00000100:00100000:0.0:1788361142.434579:0:18612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144095360 00000100:00100000:0.0:1788361142.434588:0:18612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144095360 00000100:00100000:0.0:1788361142.434613:0:18612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788361142.434619:0:18612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3311:x1875232144095360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361142.434647:0:18612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3311:x1875232144095360:12345-0@lo:400:kworker.0 Request processed in 29us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361142.434653:0:18612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788361143.144809:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130508160 00000100:00100000:0.0:1788361143.144817:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130508160 00000100:00100000:0.0:1788361143.144879:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:0.0:1788361143.144889:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+36:18262:x1875232130508160:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788361143.144920:0:18620:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788361143.146273:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+36:18262:x1875232130508160:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 1376us (3586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361143.146284:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:0.0:1788361143.200138:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130509312 00000100:00100000:0.0:1788361143.200150:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130509312 00000100:00100000:0.0:1788361143.200211:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1788361143.200222:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+37:18262:x1875232130509312:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361143.200244:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361143.200268:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6612476 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e9df expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.200308:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d661247d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.200322:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d661247d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.200351:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d661247d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.200460:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6612476 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e9df expref: 39 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.200478:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d661247d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e9df expref: 38 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.200486:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361143.200489:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361143.200493:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965200, rc 0) 00000100:00100000:0.0:1788361143.200554:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+38:18262:x1875232130509312:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 334us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361143.200562:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1788361143.211432:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130509696 00000100:00100000:0.0:1788361143.211442:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130509696 00000100:00100000:0.0:1788361143.211503:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:0.0:1788361143.211514:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+40:18262:x1875232130509696:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361143.211539:0:18620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361143.211561:0:18620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661248b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86e9e6 expref: -99 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.211626:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661248b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e9e6 expref: 41 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.211642:0:18620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661248b lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e9e6 expref: 41 pid: 18620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.211677:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361143.211680:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361143.211684:0:18620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965000, rc 0) 00000100:00100000:0.0:1788361143.211746:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+41:18262:x1875232130509696:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 234us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361143.211753:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:0.0:1788361143.215022:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130509824 00000100:00100000:0.0:1788361143.215032:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130509824 00000100:00100000:0.0:1788361143.215147:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1788361143.215226:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2350:x1875232130509824:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788361143.215587:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2350:x1875232130509824:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 429us (650us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788361143.221400:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1788361143.259989:0:18605:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:18605:1875232144096256:192.168.203.60@tcp:105: 00010000:00010000:0.0:1788361143.260019:0:18605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361143.260080:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+7:2349:x1875232130511104:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 8116us (8403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361143.260111:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:0.0:1788361143.268323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361143.268679:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:0.0:1788361143.268691:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+42:18262:x1875232130511360:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000020:00080000:0.0:1788361143.308074:0:18657:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8589934631 committed batchid 8589934629 00000020:00080000:0.0:1788361143.308280:0:18657:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934629 00000100:00100000:0.0:1788361143.312716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1788361143.366022:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66124ae lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.366041:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66124ae lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.366048:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66124ae lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.366054:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361143.366059:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66124ae lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.366067:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66124ae lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.366113:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0xa:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361143.366117:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361143.366122:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66124ae lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.366128:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66124ae lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361143.369022:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130511872 00000100:00100000:0.0:1788361143.369036:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130511872 00000100:00100000:0.0:1788361143.369161:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788361143.369171:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2350:x1875232130511872:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788361143.369541:0:19255:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:0.0:1788361143.369546:0:19255:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb mtime from disk: 1788361143 -> 1788361141 00002000:00010000:0.0:1788361143.369563:0:19255:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb atime from disk: 0 -> 1788361142 00002000:00010000:0.0:1788361143.369566:0:19255:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb ctime from disk: 1788361143 -> 1788361141 00002000:00010000:0.0:1788361143.369568:0:19255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x43:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788361143.369637:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+7:2350:x1875232130511872:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 467us (2043us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788361143.369645:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788361143.386609:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130512512 00000100:00100000:0.0:1788361143.386619:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130512512 00010000:00010000:0.0:1788361143.386666:0:18605:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d66124a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e9fb expref: 8 pid: 20647 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361143.386705:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361143.386713:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+8:2349:x1875232130512512:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361143.386730:0:18605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361143.386753:0:18605:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d66124a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e9fb expref: 8 pid: 20647 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.386767:0:18605:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d66124a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e9fb expref: 8 pid: 20647 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.386792:0:18605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361143.386797:0:18605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x43:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361143.386803:0:18605:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d66124bc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.386824:0:18605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d66124bc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x43:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361143.386861:0:18605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361143.386925:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+8:2349:x1875232130512512:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 212us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361143.386934:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361143.401892:0:18624:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144096896 00000100:00100000:0.0:1788361143.401959:0:18624:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144096896 00000040:00080000:0.0:1788361143.410232:0:18654:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788361143.410238:0:18654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361143.410285:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 4 count 4 00000040:00080000:0.0:1788361143.410291:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788361143.413692:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130513280 00000100:00100000:0.0:1788361143.413697:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130513280 00000100:00100000:0.0:1788361143.413725:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:0.0:1788361143.413734:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+23:18261:x1875232130513024:12345-192.168.203.60@tcp:49:lfs.0 00000100:00100000:0.0:1788361143.413875:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+23:18261:x1875232130513024:12345-192.168.203.60@tcp:49:lfs.0 Request processed in 141us (4645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361143.413882:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:0.0:1788361143.419290:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130513536 00000100:00100000:0.0:1788361143.419302:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130513536 00010000:00010000:1.0:1788361143.474833:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d66124e6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361143.474853:0:18619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66124ed lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361143.474859:0:18619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66124ed lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361143.474864:0:18619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66124ed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361143.474869:0:18619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361143.474872:0:18619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66124ed lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361143.474877:0:18619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66124ed lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361143.474884:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0xa340e02b (ffff9a8a99526800) 00010000:00010000:1.0:1788361143.474886:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361143.474889:0:18619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66124ed lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361143.474894:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66124ed lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x4:0x0].0xa340e02b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361143.474939:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66124df lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea02 expref: 26 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361143.474953:0:18619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d66124f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea02 expref: 25 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361143.474970:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:1.0:1788361143.474973:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361143.474975:0:18619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e200, rc 0) 00000100:00100000:1.0:1788361143.475006:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+25:18264:x1875232130513664:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 11881us (12155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361143.475013:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00000040:00080000:0.0:1788361144.136343:0:21411:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788361144.136353:0:21411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361144.136419:0:21411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:0.0:1788361144.136426:0:21411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:1.0:1788361144.352422:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361144.416362:0:18654:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788361144.416373:0:18654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361144.416426:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:0.0:1788361144.416433:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788361144.416570:0:18654:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18654:1875232144097536:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361144.416679:0:18654:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88361600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361144.420280:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130514176 00000100:00100000:1.0:1788361144.420288:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130514176 00000100:00100000:0.0:1788361144.420296:0:18654:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18654:1875232144097536:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361144.420413:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:1.0:1788361144.420424:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+25:18276:x1875232130514176:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788361144.420473:0:18620:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000013a1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788361144.420583:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+25:18276:x1875232130514176:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 161us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361144.420590:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:0.0:1788361144.440521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361144.440599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361144.440983:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130514688 00000100:00100000:1.0:1788361144.440987:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130514688 00000100:00100000:1.0:1788361144.441068:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:1.0:1788361144.441077:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+26:18276:x1875232130514688:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788361144.441194:0:18620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6612510 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361144.441209:0:18620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6612510 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361144.441219:0:18620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6612510 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361144.441673:0:18620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6612510 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361144.441682:0:18620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6612510 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361144.441689:0:18620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6612510 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361144.441696:0:18620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361144.441700:0:18620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6612510 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361144.441708:0:18620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6612510 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361144.441719:0:18620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x5:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:1.0:1788361144.441723:0:18620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361144.441727:0:18620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6612510 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361144.441733:0:18620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6612510 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361144.441869:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+27:18276:x1875232130514688:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 792us (1357us total) trans 12884901996 rc 0/0 00000100:00100000:1.0:1788361144.441876:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00000040:00080000:0.0:1788361144.442020:0:18654:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788361144.442024:0:18654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361144.442585:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 64768 count 5 00000040:00080000:0.0:1788361144.442594:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788361144.446193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361144.446286:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130515072 00000100:00100000:1.0:1788361144.446296:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130515072 00000100:00100000:1.0:1788361144.446345:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:1.0:1788361144.446368:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0866c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+27:18276:x1875232130515072:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788361144.446637:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0866c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+28:18276:x1875232130515072:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 270us (452us total) trans 12884901997 rc 0/0 00000100:00100000:1.0:1788361144.446645:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00010000:00010000:0.0:1788361145.376289:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361145.900317:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130515328 00000100:00100000:1.0:1788361145.900328:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130515328 00000100:00100000:1.0:1788361145.900395:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:1.0:1788361145.900405:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+28:18294:x1875232130515328:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361145.900431:0:18619:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361145.900453:0:18619:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6612517 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ea10 expref: -99 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361145.900720:0:18619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d661251e lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361145.900738:0:18619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d661251e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361145.900750:0:18619:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d661251e lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18619 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361145.900763:0:18619:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x4:0x0]: returning size 7680 00010000:00010000:1.0:1788361145.900928:0:18619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6612517 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea10 expref: 31 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361145.900948:0:18619:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d661251e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea10 expref: 30 pid: 18619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361145.900967:0:18619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x4:0x0].0x0 (ffff9a8a99526600) 00010000:00010000:1.0:1788361145.900970:0:18619:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788361145.900973:0:18619:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce400, rc 0) 00000100:00100000:1.0:1788361145.901238:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+30:18294:x1875232130515328:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 833us (1058us total) trans 12884901998 rc 0/0 00000100:00100000:1.0:1788361145.901245:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:0.0:1788361145.996618:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130515456 00000100:00100000:0.0:1788361145.996629:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130515456 00000100:00100000:0.0:1788361145.996692:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:0.0:1788361145.996706:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:2351:x1875232130515456:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361145.996780:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:2351:x1875232130515456:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 76us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361145.996788:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:1.0:1788361145.997250:0:20647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130515584 00000100:00100000:1.0:1788361145.997256:0:20647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130515584 00000100:00100000:1.0:1788361145.997311:0:20647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1788361145.997319:0:20647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2352:x1875232130515584:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361145.997365:0:20647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2352:x1875232130515584:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 47us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361145.997382:0:20647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788361145.998563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361145.998715:0:19254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130515712 00000100:00100000:1.0:1788361145.998722:0:19254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130515712 00000100:00100000:1.0:1788361145.998809:0:19254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:1.0:1788361145.998818:0:19254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2351:x1875232130515712:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361145.998874:0:19254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+6:2351:x1875232130515712:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 57us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361145.998881:0:19254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000001:00080000:1.0:1788361147.125523:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901907 is committed 00000001:00080000:1.0:1788361147.125543:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901905 is committed 00010000:00010000:1.0:1788361147.424368:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361147.552369:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144097664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361147.552445:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361147.553370:0:19256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144097664 00000100:00100000:1.0:1788361147.553394:0:19256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144097664 00000100:00100000:1.0:1788361147.553467:0:19256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361147.553476:0:19256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144097664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361147.553511:0:19256:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361147.553575:0:19256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144097664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361147.553582:0:19256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361147.553683:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3311:1875232144097792:0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.553718:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361147.553746:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144098304:0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.553775:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361147.553807:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361147.553813:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144097920:0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.553840:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361147.553870:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144097792 00000100:00100000:1.0:1788361147.553874:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144097792 00000100:00100000:1.0:1788361147.553901:0:18614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788361147.553908:0:18614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3311:x1875232144097792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.553942:0:18614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3311:x1875232144097792:12345-0@lo:400:kworker.0 Request processed in 34us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361147.553948:0:18614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788361147.553974:0:18619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144098304 00000100:00100000:1.0:1788361147.553977:0:18619:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144098304 00000100:00100000:1.0:1788361147.554005:0:18619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361147.554011:0:18619:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144098304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.554041:0:18619:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144098304:12345-0@lo:400:kworker.0 Request processed in 30us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361147.554056:0:18619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361147.554074:0:20647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144097920 00000100:00100000:1.0:1788361147.554078:0:20647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144097920 00000100:00100000:1.0:1788361147.554138:0:20647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361147.554144:0:20647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144097920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.554178:0:20647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144097920:12345-0@lo:400:kworker.0 Request processed in 33us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361147.554183:0:20647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361147.554204:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144098048:0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.554227:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361147.554248:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361147.554254:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144098176:0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.554276:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361147.554302:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144098048 00000100:00100000:1.0:1788361147.554305:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144098048 00000100:00100000:1.0:1788361147.554322:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144098176 00000100:00100000:1.0:1788361147.554324:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144098176 00000100:00100000:1.0:1788361147.554342:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788361147.554347:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144098048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.554388:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144098048:12345-0@lo:400:kworker.0 Request processed in 41us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361147.554393:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788361147.554404:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788361147.554409:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144098176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.554431:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144098176:12345-0@lo:400:kworker.0 Request processed in 22us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361147.554903:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144098176:0@lo:400:kworker.0 00000100:00100000:0.0:1788361147.554919:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144098048:0@lo:400:kworker.0 00000100:00100000:1.0:1788361147.558066:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788361148.449388:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788361148.581324:0:18642:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 538596234561ns, next at 539596232614ns, rc = 0 00000100:00100000:1.0:1788361148.581608:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144098432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361148.581688:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361148.581763:0:19256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144098432 00000100:00100000:1.0:1788361148.581772:0:19256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144098432 00000100:00100000:1.0:1788361148.581817:0:19256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361148.581825:0:19256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144098432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361148.581859:0:19256:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 69795840 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361148.581904:0:19256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144098432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361148.581911:0:19256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361148.582042:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144098432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361148.635607:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144098560:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788361148.635685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361149.864741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00080000:1.0:1788361149.866239:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361149.872195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361149.872371:0:18622:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130516224 00000100:00100000:1.0:1788361149.872382:0:18622:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130516224 00000100:00100000:1.0:1788361149.872442:0:18622:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1788361149.872452:0:18622:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+16:18117:x1875232130516224:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788361149.872969:0:18622:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+17:18117:x1875232130516224:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 516us (782us total) trans 12884901999 rc 0/0 00000100:00100000:1.0:1788361149.878755:0:18622:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00010000:00010000:0.0:1788361150.496886:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361151.124907:0:20647:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130516736 00000100:00100000:0.0:1788361151.124920:0:20647:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130516736 00000100:00100000:0.0:1788361151.124981:0:20647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788361151.124993:0:20647:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2352:x1875232130516736:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361151.125069:0:20647:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2352:x1875232130516736:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 79us (6294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361151.125076:0:20647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00010000:00010000:1.0:1788361152.544477:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361152.674124:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361152.674138:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788361152.674147:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144099200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361152.675074:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144099200:12345-0@lo:400:kworker.0 Request processed in 925us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361152.675099:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788361152.675132:0:18613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144098688 00000100:00100000:0.0:1788361152.675137:0:18613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144098688 00000100:00100000:1.0:1788361152.675277:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144098816:0@lo:400:kworker.0 00000100:00100000:1.0:1788361152.675346:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361152.675369:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788361152.675390:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361152.675408:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361152.675413:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144098944:0@lo:400:kworker.0 00000100:00100000:1.0:1788361152.675430:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361152.675454:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144098816 00000100:00100000:1.0:1788361152.675457:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144098816 00000100:00100000:1.0:1788361152.675487:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144098944 00000100:00100000:1.0:1788361152.675490:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144098944 00000100:00100000:1.0:1788361152.675508:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788361152.675514:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144098816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361152.675551:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144098816:12345-0@lo:400:kworker.0 Request processed in 37us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361152.675557:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788361152.675569:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788361152.675574:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144098944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361152.675601:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144098944:12345-0@lo:400:kworker.0 Request processed in 27us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361152.675607:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788361152.675643:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361152.675647:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361152.675670:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901897 gen 2 00000004:00080000:1.0:1788361152.675675:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901897 committed transno 12884901897 00000100:00100000:1.0:1788361152.675700:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144098944:0@lo:400:kworker.0 00000100:00100000:1.0:1788361152.675709:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901908 gen 2 00000004:00080000:1.0:1788361152.675720:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a83543800, transno 12884901908 00000100:00100000:1.0:1788361152.675731:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144098816:0@lo:400:kworker.0 00000100:00100000:0.0:1788361152.676036:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788361152.676046:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3313:x1875232144098688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361152.676081:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+19:3313:x1875232144098688:12345-0@lo:400:kworker.0 Request processed in 37us (2408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361152.676109:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788361152.676306:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144099456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361152.676640:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361152.676679:0:19256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144099456 00000100:00100000:0.0:1788361152.676684:0:19256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144099456 00000100:00100000:0.0:1788361152.676724:0:19256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361152.676731:0:19256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144099456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361152.678067:0:19256:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361152.678144:0:19256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144099456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1411us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361152.678152:0:19256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361152.678611:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788361152.678659:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144099456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361153.185534:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130516992 00000100:00100000:0.0:1788361153.185544:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130516992 00000100:00100000:0.0:1788361153.185626:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 136 00000100:00100000:0.0:1788361153.185639:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+5:18926:x1875232130516992:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:0.0:1788361153.185661:0:18621:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361153.185683:0:18621:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6612533 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ea17 expref: -99 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361153.185773:0:18621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661253a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361153.185787:0:18621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661253a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361153.185801:0:18621:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661253a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361153.186514:0:18621:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361153.186521:0:18621:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361153.186638:0:18621:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661253a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18621 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361153.186679:0:18621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6612533 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea17 expref: 7 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361153.186821:0:18621:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661253a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea17 expref: 6 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361153.186832:0:18621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526200) 00010000:00010000:0.0:1788361153.186835:0:18621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361153.186839:0:18621:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965400, rc 0) 00000100:00100000:0.0:1788361153.186900:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+6:18926:x1875232130516992:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 1263us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361153.186907:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 136 00010000:00010000:0.0:1788361153.571599:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361154.492354:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130517248 00000100:00100000:0.0:1788361154.492365:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130517248 00000100:00100000:0.0:1788361154.492438:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:0.0:1788361154.492449:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+16:18927:x1875232130517248:12345-192.168.203.60@tcp:35:umount.0 00000001:00080000:0.0:1788361154.492759:0:18623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902000 00000001:00080000:0.0:1788361154.492836:0:18623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884902001 00000100:00100000:0.0:1788361154.492984:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+19:18927:x1875232130517248:12345-192.168.203.60@tcp:35:umount.0 Request processed in 536us (1023us total) trans 12884902002 rc 0/0 00000100:00100000:0.0:1788361154.492993:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000020:00080000:0.0:1788361154.492998:0:18623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788361154.500705:0:18623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130517504 00000100:00100000:0.0:1788361154.500720:0:18623:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130517504 00000100:00100000:0.0:1788361154.500787:0:18623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788361154.500796:0:18623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+19:18927:x1875232130517504:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:0.0:1788361154.501414:0:18623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+20:18927:x1875232130517504:12345-192.168.203.60@tcp:35:umount.0 Request processed in 616us (889us total) trans 12884902003 rc 0/0 00000100:00100000:0.0:1788361154.501429:0:18623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:1.0:1788361154.506953:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130517632 00000100:00100000:1.0:1788361154.506965:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130517632 00000100:00100000:1.0:1788361154.507031:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130517888 00000100:00100000:1.0:1788361154.507034:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130517888 00000100:00100000:1.0:1788361154.507045:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130517760 00000100:00100000:1.0:1788361154.507047:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130517760 00000100:00100000:1.0:1788361154.507060:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361154.507067:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89870a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+15:2349:x1875232130517632:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361154.507082:0:18606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361154.507131:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964600/0xf6a94c97d6611d37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e746 expref: 15 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361154.507148:0:18606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361154.507209:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89870a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+14:2349:x1875232130517632:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 142us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361154.507215:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361154.507263:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361154.507269:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+13:2349:x1875232130517888:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361154.507278:0:18606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361154.507288:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573f200/0xf6a94c97d6611f2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e873 expref: 13 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361154.507329:0:18606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361154.507352:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:2349:x1875232130517888:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 82us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361154.507358:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361154.507373:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1788361154.507379:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:2349:x1875232130517760:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361154.507386:0:18606:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361154.507396:0:18606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e800/0xf6a94c97d6611d3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e770 expref: 11 pid: 18614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361154.507405:0:18606:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361154.507421:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:2349:x1875232130517760:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 42us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361154.507427:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1788361154.524735:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130518016 00000100:00100000:1.0:1788361154.524747:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130518016 00000100:00100000:1.0:1788361154.524880:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:1.0:1788361154.525043:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2348:x1875232130518016:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:1.0:1788361154.525137:0:19255:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611d5a 00000100:00080000:1.0:1788361154.525147:0:19255:0:(import.c:65:import_set_state_nolock()) ffff9a898694b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361154.525189:0:19255:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901897 00000100:00100000:1.0:1788361154.525534:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6dc24666-75f2-466e-bd74-ac2809e63d73+2:2348:x1875232130518016:12345-192.168.203.60@tcp:9:umount.0 Request processed in 643us (1016us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361154.525594:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361154.525886:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1788361154.535736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361154.539219:0:19253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130518144 00000100:00100000:1.0:1788361154.539246:0:19253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130518144 00000100:00100000:1.0:1788361154.539358:0:19253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788361154.539368:0:19253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+5:2348:x1875232130518144:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:1.0:1788361154.539404:0:19253:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611d53 00000100:00080000:1.0:1788361154.539412:0:19253:0:(import.c:65:import_set_state_nolock()) ffff9a898694e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361154.539451:0:19253:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901908 00000100:00100000:1.0:1788361154.539697:0:19253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6dc24666-75f2-466e-bd74-ac2809e63d73+2:2348:x1875232130518144:12345-192.168.203.60@tcp:9:umount.0 Request processed in 329us (3971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361154.539704:0:19253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788361154.545328:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130519296 00000100:00100000:1.0:1788361154.545337:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130519296 00000100:00100000:1.0:1788361154.545398:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:1.0:1788361154.545407:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+20:2348:x1875232130519296:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:1.0:1788361154.545438:0:18620:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611d4c 00000020:00010000:1.0:1788361154.545453:0:18620:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a83e4e000: total 0 00000100:00080000:1.0:1788361154.545458:0:18620:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361154.545487:0:18620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884902003 00000100:00100000:1.0:1788361154.545833:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6dc24666-75f2-466e-bd74-ac2809e63d73+19:2348:x1875232130519296:12345-192.168.203.60@tcp:39:umount.0 Request processed in 426us (686us total) trans 12884902004 rc 0/0 00000100:00100000:1.0:1788361154.545842:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 137 00010000:00010000:0.0:1788361154.593135:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361154.720366:0:18654:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788361154.720376:0:18654:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361154.720416:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 5 00000040:00080000:1.0:1788361154.720422:0:18654:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788361155.883651:0:18604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130519680 00000100:00100000:0.0:1788361155.883656:0:18604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130519680 00000100:00100000:0.0:1788361155.883706:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1788361155.883718:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+12:2350:x1875232130519424:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361155.883745:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361155.883772:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964800/0xf6a94c97d6611d6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7a8 expref: 12 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361155.883790:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361155.883858:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+11:2350:x1875232130519424:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 143us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361155.883866:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1788361155.883884:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361155.883890:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+10:2350:x1875232130519680:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361155.883898:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361155.883907:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964a00/0xf6a94c97d6611f28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e86c expref: 10 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361155.883916:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361155.883934:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+9:2350:x1875232130519680:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 44us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361155.883952:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361155.883987:0:18604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361155.883994:0:18604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+8:2350:x1875232130519552:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361155.884003:0:18604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361155.884014:0:18604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965c00/0xf6a94c97d6611d76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86e7d2 expref: 8 pid: 18613 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361155.884023:0:18604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361155.884283:0:18604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+7:2350:x1875232130519552:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 288us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361155.884290:0:18604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361155.896975:0:18621:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130519936 00000100:00100000:0.0:1788361155.896987:0:18621:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130519936 00000100:00100000:0.0:1788361155.897073:0:18621:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:0.0:1788361155.897099:0:18621:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+6:2348:x1875232130519936:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:0.0:1788361155.897142:0:18621:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611d84 00000020:00010000:0.0:1788361155.897150:0:18621:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a83e4b000: total 0 00000100:00080000:0.0:1788361155.897154:0:18621:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361155.897177:0:18621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884902004 00000100:00100000:0.0:1788361155.897410:0:18621:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2329b358-e201-4b49-9217-354f420c399f+5:2348:x1875232130519936:12345-192.168.203.60@tcp:39:umount.0 Request processed in 326us (1577us total) trans 12884902005 rc 0/0 00000100:00100000:0.0:1788361155.897426:0:18621:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 138 00000020:00010000:0.0:1788361155.897476:0:18608:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a83e4b000: total 0 00010000:00010000:0.0:1788361155.897511:0:18608:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a83e4b000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788361155.897543:0:18608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a99526200) 00010000:00010000:0.0:1788361155.897547:0:18608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361155.897555:0:18608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661253a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea17 expref: 4 pid: 18621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361155.897606:0:18608:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a83e4b000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788361155.897618:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361155.897620:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361155.897622:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361155.898472:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361155.913991:0:18614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130520192 00000100:00100000:1.0:1788361155.914008:0:18614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130520192 00000100:00100000:0.0:1788361155.914372:0:18613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:0.0:1788361155.914385:0:18613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+7:2348:x1875232130520192:12345-192.168.203.60@tcp:251:umount.0 00000020:00000080:0.0:1788361155.914432:0:18613:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611d29 00000020:00010000:0.0:1788361155.914440:0:18613:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a89850ed000: total 0 00000100:00080000:0.0:1788361155.914444:0:18613:0:(import.c:65:import_set_state_nolock()) ffff9a89850e8000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788361155.914590:0:18613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d+3:2348:x1875232130520192:12345-192.168.203.60@tcp:251:umount.0 Request processed in 207us (5457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361155.914599:0:18613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00000020:00000080:1.0:1788361155.915994:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89850ed000/2cc79cbc-6a3d-4ae5-a8f8-4d8bfccffc2d for MGS 00000020:00000080:1.0:1788361155.916048:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89850e8000 for MGS 00010000:00010000:0.0:1788361156.641471:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361157.298046:0:21859:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00100000:1.0:1788361157.324190:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144099712:0@lo:39:umount.0 00000100:00100000:1.0:1788361157.324221:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361157.324580:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac0c02800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788361157.324597:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144099712:0@lo:39:umount.0 00000100:00100000:1.0:1788361157.327517:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144099968:0@lo:9:umount.0 00000100:00100000:1.0:1788361157.327551:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361157.327588:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144100096:0@lo:9:umount.0 00000100:00100000:1.0:1788361157.327607:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361157.327636:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3312:1875232144100352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361157.327659:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361157.327676:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361157.327682:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3312:1875232144100224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361157.327701:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361157.327725:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144099968 00000100:00100000:1.0:1788361157.327729:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144099968 00000100:00100000:1.0:1788361157.327773:0:19255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144100096 00000100:00100000:1.0:1788361157.327776:0:19255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144100096 00000100:00100000:1.0:1788361157.327798:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361157.327806:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144099968:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788361157.327832:0:19255:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611ae4 00000100:00080000:1.0:1788361157.327841:0:19255:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361157.327878:0:19255:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901908 00000100:00100000:1.0:1788361157.328241:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144099968:12345-0@lo:9:umount.0 Request processed in 436us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361157.328248:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361157.328270:0:19255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788361157.328277:0:19255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144100096:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788361157.328289:0:19255:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611c49 00000100:00080000:1.0:1788361157.328306:0:19255:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361157.328328:0:19255:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901897 00000100:00100000:1.0:1788361157.328437:0:19255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144100096:12345-0@lo:9:umount.0 Request processed in 160us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361157.328444:0:19255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788361157.328462:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361157.328466:0:18615:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361157.328497:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c4800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788361157.328512:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788361157.328514:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361157.328518:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144099968:0@lo:9:umount.0 00000100:00080000:1.0:1788361157.328529:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788361157.328533:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788361157.328535:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361157.328537:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144100096:0@lo:9:umount.0 00010000:00010000:1.0:1788361157.328558:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361157.328571:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361157.328581:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144100352 00000100:00100000:1.0:1788361157.328585:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144100352 00000100:00100000:1.0:1788361157.328607:0:18605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144100224 00000100:00100000:1.0:1788361157.328611:0:18605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144100224 00000100:00100000:1.0:1788361157.328625:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361157.328631:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+17:3312:x1875232144100352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361157.328640:0:18605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361157.328654:0:18605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ac06c9400/0xf6a94c97d6611c42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6611c3b expref: 17 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361157.328682:0:18605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361157.328714:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+16:3312:x1875232144100352:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361157.328720:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361157.328732:0:18605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361157.328737:0:18605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+15:3312:x1875232144100224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361157.328744:0:18605:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361157.328752:0:18605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d661198d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6611986 expref: 15 pid: 18612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361157.328759:0:18605:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361157.328778:0:18605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2cb705f4-a3cf-4d33-acc9-f3301f47b64a+14:3312:x1875232144100224:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361157.328783:0:18605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361157.328805:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3312:1875232144100224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361157.328813:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3312:1875232144100352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361157.328832:0:19344:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788361157.329279:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89852f6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788361157.329342:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e4f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788361157.329368:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a856ed800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788361157.329395:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89852f2000 for lustre-MDT0000 00000020:00000080:1.0:1788361157.329403:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83e4a000 for lustre-MDT0000 00000020:00000080:1.0:1788361157.329407:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a856ea000 for lustre-MDT0000 00000001:00100000:1.0:1788361157.337715:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6dc24666-75f2-466e-bd74-ac2809e63d73 00000020:00000080:1.0:1788361157.337725:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a898694a000/6dc24666-75f2-466e-bd74-ac2809e63d73 00000020:00000080:0.0:1788361157.337796:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a898694a000/6dc24666-75f2-466e-bd74-ac2809e63d73 for lustre-OST0000 00000020:00000080:0.0:1788361157.337845:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a898694e000 for lustre-OST0000 00000020:00000080:1.0:1788361157.394726:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788361157.394778:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361157.394790:0:21859:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788361157.394796:0:21859:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9a8ab77a19c0) has no exports 00000020:00000080:0.0:1788361157.395398:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66119cc 00000020:00000080:0.0:1788361157.395404:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c68000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361157.395456:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361157.395464:0:21859:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788361157.395467:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6a800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788361157.395469:0:21859:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788361157.395476:0:21859:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788361157.395635:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c68000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788361157.664603:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361157.812823:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144100992:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788361157.812893:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361157.814008:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144101120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788361157.814054:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361157.814497:0:18620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144101120 00000100:00100000:1.0:1788361157.814503:0:18620:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144101120 00000100:00100000:1.0:1788361157.814528:0:18620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788361157.814534:0:18620:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144101120:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1788361157.814545:0:18620:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788361157.815054:0:18620:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144101120:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 518us (998us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361157.815062:0:18620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1788361157.815545:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a89248800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361157.815550:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361157.815554:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144101120:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788361157.829021:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89850eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361157.829026:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361157.829030:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144100992:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1788361158.688871:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788361158.861756:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e4a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788361158.861808:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8986949800/6dc24666-75f2-466e-bd74-ac2809e63d73 for lustre-OST0001 00000020:00000080:1.0:1788361158.861831:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83e4c000 for lustre-OST0001 00000020:00000080:1.0:1788361158.861836:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a898694b800 for lustre-OST0001 00000004:00080000:1.0:1788361159.562296:0:18641:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788361159.562301:0:18641:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x10:0x0] index 4 count 1 00000040:00080000:1.0:1788361159.562311:0:18641:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 3 count 2 00000004:00080000:0.0:1788361159.564591:0:18643:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788361159.564611:0:18643:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x12:0x0] index 3 count 1 00000040:00080000:0.0:1788361159.564622:0:18643:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 3 count 2 00000020:00000080:0.0:1788361159.648888:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661199b 00000020:00000080:0.0:1788361159.648901:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8a8a11d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361159.649659:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66119b0 00000020:00000080:0.0:1788361159.649666:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8a83778800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361159.650074:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a11d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788361159.650185:0:21859:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788361159.650191:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361159.650199:0:21859:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361159.650203:0:21859:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9a8ab77a3380) has no exports 00000004:01000000:0.0:1788361159.650546:0:21859:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788361159.650554:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66119fd 00000020:00000080:0.0:1788361159.650560:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8a8377a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361159.650579:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83778800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788361159.650862:0:21859:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788361159.650867:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361159.650872:0:21859:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788361159.650875:0:21859:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9a8984a58000) has no exports 00000020:00000080:0.0:1788361159.650881:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66119f6 00000020:00000080:0.0:1788361159.650885:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8a8377e000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788361159.651523:0:21859:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788361159.651528:0:21859:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788361159.651532:0:21859:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901897 gen 5 00000004:00080000:0.0:1788361159.651538:0:21859:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361159.651540:0:21859:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361159.651570:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361159.651577:0:21859:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361159.651582:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66119e8 00000020:00000080:0.0:1788361159.651587:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8a8377c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788361159.651591:0:21859:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788361159.651595:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361159.651598:0:21859:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788361159.651600:0:21859:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9a8a857119c0) has no exports 00000020:00000080:0.0:1788361159.651604:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66119e1 00000020:00000080:0.0:1788361159.651617:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8ac05c6800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788361159.651952:0:21859:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788361159.651956:0:21859:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788361159.651958:0:21859:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901908 gen 5 00000004:00080000:0.0:1788361159.651962:0:21859:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361159.651963:0:21859:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361159.651987:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361159.651992:0:21859:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361159.652019:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361159.652022:0:21859:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361159.652026:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8a89869800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361159.652029:0:21859:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a89869800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788361159.652034:0:21859:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361159.652356:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8377a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788361159.652365:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8377e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361159.652369:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ac05c3000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788361159.652374:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a8a8377d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361159.652377:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8377d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788361159.652382:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361159.652428:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8377c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788361159.652432:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac05c6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361159.652436:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ac05c4800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788361159.652440:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a8ac05c1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361159.652442:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac05c1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788361159.652445:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361159.652530:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66119b7 00000020:00000080:0.0:1788361159.652535:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8a83778000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788361159.652550:0:21859:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788361159.652554:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361159.652558:0:21859:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361159.652561:0:21859:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9a8984a599c0) has no exports 00000020:00000080:0.0:1788361159.652578:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361159.652582:0:21859:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788361159.652585:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66119be 00000020:00000080:0.0:1788361159.652588:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8a83779000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788361159.652603:0:21859:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8ab6fbc800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788361159.652606:0:21859:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8ab6fbc800 3 00000020:01000004:0.0:1788361159.652609:0:21859:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8ab6fbc800 from lustre-MDT0000 00000020:00000080:0.0:1788361159.652629:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361159.652632:0:21859:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788361159.652634:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8a8a11a000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788361159.652636:0:21859:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a11a000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788361159.652642:0:21859:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788361159.652665:0:21859:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788361159.652676:0:21859:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788361159.652679:0:21859:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788361159.652682:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361159.652684:0:21859:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788361159.652691:0:21859:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9a8a9835a800 2cb705f4-a3cf-4d33-acc9-f3301f47b64a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361159.652696:0:21859:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9a8ab77a0000) has exports, disconnecting them 00000020:00080000:0.0:1788361159.652700:0:21859:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a8a9835a800), last request at 1788361092 00000020:00000080:0.0:1788361159.652713:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611963 00000020:00010000:0.0:1788361159.652716:0:21859:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a9835a800: total 2 00000100:00080000:0.0:1788361159.652720:0:21859:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a10b000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788361159.652744:0:21859:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a9835a800): rc 0 00000020:00080000:0.0:1788361159.652748:0:21859:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9a8ab77a0000) has no exports 00000020:00000080:1.0:1788361159.653556:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83778000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788361159.653560:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a8a8377a000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788361159.653562:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8377a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788361159.653566:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788361159.653706:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83779000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361159.653710:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9835a800/2cb705f4-a3cf-4d33-acc9-f3301f47b64a for MGS 00000020:00000080:1.0:1788361159.653737:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a10b000 for MGS 00000100:00100000:1.0:1788361159.653767:0:18614:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a8a85e99400:18614] 2 exiting: rc = 0 00000100:00100000:1.0:1788361159.654429:0:18613:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a8a85e99e00:18613] 1 exiting: rc = 0 00000100:00100000:0.0:1788361159.654573:0:18612:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a8a8a130400:18612] 0 exiting: rc = 1 00000020:00000080:1.0:1788361159.659839:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84582000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361159.659957:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac0c01000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788361159.665507:0:21859:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788361159.665518:0:21859:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361159.665522:0:21859:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788361159.665530:0:21859:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361159.665736:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ac0c02800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788361159.665803:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361159.665811:0:21859:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788361159.665817:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8ab77b6800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788361159.665821:0:21859:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab77b6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788361159.665827:0:21859:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788361159.665890:0:21859:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8ab6fbc800 1 00000020:00000080:0.0:1788361159.665895:0:21859:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611939 00000020:00000080:0.0:1788361159.665901:0:21859:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fb9800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788361159.665915:0:21859:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788361159.665919:0:21859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361159.665923:0:21859:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361159.665926:0:21859:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9a8ab77a4d40) has no exports 00000020:00000080:1.0:1788361159.665988:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fb9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788361159.702345:0:18620:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a8985353a00:18620] 1 exiting: rc = 0 00000100:00100000:0.0:1788361159.706988:0:18652:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a8abcbcca00:18652] 3 exiting: rc = 0 00000100:00100000:1.0:1788361159.712257:0:18622:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a8985353000:18622] 0 exiting: rc = 1 00000100:00100000:1.0:1788361159.713668:0:18624:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a8a85752200:18624] 0 exiting: rc = 1 00000100:00100000:0.0:1788361159.722418:0:18626:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a8a85752800:18626] 0 exiting: rc = 1 00000100:00100000:1.0:1788361159.723711:0:18628:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a8a85753e00:18628] 0 exiting: rc = 1 00000100:00100000:0.0:1788361159.724963:0:18631:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a8a86bdc000:18631] 1 exiting: rc = 0 00000100:00100000:1.0:1788361159.725415:0:18630:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a8a86bdd400:18630] 0 exiting: rc = 1 00000100:00100000:0.0:1788361159.726774:0:18632:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a8a882c0e00:18632] 0 exiting: rc = 1 00010000:00010000:1.0:1788361160.736248:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788361162.471384:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8924e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788361162.471434:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a89249800 for lustre-OST0000 00010000:00010000:1.0:1788361162.716727:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361162.716738:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361162.716748:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac06c8800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361162.716752:0:18607:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361162.716761:0:18607:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361162.716768:0:18607:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361162.716773:0:18607:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361162.716775:0:18607:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788361162.716778:0:18607:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788361162.716819:0:18607:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361162.716826:0:18607:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788361162.716912:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788361162.716975:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361162.716984:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c8800/0xf6a94c97d6611aba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611ac1 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361162.716996:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361162.717000:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361162.717006:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361162.717009:0:18607:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361162.717015:0:18607:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361162.717021:0:18607:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361162.717026:0:18607:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361162.717028:0:18607:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788361162.717042:0:18607:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361162.717047:0:18607:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788361162.717104:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3314:1875232144101376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361162.717170:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361162.717229:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3314:1875232144101248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361162.717250:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361162.717296:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144101376 00000100:00100000:0.0:1788361162.717304:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144101376 00000100:00100000:0.0:1788361162.717338:0:18606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144101248 00000100:00100000:0.0:1788361162.717341:0:18606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144101248 00000100:00100000:0.0:1788361162.717354:0:18606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361162.717362:0:18606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1875232144101376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788361162.717368:0:18606:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361162 with bad export cookie 17773821619414833507 00010000:00010000:1.0:1788361162.724485:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361162.724503:0:18607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6611a90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6611a97 expref: -99 pid: 19251 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361162.724542:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361162.724545:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361162.724547:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361162.724559:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361162.724625:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788361162.727443:0:18606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3314:x1875232144101376:12345-0@lo:103:ldlm_bl.0 Request processed in 10076us (10268us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361162.727456:0:18606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788361162.738290:0:3314:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a8ac0588000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788361162.738401:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3314:1875232144101376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361162.738408:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3314:1875232144101248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361162.738644:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a83541500 x1875232144101632/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361162.738693:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3310:1875232144101632:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788361162.738740:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875232144101632 offset 0 length 520: 4 00000100:00100000:0.0:1788361162.738796:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2cb705f4-a3cf-4d33-acc9-f3301f47b64a:3311:1875232144101504:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788361162.768822:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85599000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788361162.770976:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a89248000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788361162.771402:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a89248800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788361162.771408:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a8a83e48000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788361162.771410:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e48000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788361162.771414:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788361162.771466:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84a44000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000100:00100000:1.0:1788361162.913788:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144101760:0@lo:38:kworker.0 00000400:00000100:1.0:1788361162.913840:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144101760 offset 0 length 520: 4 00010000:00010000:1.0:1788361164.896216:0:18608:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361165.304384:0:22166:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788361165.321782:0:22166:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788361165.321863:0:22166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611c18 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.321878:0:22166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611c18 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.321885:0:22166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611c18 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.321892:0:22166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8ac06c9200/0xf6a94c97d6611c11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611c18 expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.321917:0:22166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788361165.321923:0:22166:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788361165.321957:0:22166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361165.321969:0:22166:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a843eb800 x1875232144101760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361177 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361165.321995:0:22166:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788361165.322001:0:22166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788361165.322007:0:22166:0:(import.c:65:import_set_state_nolock()) ffff9a89850eb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788361165.322012:0:22166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361165.322016:0:22166:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a843eb800 x1875232144101760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361177 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361165.322023:0:22166:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788361165.322026:0:22166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:1.0:1788361165.325254:0:22166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611bee expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.325273:0:22166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611bee expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.325281:0:22166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611bee expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.325288:0:22166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8985965e00/0xf6a94c97d6611be7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611bee expref: -99 pid: 19924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.327316:0:22166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361165.327336:0:22166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.327349:0:22166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.327377:0:22166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361165.327384:0:22166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361165.330618:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361165.330624:0:18607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361165.330630:0:18607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361165.330633:0:18607:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361165.330639:0:18607:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361165.330645:0:18607:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361165.330649:0:18607:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788361165.330651:0:18607:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788361165.330656:0:18607:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8ac0588000 00010000:00010000:0.0:1788361165.330658:0:18607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361165.330665:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361165.330667:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361165.330669:0:18607:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361165.340025:0:22166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361165.340040:0:22166:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d6611efe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6611f05 expref: -99 pid: 18616 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361165.340064:0:22166:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788361165.340072:0:22166:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1788361165.340075:0:22166:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788361165.340123:0:22166:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788361165.340128:0:22166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788361165.340137:0:22166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361165.340143:0:22166:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788361165.340147:0:22166:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a8a90bf0000) has no exports 00000020:00080000:1.0:1788361165.340167:0:22166:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a8a90bf0000) has no exports 00000020:01000000:0.0:1788361165.348479:0:22166:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8ac1ce77e0 - data ffff9a8abda4f288/ffff9a89871e7000 00000020:01000000:0.0:1788361165.348654:0:22166:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a90bfe000 - data ffff9a8aa9bdbd80/ffff9a8986950c00 00100000:10000000:0.0:1788361165.367025:0:22166:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788361165.394678:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abc48c000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788361165.395407:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac05a2800/2cb705f4-a3cf-4d33-acc9-f3301f47b64a for MGC192.168.203.160@tcp 00000020:00000080:0.0:1788361165.402389:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89850eb000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788361165.403429:0:18607:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1788361165.409055:0:18603:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a8a88337c00:18603] 1 exiting: rc = 0 00000100:00100000:0.0:1788361165.409173:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.409392:0:18606:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a8a878cbe00:18606] 2 exiting: rc = 0 00000100:00100000:0.0:1788361165.411300:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411310:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411316:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411323:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411330:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411336:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411341:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411347:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411352:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411357:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411364:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411369:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411374:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411378:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411382:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411387:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411392:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411397:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411402:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411408:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411413:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411419:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411441:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411447:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411452:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411457:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411463:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411468:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411474:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411480:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411485:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411490:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411495:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411501:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411506:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411510:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411516:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411522:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411527:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411532:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411536:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411542:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411546:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411551:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411562:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411567:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411572:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411576:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411581:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411585:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411590:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411594:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411599:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411603:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411607:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411612:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411617:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411635:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411641:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411650:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411655:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411660:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411665:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361165.411672:0:22166:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788361165.413492:0:22166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361165.413503:0:22166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788361165.413509:0:22166:0:(genops.c:906:class_export_put()) final put ffff9a898694a800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788361165.413513:0:22166:0:(genops.c:865:class_export_destroy()) destroying export ffff9a898694a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788361165.413518:0:22166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788361165.413574:0:22166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a9efca800 1 00000020:00000080:0.0:1788361165.413580:0:22166:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6611be0 00000020:00000080:0.0:1788361165.413585:0:22166:0:(genops.c:906:class_export_put()) final put ffff9a8a841a6000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788361165.413602:0:22166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788361165.413605:0:22166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361165.413610:0:22166:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361165.413613:0:22166:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a8ab7463380) has no exports 00000100:00100000:1.0:1788361165.449504:0:20647:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a8ac06f2c00:20647] 3 exiting: rc = 0 00000100:00080000:0.0:1788361165.449719:0:18615:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788361165.450495:0:19253:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a8ab76e9a00:19253] 0 exiting: rc = 1 00000100:00100000:0.0:1788361165.459111:0:19256:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a8a834b7c00:19256] 0 exiting: rc = 1 00000100:00100000:0.0:1788361165.467039:0:19258:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a8ab76e8c00:19258] 0 exiting: rc = 1 00000100:00100000:1.0:1788361165.467460:0:20651:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff9a8ab6ca3600:20651] 3 exiting: rc = 0 00000100:00100000:1.0:1788361165.468799:0:20652:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_004: service thread [ffff9a8ac05ba000:20652] 4 exiting: rc = 0 00000100:00100000:0.0:1788361165.489582:0:19262:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a8a83d4b400:19262] 1 exiting: rc = 0 00000100:00100000:1.0:1788361165.491028:0:19263:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a8ac06ee200:19263] 0 exiting: rc = 1 00000100:00100000:0.0:1788361165.491364:0:19264:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a8a82b01600:19264] 1 exiting: rc = 0 00000001:02000400:1.0:1788361179.566745:0:22783:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788361185.646543:0:23195:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788361185.646549:0:23195:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788361185.646670:0:23195:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8a84154800 00000020:01000004:0.0:1788361185.646688:0:23195:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788361185.646696:0:23195:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788361185.646710:0:23195:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a8a90bf4d40) 00000020:00000080:0.0:1788361185.646736:0:23195:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788361185.660676:0:23195:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788361185.663813:0:23195:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x37:0x0] (8/32) 00100000:10000000:0.0:1788361185.667694:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1788361185.667831:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:0.0:1788361185.667928:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:0.0:1788361185.668027:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:0.0:1788361185.668182:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:0.0:1788361185.668500:0:23195:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788361185.668573:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:0.0:1788361185.668894:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:1.0:1788361185.673457:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 660: rc = 0 00100000:10000000:1.0:1788361185.673557:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 660: rc = 0 00100000:10000000:1.0:1788361185.674926:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 790: rc = 0 00100000:10000000:1.0:1788361185.675532:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361185.677009:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 790: rc = 0 00100000:10000000:1.0:1788361185.677369:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361185.677619:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361185.679042:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 790: rc = 0 00100000:10000000:1.0:1788361185.680490:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 790: rc = 0 00100000:10000000:1.0:1788361185.681220:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361185.681488:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361185.681773:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 790: rc = 0 00100000:10000000:1.0:1788361185.682010:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361185.683674:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 790: rc = 0 00100000:10000000:1.0:1788361185.685465:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 311: rc = 0 00100000:10000000:1.0:1788361185.686843:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 311: rc = 0 00100000:10000000:1.0:1788361185.688483:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 311: rc = 0 00100000:10000000:1.0:1788361185.690414:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 311: rc = 0 00100000:10000000:1.0:1788361185.690744:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 311: rc = 0 00100000:10000000:1.0:1788361185.690987:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 311: rc = 0 00100000:10000000:1.0:1788361185.691255:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 311: rc = 0 00100000:10000000:1.0:1788361185.691469:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 311: rc = 0 00100000:10000000:1.0:1788361185.691723:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 311: rc = 0 00100000:10000000:1.0:1788361185.691968:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 311: rc = 0 00100000:10000000:1.0:1788361185.692254:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 311: rc = 0 00100000:10000000:1.0:1788361185.692496:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 311: rc = 0 00100000:10000000:1.0:1788361185.695061:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 311: rc = 0 00100000:10000000:0.0:1788361185.698583:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 311: rc = 0 00100000:10000000:0.0:1788361185.700192:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 311: rc = 0 00100000:10000000:0.0:1788361185.700489:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 311: rc = 0 00100000:10000000:0.0:1788361185.701888:0:23195:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 311: rc = 0 00010000:00010000:0.0:1788361185.719945:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361185.719949:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361185.719951:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361185.720337:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361185.720339:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361185.720342:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361185.722804:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788361185.752760:0:23195:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788361185.752859:0:23195:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361185.753365:0:23195:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788361185.754919:0:23195:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361185.755119:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788361185.755125:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788361185.756463:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788361185.756473:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788361185.761136:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788361185.761235:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788361185.762640:0:23209:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1788361185.766028:0:23195:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.160@tcp (uuid d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee) 00000020:00000080:1.0:1788361185.766052:0:23195:0:(genops.c:1406:class_connect()) connect: client d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee, cookie 0xf6a94c97d6612564 00000100:00080000:1.0:1788361185.766070:0:23195:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361185.766076:0:23195:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a89864bc000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361185.766148:0:23195:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a8926c700 x1875232144101888/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361185.766171:0:23195:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee->MGS 00000020:01000004:1.0:1788361185.766195:0:23195:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788361185.766201:0:23195:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788361185.766213:0:23195:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a8ab7464d40) 00000020:00000080:1.0:1788361185.766225:0:23195:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788361185.777011:0:23195:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361185.784376:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788361185.784386:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788361185.794322:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788361185.794342:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788361185.795829:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788361185.795842:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788361185.797034:0:23195:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361185.797262:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788361185.797270:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788361185.799451:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788361185.799469:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788361185.846673:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788361185.846683:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788361185.848672:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788361185.848679:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788361185.849206:0:23195:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361185.849329:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788361185.849334:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788361185.849800:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788361185.849806:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788361185.850265:0:23195:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361185.850391:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788361185.850397:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788361185.851460:0:23195:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788361185.851474:0:23195:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788361185.876243:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144102016 00000100:00100000:1.0:1788361185.876251:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144102016 00000100:00100000:1.0:1788361185.876331:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361185.876341:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+5:23195:x1875232144102016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788361185.876390:0:23208:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361185.876393:0:23208:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788361185.876396:0:23208:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788361185.876832:0:23229:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1788361185.890426:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+5:23195:x1875232144102016:12345-0@lo:253:mount.lustre.0 Request processed in 14017us (14340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361185.890442:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361185.891292:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144102144 00000100:00100000:1.0:1788361185.891299:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144102144 00000100:00100000:1.0:1788361185.891438:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361185.891448:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+5:23195:x1875232144102144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361185.891463:0:23206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361185.891478:0:23206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab65ce800/0xf6a94c97d6612580 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6612579 expref: -99 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361185.891501:0:23206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab65ce800/0xf6a94c97d6612580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6612579 expref: 6 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361185.891512:0:23206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab65ce800/0xf6a94c97d6612580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612579 expref: 6 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361185.891522:0:23206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce800, rc 0) 00000100:00100000:1.0:1788361185.891568:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+6:23195:x1875232144102144:12345-0@lo:101:mount.lustre.0 Request processed in 121us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361185.891588:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00000080:0.0:1788361186.022852:0:23231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788361186.022866:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361186.025801:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.025808:0:23231:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788361186.025820:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361186.025828:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.025829:0:23231:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788361186.025835:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788361186.025911:0:23231:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788361186.025944:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361186.025948:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.025949:0:23231:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788361186.025952:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788361186.025954:0:23231:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788361186.025955:0:23231:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361186.025957:0:23231:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361186.025958:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788361186.025961:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.025963:0:23231:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788361186.025965:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788361186.025968:0:23231:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788361186.025971:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.025973:0:23231:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788361186.025976:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788361186.025982:0:23231:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:1.0:1788361186.026010:0:23231:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788361186.026013:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361186.026028:0:23231:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a8ab74619c0) 00000020:00000080:1.0:1788361186.026044:0:23231:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788361186.026049:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788361186.026311:0:23231:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788361186.026317:0:23231:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788361186.026330:0:23231:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66125f0 00010000:00080000:1.0:1788361186.026371:0:23231:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a84584800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1788361186.026590:0:23231:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788361186.027320:0:23231:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788361186.027369:0:23231:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788361186.030000:0:23231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361186.030122:0:23231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].4, 64 off8448 00000040:00080000:1.0:1788361186.030195:0:23231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].1, 64 off8256 00000040:00080000:1.0:1788361186.031040:0:23235:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1788361186.031046:0:23235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x16:0x0] at index 4 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788361186.036920:0:23231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361186.036936:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788361186.036970:0:23231:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788361186.036987:0:23231:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66125f7 00000100:00080000:0.0:1788361186.036997:0:23231:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361186.037003:0:23231:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8a84584800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361186.037038:0:23231:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a83540700 x1875232144103040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361186.037068:0:23231:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788361186.038349:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361186.038357:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.038360:0:23231:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788361186.038363:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788361186.038366:0:23231:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788361186.038367:0:23231:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361186.038369:0:23231:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361186.038370:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788361186.038373:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.038374:0:23231:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788361186.038376:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788361186.038380:0:23231:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788361186.038383:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.038384:0:23231:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788361186.038387:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788361186.038391:0:23231:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:1.0:1788361186.038426:0:23231:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788361186.038429:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361186.038443:0:23231:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a8ab7460000) 00000020:00000080:1.0:1788361186.038459:0:23231:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788361186.038464:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788361186.038525:0:23231:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788361186.038530:0:23231:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788361186.038547:0:23231:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d6612605 00010000:00080000:1.0:1788361186.038578:0:23231:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a84584000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1788361186.038852:0:23231:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788361186.039026:0:23231:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788361186.039046:0:23231:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788361186.039697:0:23231:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361186.039763:0:23231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].4, 64 off8448 00000040:00080000:1.0:1788361186.039828:0:23231:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].1, 64 off8256 00000040:00080000:0.0:1788361186.043815:0:23237:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788361186.043823:0:23237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x18:0x0] at index 4 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1788361186.044650:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144103168 00000100:00100000:0.0:1788361186.044657:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144103168 00000100:00100000:0.0:1788361186.044706:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361186.044838:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+9:3311:x1875232144103168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361186.044912:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+9:3311:x1875232144103168:12345-0@lo:400:kworker.0 Request processed in 197us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361186.044919:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361186.044968:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144103168:0@lo:400:kworker.0 00000020:00000080:1.0:1788361186.046488:0:23231:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361186.046500:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788361186.046530:0:23231:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788361186.046547:0:23231:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d661260c 00000100:00080000:1.0:1788361186.046555:0:23231:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361186.046560:0:23231:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8a84584000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361186.046589:0:23231:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a8926e680 x1875232144103296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361186.046897:0:23231:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788361186.046965:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361186.046970:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.046972:0:23231:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788361186.046975:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361186.046979:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.046980:0:23231:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788361186.046983:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788361186.046984:0:23231:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788361186.046987:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361186.046989:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.046990:0:23231:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788361186.046993:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361186.046995:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.046996:0:23231:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788361186.046999:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788361186.047037:0:23231:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23231:1875232144103424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361186.047140:0:23231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361186.047172:0:23231:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83ef5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361186.048254:0:23231:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23231:1875232144103424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361186.048285:0:23231:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361186.048291:0:23231:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361186.048293:0:23231:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788361186.048296:0:23231:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:0.0:1788361186.049048:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144103552 00000100:00100000:0.0:1788361186.049054:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144103552 00000100:00100000:1.0:1788361186.049489:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+9:23195:x1875232144103552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361186.049503:0:23205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361186.049520:0:23205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab65cea00/0xf6a94c97d661261a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6612613 expref: -99 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.049805:0:23205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab65cea00/0xf6a94c97d661261a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6612613 expref: 10 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.049816:0:23205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab65cea00/0xf6a94c97d661261a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612613 expref: 10 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.049825:0:23205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cea00, rc 0) 00000100:00100000:1.0:1788361186.049924:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+10:23195:x1875232144103552:12345-0@lo:101:mount.lustre.0 Request processed in 585us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361186.049931:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788361186.060607:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144103680 00000100:00100000:1.0:1788361186.060630:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144103680 00000100:00100000:1.0:1788361186.060694:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361186.060704:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+10:23195:x1875232144103680:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788361186.060894:0:23208:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788361186.060914:0:23208:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788361186.061031:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+10:23195:x1875232144103680:12345-0@lo:256:mount.lustre.0 Request processed in 328us (2452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361186.061039:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361186.062814:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144103808 00000100:00100000:1.0:1788361186.062823:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144103808 00000100:00100000:1.0:1788361186.062868:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361186.062877:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+10:23195:x1875232144103808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361186.062890:0:23205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361186.062905:0:23205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab65ce000/0xf6a94c97d6612628 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6612621 expref: -99 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.062927:0:23205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab65ce000/0xf6a94c97d6612628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6612621 expref: 11 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.062937:0:23205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab65ce000/0xf6a94c97d6612628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612621 expref: 11 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.062947:0:23205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce000, rc 0) 00000100:00100000:1.0:1788361186.063009:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+11:23195:x1875232144103808:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361186.063016:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361186.063141:0:23195:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23195:1875232144103808:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361186.063156:0:23195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d6612621 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612628 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361186.063179:0:23195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d6612621 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612628 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361186.063238:0:23195:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23195:1875232144103936:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361186.063270:0:23195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361186.063290:0:23195:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361186.065470:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144104064 00000100:00100000:0.0:1788361186.065478:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144104064 00000100:00100000:0.0:1788361186.065518:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361186.065526:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+11:23195:x1875232144104064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361186.065855:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+11:23195:x1875232144104064:12345-0@lo:503:mount.lustre.0 Request processed in 329us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361186.065863:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361186.066568:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144104192 00000100:00100000:0.0:1788361186.066573:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144104192 00000100:00100000:0.0:1788361186.066595:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361186.066602:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+11:23239:x1875232144104192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361186.066944:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+11:23239:x1875232144104192:12345-0@lo:502:llog_process_th.0 Request processed in 341us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361186.066951:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361186.067560:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144104320 00000100:00100000:1.0:1788361186.067566:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144104320 00000100:00100000:1.0:1788361186.067598:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361186.067607:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+11:23239:x1875232144104320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361186.067925:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+11:23239:x1875232144104320:12345-0@lo:502:llog_process_th.0 Request processed in 317us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361186.067944:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000020:01000000:1.0:1788361186.069769:0:23195:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788361186.069802:0:23195:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361186.069830:0:23195:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d6612621 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612628 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.069842:0:23195:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d6612621 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612628 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361186.069894:0:23195:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361186.069898:0:23195:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a84154800 10000000:01000000:1.0:1788361186.069901:0:23195:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a84154800 10000000:01000000:1.0:1788361186.069905:0:23195:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361186.069911:0:23195:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a84154800 from 1 10000000:01000000:1.0:1788361186.069913:0:23195:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361186.069948:0:23195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.069957:0:23195:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.069967:0:23195:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361186.069989:0:23195:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23195:1875232144104448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361186.070043:0:23195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361186.070079:0:23195:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83ef5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361186.070132:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144104448 00000100:00100000:1.0:1788361186.070139:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144104448 00000100:00100000:1.0:1788361186.070178:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361186.070186:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+11:23195:x1875232144104448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361186.070200:0:23208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361186.070212:0:23208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab65cf200/0xf6a94c97d6612636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661262f expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.070235:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab65cf200/0xf6a94c97d6612636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661262f expref: 12 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.070246:0:23208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab65cf200/0xf6a94c97d6612636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661262f expref: 12 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.070254:0:23208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf200, rc 0) 00000100:00100000:1.0:1788361186.070294:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23195:x1875232144104448:12345-0@lo:101:mount.lustre.0 Request processed in 108us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361186.070301:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361186.070345:0:23195:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23195:1875232144104448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361186.070358:0:23195:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.070366:0:23195:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361186.070411:0:23195:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23195:1875232144104576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361186.070436:0:23195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361186.070454:0:23195:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86ae3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361186.070468:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144104576 00000100:00100000:1.0:1788361186.070471:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144104576 00000100:00100000:1.0:1788361186.070494:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361186.070500:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23195:x1875232144104576:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361186.072902:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23195:x1875232144104576:12345-0@lo:501:mount.lustre.0 Request processed in 2394us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361186.072916:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361186.072986:0:23195:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23195:1875232144104576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361186.073037:0:23195:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23195:1875232144104704:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361186.073115:0:23195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361186.073141:0:23195:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86ae3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361186.073158:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144104704 00000100:00100000:1.0:1788361186.073163:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144104704 00000100:00100000:1.0:1788361186.073191:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788361186.073201:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23195:x1875232144104704:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361186.075049:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23195:x1875232144104704:12345-0@lo:503:mount.lustre.0 Request processed in 1844us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361186.075061:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788361186.078430:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144104832 00000100:00100000:1.0:1788361186.078437:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144104832 00000100:00100000:1.0:1788361186.078482:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788361186.078490:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23241:x1875232144104832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361186.080346:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23241:x1875232144104832:12345-0@lo:502:llog_process_th.0 Request processed in 1848us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361186.080360:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361186.095435:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144104960 00000100:00100000:0.0:1788361186.095453:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144104960 00000100:00100000:0.0:1788361186.095511:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361186.095519:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144104960:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361186.095628:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144104960:12345-0@lo:38:llog_process_th.0 Request processed in 107us (4275us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788361186.095649:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361186.096396:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788361186.096405:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efdc000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361186.096410:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361186.096414:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144104960:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361186.100804:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144105088 00000100:00100000:1.0:1788361186.100814:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144105088 00000100:00100000:1.0:1788361186.100911:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788361186.100927:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23241:x1875232144105088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361186.101259:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23241:x1875232144105088:12345-0@lo:502:llog_process_th.0 Request processed in 332us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361186.101266:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788361186.105803:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144105216 00000100:00100000:0.0:1788361186.105817:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144105216 00000100:00100000:0.0:1788361186.105872:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361186.105881:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23195:x1875232144105216:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361186.105926:0:23205:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788361186.105940:0:23205:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788361186.180148:0:23205:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361186.180159:0:23205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788361186.180211:0:23229:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361186.180216:0:23229:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361186.180237:0:23229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d661264b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.180254:0:23229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8ab65cea00/0xf6a94c97d661261a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612613 expref: 12 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.180262:0:23229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d661264b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.180300:0:23229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8ab65cea00/0xf6a94c97d661261a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6612613 expref: 12 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.180313:0:23229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8ab65cea00/0xf6a94c97d661261a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6612613 expref: 12 pid: 23205 timeout: 676 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361186.180327:0:23229:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23229:1875232144105344:0@lo:104: 00000100:00100000:1.0:1788361186.180400:0:23229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361186.180448:0:23229:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788361186.180676:0:23196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144105344 00000100:00100000:0.0:1788361186.180684:0:23196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144105344 00000100:00100000:0.0:1788361186.180737:0:23196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361186.180745:0:23196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+3:23229:x1875232144105344:12345-0@lo:104: 00010000:00010000:0.0:1788361186.180758:0:23196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d6612613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661261a expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361186.180814:0:23196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361186.180820:0:23196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+3:23229:x1875232144105344:12345-0@lo:104: Request processed in 76us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361186.180827:0:23196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788361186.180848:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361186.180854:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d6612613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661261a expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361186.180879:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361186.180883:0:23202:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d6612613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661261a expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361186.180893:0:23202:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d6612613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661261a expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361186.180900:0:23202:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d6612613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661261a expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361186.180906:0:23202:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361186.180932:0:23202:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d6612613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661261a expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361186.180939:0:23202:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361186.180956:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d6612613 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661261a expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361186.180963:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d6612613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661261a expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361186.180980:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361186.180982:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361186.180984:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361186.181011:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144105472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361186.181038:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361186.181135:0:23229:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23229:1875232144105344:0@lo:104: 00010000:00010000:0.0:1788361186.181153:0:23229:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d661264b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361186.183181:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144105472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361186.184193:0:23229:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d661264b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.184205:0:23229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d661264b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361186.184226:0:23229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d661264b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361186.193835:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+11:23195:x1875232144105216:12345-0@lo:253:mount.lustre.0 Request processed in 87946us (90296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361186.193850:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000040:01000000:0.0:1788361186.236850:0:23195:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788361186.249985:0:23195:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788361186.250350:0:23195:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788361186.251529:0:23195:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788361186.251545:0:23195:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788361186.252821:0:23195:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361186.256503:0:23195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788361186.258006:0:23195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788361186.258062:0:23195:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788361186.260284:0:23195:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 2, last_idx 3 00080000:10000000:1.0:1788361186.267906:0:23195:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x38:0x0] (8/8/4) registered 00000001:00000004:1.0:1788361186.282148:0:23195:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869184 00000001:00080000:1.0:1788361186.376187:0:23195:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788361186.376226:0:23195:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa998c1c97988 00100000:10000000:1.0:1788361186.376233:0:23195:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788361186.377404:0:23195:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788361186.377420:0:23195:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788361186.377433:0:23195:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788361186.377448:0:23195:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788361186.784276:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788361187.232757:0:23210:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788361187.232764:0:23210:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8a84154800 from 12 10000000:01000000:0.0:1788361187.232770:0:23210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361187.232815:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6612652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361187.232826:0:23210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6612652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361187.232835:0:23210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6612652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361187.232859:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144105600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361187.232920:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361187.232974:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a82a98300 going to sleep for 11 seconds 00010000:00010000:1.0:1788361187.808619:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361188.202352:0:23247:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788361188.202362:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361188.204493:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 4 00000040:00080000:1.0:1788361188.204506:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:0.0:1788361188.834556:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361189.856419:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361190.880234:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361191.588304:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361191.588318:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144105856:0@lo:400:kworker.0 00000100:00100000:1.0:1788361191.588368:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361191.588409:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144105856 00000100:00100000:1.0:1788361191.588413:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144105856 00000100:00100000:1.0:1788361191.588447:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788361191.588455:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:3313:x1875232144105856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361191.588547:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:3313:x1875232144105856:12345-0@lo:400:kworker.0 Request processed in 92us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361191.588555:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788361191.588594:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144105856:0@lo:400:kworker.0 00010000:00010000:0.0:1788361191.904246:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788361192.886030:0:23644:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc145fd780 20000000:00000080:1.0:1788361192.886060:0:23644:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8abd3a3800 uarg=0000000000000000 20000000:01000000:1.0:1788361192.886265:0:23644:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788361192.886273:0:23644:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788361192.886278:0:23644:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 20000000:00000400:1.0:1788361192.887395:0:23644:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788361192.893920:0:23644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788361192.893953:0:23644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d6612667 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361192.893974:0:23644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8ab65ce000/0xf6a94c97d6612628 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612621 expref: 11 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361192.893983:0:23644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d6612667 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361192.894025:0:23644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8ab65ce000/0xf6a94c97d6612628 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6612621 expref: 11 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361192.894039:0:23644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8ab65ce000/0xf6a94c97d6612628 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6612621 expref: 11 pid: 23205 timeout: 682 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361192.894064:0:23644:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23644:1875232144106112:0@lo:104: 00000100:00100000:1.0:1788361192.894261:0:23644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361192.894314:0:23644:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361192.894648:0:23644:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23644:1875232144106112:0@lo:104: 00010000:00010000:1.0:1788361192.894665:0:23644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d6612667 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361192.895349:0:23644:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d6612667 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361192.895358:0:23644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d6612667 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361192.895364:0:23644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d6612667 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361192.933288:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361194.088149:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144106368 00000100:00100000:0.0:1788361194.088162:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144106368 00000100:00100000:0.0:1788361194.088219:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361194.088230:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+11:23210:x1875232144106368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361194.088246:0:23208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361194.088265:0:23208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6612675 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661266e expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361194.088291:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6612675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661266e expref: 12 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361194.088302:0:23208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6612675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661266e expref: 12 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361194.088310:0:23208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965e00, rc 0) 00000100:00100000:0.0:1788361194.089624:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23210:x1875232144106368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1388us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361194.089634:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361194.089728:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144106368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361194.089747:0:23210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d661266e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612675 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361194.089758:0:23210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d661266e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612675 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361194.089826:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144106496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361194.089869:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361194.089913:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361194.090008:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144106496 00000100:00100000:1.0:1788361194.090014:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144106496 00000100:00100000:1.0:1788361194.090061:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788361194.090069:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23210:x1875232144106496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361194.090326:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23210:x1875232144106496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361194.090333:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361194.090552:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144106496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361194.090583:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144106624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361194.090623:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361194.090651:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361194.091533:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144106624 00000100:00100000:1.0:1788361194.091542:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144106624 00000100:00100000:1.0:1788361194.091581:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788361194.091590:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23210:x1875232144106624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361194.091771:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23210:x1875232144106624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361194.091778:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788361194.091881:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144106624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361194.103543:0:23706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00010000:00010000:1.0:1788361194.976375:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361196.284950:0:23845:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788361196.284955:0:23845:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788361196.285075:0:23845:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8a83778000 00000020:01000004:0.0:1788361196.285335:0:23845:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788361196.285348:0:23845:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788361196.285360:0:23845:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a8a90bf19c0) 00000020:00000080:0.0:1788361196.285376:0:23845:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788361196.300675:0:23845:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788361196.300934:0:23845:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788361196.301801:0:23845:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00000100:00100000:0.0:1788361196.331650:0:23845:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361196.331877:0:23845:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788361196.331885:0:23845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788361196.333294:0:23845:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788361196.333308:0:23845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788361196.334065:0:23845:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788361196.334073:0:23845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788361196.336077:0:23845:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361196.336288:0:23845:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788361196.336294:0:23845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788361196.389298:0:23845:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361196.389490:0:23845:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788361196.389506:0:23845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788361196.390748:0:23845:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788361196.390759:0:23845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000100:00100000:0.0:1788361196.424684:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144106752 00000100:00100000:0.0:1788361196.424693:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144106752 00000100:00100000:0.0:1788361196.424743:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361196.424753:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23845:x1875232144106752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361196.424796:0:23208:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788361196.424800:0:23208:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788361196.424803:0:23208:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788361196.437233:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144106752:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361196.437250:0:23845:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788361196.437253:0:23845:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361196.437255:0:23845:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788361196.437256:0:23845:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361196.437258:0:23845:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361196.437259:0:23845:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361196.437260:0:23845:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361196.437262:0:23845:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361196.437264:0:23845:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361196.437265:0:23845:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788361196.437283:0:23845:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8a83778000 from lustre-OST0000 10000000:01000000:0.0:1788361196.437323:0:23845:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788361196.437326:0:23845:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788361196.437334:0:23845:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8984a5b380 local copy 00010000:00010000:0.0:1788361196.437345:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6612579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612580 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361196.437764:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144106880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361196.437806:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.437933:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361196.438190:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144106880 00000100:00100000:1.0:1788361196.438198:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144106880 00000100:00100000:1.0:1788361196.438246:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788361196.438255:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23845:x1875232144106880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361196.438446:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+12:23845:x1875232144106880:12345-0@lo:501:mount.lustre.0 Request processed in 191us (638us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361196.438453:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788361196.438717:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144106880:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788361196.438740:0:23845:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788361196.438962:0:23845:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788361196.438971:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6612579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612580 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.438982:0:23845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6612579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612580 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361196.439004:0:23845:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8a83778000 10000000:01000000:0.0:1788361196.439009:0:23845:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788361196.439014:0:23845:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a8984a5b380 10000000:01000000:0.0:1788361196.439017:0:23845:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788361196.439021:0:23845:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a8984a5b380 from 1 10000000:01000000:0.0:1788361196.439024:0:23845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788361196.439687:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6612691 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.439700:0:23845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6612691 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.439711:0:23845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6612691 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361196.439732:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361196.439773:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361196.446696:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361196.446744:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361196.446770:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6612691 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612698 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.446782:0:23845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6612691 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612698 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361196.446805:0:23845:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788361196.447158:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6612691 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612698 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.447176:0:23845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6612691 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612698 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361196.447185:0:23845:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788361196.447194:0:23845:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361196.447201:0:23845:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788361196.447203:0:23845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788361196.447241:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.447267:0:23845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.447278:0:23845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361196.447978:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361196.448653:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361196.448747:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bada300 going to sleep for 11 seconds 00010000:00010000:0.0:1788361196.456924:0:23205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964000/0xf6a94c97d66126a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661269f expref: -99 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.456968:0:23205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964000/0xf6a94c97d66126a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661269f expref: 14 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.456995:0:23205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964000/0xf6a94c97d66126a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661269f expref: 14 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.457005:0:23205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964000, rc 0) 00000100:00100000:0.0:1788361196.457171:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+14:23845:x1875232144107136:12345-0@lo:101:mount.lustre.0 Request processed in 3399us (9112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361196.457179:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361196.457306:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361196.457325:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.457335:0:23845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361196.458378:0:23845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:0.0:1788361196.464758:0:23845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361196.466014:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788361196.469713:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:0.0:1788361196.469795:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:0.0:1788361196.470278:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:0.0:1788361196.470330:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:0.0:1788361196.470360:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:0.0:1788361196.470504:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:0.0:1788361196.470782:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:0.0:1788361196.471004:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 80 off9712 00000040:00080000:0.0:1788361196.471082:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9936 00000040:00080000:0.0:1788361196.472344:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10160 00000040:00080000:0.0:1788361196.472414:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 120 off10280 00000040:00080000:0.0:1788361196.472518:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 224 off10504 00000040:00080000:0.0:1788361196.473000:0:23845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:0.0:1788361196.473275:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361196.473338:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.473385:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361196.473393:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144107264 00000100:00100000:1.0:1788361196.473402:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144107264 00000100:00100000:1.0:1788361196.473457:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788361196.473467:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+14:23845:x1875232144107264:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361196.473867:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+14:23845:x1875232144107264:12345-0@lo:501:mount.lustre.0 Request processed in 400us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361196.473876:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788361196.473981:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107264:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361196.474014:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361196.474351:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.474381:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361196.474432:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144107392 00000100:00100000:1.0:1788361196.474437:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144107392 00000100:00100000:1.0:1788361196.474469:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788361196.474484:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+14:23845:x1875232144107392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361196.474804:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+14:23845:x1875232144107392:12345-0@lo:503:mount.lustre.0 Request processed in 320us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361196.474823:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361196.474868:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107392:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788361196.476565:0:23845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361196.476644:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361196.476711:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.476756:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361196.481112:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361196.482390:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788361196.482455:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:0.0:1788361196.482487:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:0.0:1788361196.482533:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:0.0:1788361196.482568:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:0.0:1788361196.482598:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:0.0:1788361196.482644:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:0.0:1788361196.482701:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:0.0:1788361196.482731:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 80 off9712 00000040:00080000:0.0:1788361196.482770:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9936 00000040:00080000:0.0:1788361196.482802:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10160 00000040:00080000:0.0:1788361196.482846:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 120 off10280 00000100:00100000:0.0:1788361196.483775:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361196.483947:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.483993:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361196.485196:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361196.485313:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 224 off10504 00000040:00080000:0.0:1788361196.485327:0:23845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788361196.523304:0:23845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788361196.523341:0:23845:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788361196.523363:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.523376:0:23845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361196.523385:0:23845:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a83778000 from 1 10000000:01000000:1.0:1788361196.523388:0:23845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361196.523428:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.523436:0:23845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.523456:0:23845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361196.523634:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361196.523712:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.524018:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144107776 00000100:00100000:0.0:1788361196.524046:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144107776 00000100:00100000:0.0:1788361196.524134:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788361196.524147:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+14:23845:x1875232144107776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361196.524161:0:23208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361196.524175:0:23208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964400/0xf6a94c97d66126c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66126bb expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.524201:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964400/0xf6a94c97d66126c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66126bb expref: 15 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.524213:0:23208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964400/0xf6a94c97d66126c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66126bb expref: 15 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.524222:0:23208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964400, rc 0) 00000100:00100000:0.0:1788361196.524267:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+15:23845:x1875232144107776:12345-0@lo:101:mount.lustre.0 Request processed in 123us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361196.524274:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788361196.524387:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88156540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361196.524412:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361196.524429:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.524460:0:23845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361196.526605:0:23845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000040:00080000:1.0:1788361196.530422:0:23845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361196.531245:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:1.0:1788361196.531305:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:1.0:1788361196.531359:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:1.0:1788361196.531397:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8976 00000040:00080000:1.0:1788361196.531433:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 112 off9088 00000040:00080000:1.0:1788361196.531619:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 224 off9312 00000040:00080000:1.0:1788361196.531658:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9536 00000040:00080000:1.0:1788361196.531692:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 128 off9664 00000040:00080000:1.0:1788361196.531767:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:1.0:1788361196.531776:0:23845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 9 count 10 00000100:00100000:1.0:1788361196.532214:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361196.532267:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361196.532349:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88156540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361196.533534:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144107904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361196.533584:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144108032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361196.533626:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361196.533662:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88156540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361196.534134:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144108032:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361196.535438:0:23845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361196.535752:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144108160:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361196.535836:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361196.535890:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a831ecc00 going to sleep for 11 seconds 00000020:01000000:0.0:1788361196.542885:0:23845:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788361196.542908:0:23845:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361196.542930:0:23845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.542943:0:23845:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361196.542984:0:23845:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788361196.542987:0:23845:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a83778000 10000000:01000000:0.0:1788361196.542990:0:23845:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a83778000 10000000:01000000:0.0:1788361196.542994:0:23845:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361196.542999:0:23845:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a83778000 from 1 10000000:01000000:0.0:1788361196.543007:0:23845:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361196.543054:0:23845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.543063:0:23845:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.543072:0:23845:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361196.543124:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144108416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361196.543185:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.543222:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361196.543306:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144108416 00000100:00100000:1.0:1788361196.543313:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144108416 00000100:00100000:1.0:1788361196.543351:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361196.543360:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+15:23845:x1875232144108416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361196.543372:0:23205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361196.543387:0:23205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d66126d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66126c9 expref: -99 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.543410:0:23205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d66126d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66126c9 expref: 16 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.543422:0:23205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d66126d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66126c9 expref: 16 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361196.543431:0:23205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf400, rc 0) 00000100:00100000:1.0:1788361196.543469:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:23845:x1875232144108416:12345-0@lo:101:mount.lustre.0 Request processed in 110us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361196.543475:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788361196.543629:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144108416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361196.543643:0:23845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.543651:0:23845:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361196.544583:0:23845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000040:00080000:0.0:1788361196.548734:0:23845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361196.549534:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:0.0:1788361196.549588:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:0.0:1788361196.549623:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:0.0:1788361196.549669:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:0.0:1788361196.549706:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:0.0:1788361196.549757:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:0.0:1788361196.549795:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:0.0:1788361196.552297:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:0.0:1788361196.552400:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:0.0:1788361196.552454:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:0.0:1788361196.552496:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:0.0:1788361196.552567:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:0.0:1788361196.552607:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:0.0:1788361196.552647:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:0.0:1788361196.552700:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:0.0:1788361196.552740:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:0.0:1788361196.552773:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:0.0:1788361196.554345:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:0.0:1788361196.554430:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:0.0:1788361196.554483:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:0.0:1788361196.554557:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:0.0:1788361196.554597:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:0.0:1788361196.554632:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:0.0:1788361196.554680:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:0.0:1788361196.554713:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 128 off12440 00000040:00080000:0.0:1788361196.554746:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12664 00000040:00080000:0.0:1788361196.554790:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12888 00000040:00080000:0.0:1788361196.557366:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off12968 00000040:00080000:0.0:1788361196.557430:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13192 00000040:00080000:0.0:1788361196.557525:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13416 00000040:00080000:0.0:1788361196.557565:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13504 00000040:00080000:0.0:1788361196.557597:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13632 00000040:00080000:0.0:1788361196.557628:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13776 00000040:00080000:0.0:1788361196.557679:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13904 00000040:00080000:0.0:1788361196.557716:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14128 00000040:00080000:0.0:1788361196.557763:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14352 00000040:00080000:0.0:1788361196.557799:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14432 00000040:00080000:0.0:1788361196.558022:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14656 00000040:00080000:0.0:1788361196.559233:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14880 00000040:00080000:0.0:1788361196.559276:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 120 off15000 00000040:00080000:0.0:1788361196.559384:0:23845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 224 off15224 00000040:00080000:0.0:1788361196.559399:0:23845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 41 count 42 00000100:00100000:0.0:1788361196.559569:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144108544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361196.559638:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.559684:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361196.569044:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144108544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361196.569132:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144108672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361196.569205:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.569247:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361196.569315:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144108672 00000100:00100000:1.0:1788361196.569323:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144108672 00000100:00100000:1.0:1788361196.569376:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361196.569385:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:23845:x1875232144108672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361196.569698:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:23845:x1875232144108672:12345-0@lo:503:mount.lustre.0 Request processed in 312us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361196.569706:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788361196.569929:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144108672:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788361196.570727:0:23845:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361196.570813:0:23845:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144108800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361196.571962:0:23845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.572002:0:23845:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361196.572547:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144108800 00000100:00100000:1.0:1788361196.572555:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144108800 00000100:00100000:1.0:1788361196.572600:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788361196.572615:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:23845:x1875232144108800:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361196.573581:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:23845:x1875232144108800:12345-0@lo:502:mount.lustre.0 Request processed in 963us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361196.573593:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788361196.588639:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144108928 00000100:00100000:1.0:1788361196.588646:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144108928 00000100:00100000:1.0:1788361196.588696:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788361196.588706:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:23845:x1875232144108928:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361196.590969:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:23845:x1875232144108928:12345-0@lo:502:mount.lustre.0 Request processed in 2257us (2538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361196.590982:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000020:01000004:0.0:1788361196.595007:0:23868:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788361196.595066:0:23868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a8a90bf3380) 00000020:00000080:0.0:1788361196.595230:0:23868:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788361196.600751:0:23868:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a83778000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788361196.600760:0:23868:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a83778000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788361196.600763:0:23868:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a83778000 3 00010000:00080000:0.0:1788361196.600799:0:23868:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a8a10f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.160@tcp at head 00010000:00010000:0.0:1788361196.604656:0:23868:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788361196.604789:0:23868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788361196.604830:0:23868:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788361196.604845:0:23868:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf6a94c97d66126de 00000100:00080000:0.0:1788361196.604856:0:23868:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361196.604862:0:23868:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8a8a10f000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361196.605214:0:23868:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a83540e00 x1875232144109056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361196.605274:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144109056:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361196.605342:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361196.605404:0:23868:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788361196.606676:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361196.606691:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144109184:0@lo:400:kworker.0 00000100:00100000:1.0:1788361196.606737:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361196.606780:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144109184 00000100:00100000:1.0:1788361196.606797:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144109184 00000100:00100000:0.0:1788361196.606986:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361196.606995:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144109184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361196.607052:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144109184:12345-0@lo:400:kworker.0 Request processed in 57us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361196.607058:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788361196.607155:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a898705c380 x1875232144109184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361196.607164:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144109184:0@lo:400:kworker.0 00000040:00080000:0.0:1788361196.607691:0:23868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000100:00100000:1.0:1788361196.609222:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144109312 00000100:00100000:1.0:1788361196.609231:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144109312 00000100:00100000:1.0:1788361196.609287:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788361196.609296:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:23845:x1875232144109312:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788361196.609327:0:23205:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788361196.609343:0:23205:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788361196.651744:0:23205:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361196.651759:0:23205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788361196.651780:0:23229:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361196.651785:0:23229:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361196.651807:0:23229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8985965800/0xf6a94c97d66126ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.651825:0:23229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1e600/0xf6a94c97d6612659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612652 expref: 16 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.651834:0:23229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8985965800/0xf6a94c97d66126ec lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.652068:0:23229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1e600/0xf6a94c97d6612659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6612652 expref: 16 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361196.652216:0:23229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8df1e600/0xf6a94c97d6612659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6612652 expref: 16 pid: 23206 timeout: 686 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361196.652235:0:23229:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23229:1875232144109440:0@lo:104: 00000100:00100000:0.0:1788361196.652387:0:23229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361196.652537:0:23229:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361196.658283:0:23229:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23229:1875232144109440:0@lo:104: 00010000:00010000:0.0:1788361196.658317:0:23229:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8985965800/0xf6a94c97d66126ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361196.664286:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+15:23845:x1875232144109312:12345-0@lo:253:mount.lustre.0 Request processed in 54987us (55906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361196.664307:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788361196.664518:0:23845:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23845:1875232144109312:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788361196.664548:0:23845:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788361196.664552:0:23845:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361196.664553:0:23845:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361196.664554:0:23845:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361196.664555:0:23845:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361196.664556:0:23845:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361196.664557:0:23845:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361196.664559:0:23845:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361196.664560:0:23845:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361196.664562:0:23845:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788361196.664575:0:23845:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788361196.665073:0:23845:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361196.665788:0:23845:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361196.665977:0:23845:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361196.666320:0:23845:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361196.666553:0:23845:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361196.666732:0:23845:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788361196.667846:0:23845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869184 00000100:00100000:0.0:1788361197.667024:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361186/real 1788361186] req@ffff9a8a8926e680 x1875232144103296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361196 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361197.667055:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8a8926e680 x1875232144103296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361196 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361197.667064:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361186/real 1788361186] req@ffff9a8a83540700 x1875232144103040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361196 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361197.667077:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8a83540700 x1875232144103040/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361196 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361197.667109:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361197.667127:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788361197.667139:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144103296:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788361197.667144:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361197.667150:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788361197.667153:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144103040:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788361197.667215:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361197.667219:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788361197.667221:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361197.667226:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 576 00000100:00080000:0.0:1788361197.667230:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361197.667237:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8a84584800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361197.667256:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a83543100 x1875232144109824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361197.667268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361197.667271:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788361197.667273:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361197.667276:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 576 00000100:00080000:0.0:1788361197.667278:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361197.667281:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8a84584000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361197.667292:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a83542a00 x1875232144109952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361197.667345:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144109696:0@lo:400:kworker.0 00000100:00100000:0.0:1788361197.667409:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361197.667463:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144109824:0@lo:8:kworker.0 00000100:00100000:0.0:1788361197.667491:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361197.667518:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144109952:0@lo:8:kworker.0 00000100:00100000:0.0:1788361197.667543:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361197.667567:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144110208:0@lo:400:kworker.0 00000100:00100000:0.0:1788361197.667592:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361197.667610:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361197.667615:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144110080:0@lo:400:kworker.0 00000100:00100000:0.0:1788361197.667635:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361197.667679:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144109824 00000100:00100000:0.0:1788361197.667686:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144109824 00000100:00100000:0.0:1788361197.667712:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144109952 00000100:00100000:0.0:1788361197.667715:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144109952 00000100:00100000:0.0:1788361197.667728:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361197.667735:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144109824:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788361197.667759:0:23848:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:0.0:1788361197.667784:0:23848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66126f3 00002000:00100000:0.0:1788361197.667796:0:23848:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a8aae461800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788361197.667800:0:23848:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788361197.667803:0:23848:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788361197.668569:0:23848:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788361197.668596:0:23848:0:(import.c:65:import_set_state_nolock()) ffff9a8aae463800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361197.668653:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144109824:12345-0@lo:8:kworker.0 Request processed in 916us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361197.668662:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361197.668684:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361197.668689:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144109952:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788361197.668702:0:23848:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788361197.670457:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144109696 00000100:00100000:1.0:1788361197.670472:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144109696 00000100:00100000:1.0:1788361197.670527:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788361197.670536:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+15:3314:x1875232144109696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361197.670614:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+15:3314:x1875232144109696:12345-0@lo:400:kworker.0 Request processed in 79us (3205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361197.670621:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788361197.670762:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144110208 00000100:00100000:1.0:1788361197.670767:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144110208 00000100:00100000:1.0:1788361197.670800:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144110080 00000100:00100000:1.0:1788361197.670803:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144110080 00000100:00100000:1.0:1788361197.670817:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361197.670824:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144110208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361197.670864:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144110208:12345-0@lo:400:kworker.0 Request processed in 41us (3271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361197.670870:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361197.670882:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361197.670887:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144110080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361197.670935:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144110080:12345-0@lo:400:kworker.0 Request processed in 47us (3298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361197.670941:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788361197.670973:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361197.671317:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144109696:0@lo:400:kworker.0 00010000:00080000:1.0:1788361197.671358:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a83543100 x1875232144109824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361197.671369:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361197.671376:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 4 00000100:00080000:1.0:1788361197.671384:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788361197.671389:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788361197.671392:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788361197.671406:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788361197.671412:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144109824:0@lo:8:kworker.0 00000004:00080000:1.0:1788361197.671462:0:23236:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x43:0x0] 00000100:00100000:1.0:1788361197.671483:0:23236:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23236:1875232144110464:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361197.671517:0:23236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361197.671537:0:23236:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0e40 going to sleep for 11 seconds 00000004:00080000:1.0:1788361197.671551:0:23235:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788361197.671830:0:23235:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 587686742487ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788361197.671849:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361197.671858:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144110336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361197.671886:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361197.671922:0:23847:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788361197.671929:0:23847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788361197.681361:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144110464 00000100:00100000:1.0:1788361197.681381:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144110464 00000100:00080000:1.0:1788361197.681438:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361197.681513:0:23933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361197.681524:0:23933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23236:x1875232144110464:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788361197.694050:0:23933:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788361197.694061:0:23933:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 97 -> diff = -30 00002000:02000040:1.0:1788361197.694066:0:23933:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:68 to 0x240000400:97) 00010000:00080000:0.0:1788361197.696322:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a83540e00 x1875232144110080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361197.696340:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144110080:0@lo:400:kworker.0 00010000:00080000:0.0:1788361197.696352:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a83542300 x1875232144110208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361213 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361197.696360:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144110208:0@lo:400:kworker.0 00000100:00100000:0.0:1788361197.696414:0:23850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144110336 00000100:00100000:0.0:1788361197.696420:0:23850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144110336 00000100:00100000:0.0:1788361197.696461:0:23850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361197.696468:0:23850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144110336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361197.696489:0:23850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361197.696569:0:23850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144110336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (24682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361197.696576:0:23850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361197.696632:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144109952:12345-0@lo:8:kworker.0 Request processed in 27942us (29088us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361197.696640:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788361197.706629:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a8926d880 x1875232144110336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361197.706658:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144110336:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788361197.706705:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361197.706710:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361197.706713:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144109952:0@lo:8:kworker.0 00002000:00010000:1.0:1788361197.707666:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.707677:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66126fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.707695:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x61:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.707700:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.707706:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66126fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.707725:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66126fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.707736:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66126fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.707750:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66126fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.707767:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361197.707779:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361197.707784:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66126fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.707792:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361197.707796:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66126fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.707806:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66126fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.707823:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66126fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.707831:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66126fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.707849:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.707851:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.707853:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361197.708495:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.708508:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6612701 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.708518:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x60:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.708523:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.708527:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6612701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.708539:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6612701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.708547:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6612701 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.708554:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6612701 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.708576:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361197.708935:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.708941:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6612708 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.708949:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5f:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.708952:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.708956:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6612708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.708965:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6612708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709063:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6612708 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709073:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6612708 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709105:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361197.709114:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361197.709118:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6612708 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709125:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361197.709129:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6612708 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709137:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6612708 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709148:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6612708 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709155:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6612708 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709169:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.709175:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.709177:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361197.709613:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.709618:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ffd1c9/0xf6a94c97d661270f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709627:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5e:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.709630:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.709635:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073ffd1c9/0xf6a94c97d661270f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709645:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073ffd1c9/0xf6a94c97d661270f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709652:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073ffd1c9/0xf6a94c97d661270f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709658:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073ffd1c9/0xf6a94c97d661270f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.709678:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361197.710275:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.710354:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6612716 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.710365:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5d:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.710368:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.710372:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6612716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.710389:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6612716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.710398:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6612716 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.710406:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6612716 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.710461:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361197.711514:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.711522:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661271d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.711533:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5c:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.711537:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.711542:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661271d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.711554:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661271d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.711562:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661271d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.711579:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661271d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.712915:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.717443:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361197.717457:0:23933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661271d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.717811:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361197.719496:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.719506:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec89ebf/0xf6a94c97d6612724 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.719523:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5b:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.719527:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.719533:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ec89ebf/0xf6a94c97d6612724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.719548:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ec89ebf/0xf6a94c97d6612724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.719558:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ec89ebf/0xf6a94c97d6612724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.719566:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ec89ebf/0xf6a94c97d6612724 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.719594:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361197.719607:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361197.719612:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ec89ebf/0xf6a94c97d6612724 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.719620:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361197.719624:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec89ebf/0xf6a94c97d6612724 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.719634:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ec89ebf/0xf6a94c97d6612724 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.719651:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ec89ebf/0xf6a94c97d6612724 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.719659:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ec89ebf/0xf6a94c97d6612724 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.719676:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.719678:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.719679:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361197.720125:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.720131:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008234d806/0xf6a94c97d661272b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720139:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5a:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.720147:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.720151:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008234d806/0xf6a94c97d661272b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720162:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008234d806/0xf6a94c97d661272b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720170:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008234d806/0xf6a94c97d661272b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720176:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008234d806/0xf6a94c97d661272b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720188:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361197.720196:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361197.720201:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008234d806/0xf6a94c97d661272b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720207:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361197.720210:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008234d806/0xf6a94c97d661272b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720217:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008234d806/0xf6a94c97d661272b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720227:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008234d806/0xf6a94c97d661272b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720242:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008234d806/0xf6a94c97d661272b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720256:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.720258:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.720259:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361197.720633:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x59:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.720639:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6612732 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720648:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x59:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.720651:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x59:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.720656:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6612732 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720665:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6612732 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720672:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6612732 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720679:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6612732 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720691:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361197.720698:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361197.720707:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6612732 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720714:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361197.720718:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6612732 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720726:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6612732 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720736:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6612732 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720743:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6612732 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.720754:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.720756:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.720757:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361197.721155:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.721161:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d6612739 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721169:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x58:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.721172:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.721175:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d6612739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721194:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d6612739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721203:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d6612739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721210:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d6612739 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721221:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361197.721229:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361197.721232:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d6612739 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721238:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361197.721241:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d6612739 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721247:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d6612739 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721256:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d6612739 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721262:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d6612739 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721280:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.721282:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.721283:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361197.721663:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.721668:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e972e5c/0xf6a94c97d6612740 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721676:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x57:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.721679:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.721683:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e972e5c/0xf6a94c97d6612740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721691:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e972e5c/0xf6a94c97d6612740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721698:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e972e5c/0xf6a94c97d6612740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721706:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e972e5c/0xf6a94c97d6612740 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721719:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361197.721726:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361197.721729:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e972e5c/0xf6a94c97d6612740 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721748:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361197.721751:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e972e5c/0xf6a94c97d6612740 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721759:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e972e5c/0xf6a94c97d6612740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721770:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e972e5c/0xf6a94c97d6612740 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721777:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e972e5c/0xf6a94c97d6612740 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.721790:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.721791:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.721793:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361197.727266:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.728468:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039c39312/0xf6a94c97d6612747 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.728492:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x56:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.728497:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.728503:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039c39312/0xf6a94c97d6612747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.728519:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039c39312/0xf6a94c97d6612747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.728539:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039c39312/0xf6a94c97d6612747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.728547:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039c39312/0xf6a94c97d6612747 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.728649:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361197.728664:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361197.728675:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039c39312/0xf6a94c97d6612747 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.728683:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361197.728687:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039c39312/0xf6a94c97d6612747 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.728697:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039c39312/0xf6a94c97d6612747 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.728714:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039c39312/0xf6a94c97d6612747 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.728721:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039c39312/0xf6a94c97d6612747 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.728741:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.728749:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.728751:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361197.729808:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.729816:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d661274e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.729828:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x55:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.729831:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.729836:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d661274e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.729848:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d661274e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.729857:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d661274e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.729864:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d661274e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.729881:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361197.729892:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361197.729897:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d661274e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.729904:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361197.729909:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d661274e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.729929:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d661274e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.729943:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d661274e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.729950:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d661274e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.729965:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.729967:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.729969:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361197.732445:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361197.732456:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029353814/0xf6a94c97d6612755 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.732470:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x54:0x0].0x0 since=587s v=(0 0) 00010000:00010000:1.0:1788361197.732474:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361197.732480:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029353814/0xf6a94c97d6612755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.732493:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029353814/0xf6a94c97d6612755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.732503:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029353814/0xf6a94c97d6612755 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.732517:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029353814/0xf6a94c97d6612755 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.732541:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361197.737377:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361197.737389:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029353814/0xf6a94c97d6612755 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.737404:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361197.737409:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029353814/0xf6a94c97d6612755 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.737434:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029353814/0xf6a94c97d6612755 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.737458:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029353814/0xf6a94c97d6612755 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.737467:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029353814/0xf6a94c97d6612755 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.737487:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361197.737489:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361197.737491:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.741129:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.753123:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361197.753134:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ffe4b9c/0xf6a94c97d6612771 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.753146:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361197.753151:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ffe4b9c/0xf6a94c97d6612771 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.753162:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ffe4b9c/0xf6a94c97d6612771 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.753182:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ffe4b9c/0xf6a94c97d6612771 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.753190:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ffe4b9c/0xf6a94c97d6612771 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361197.753209:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.753210:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361197.753212:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.753758:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.753765:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.753767:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361197.755035:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.755045:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d661277f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.755060:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.755064:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.755070:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d661277f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.755082:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d661277f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.755108:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d661277f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.755115:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d661277f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.755140:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361197.755512:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.755518:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d6612786 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.755527:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.755530:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.755549:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d6612786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.755665:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361197.755673:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d661277f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.755682:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361197.755686:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d661277f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.755695:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d6612786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.755695:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d661277f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.755705:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d6612786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.755711:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d661277f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.755712:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d6612786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.755729:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d661277f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.755731:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361197.755746:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361197.755749:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d6612786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.755756:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361197.755759:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d6612786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.755767:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d6612786 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.755777:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d6612786 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.755784:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d6612786 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361197.755794:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361197.755796:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361197.755798:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361197.756480:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.756487:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000512baea7/0xf6a94c97d661278d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.756498:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.756501:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.756506:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000512baea7/0xf6a94c97d661278d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.756517:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000512baea7/0xf6a94c97d661278d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.756526:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000512baea7/0xf6a94c97d661278d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.756921:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000512baea7/0xf6a94c97d661278d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.756942:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361197.756956:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361197.756960:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000512baea7/0xf6a94c97d661278d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.756968:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361197.756971:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000512baea7/0xf6a94c97d661278d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.756980:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000512baea7/0xf6a94c97d661278d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.756995:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000512baea7/0xf6a94c97d661278d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.757002:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000512baea7/0xf6a94c97d661278d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.757027:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.757029:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.757030:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361197.757482:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.757494:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6612794 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.757503:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.757507:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.757512:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6612794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.757522:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6612794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.757531:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6612794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.757549:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6612794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.758176:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361197.758614:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.758622:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dba0d25d/0xf6a94c97d661279b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.758633:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.758636:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.758641:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dba0d25d/0xf6a94c97d661279b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.758652:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dba0d25d/0xf6a94c97d661279b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.758666:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dba0d25d/0xf6a94c97d661279b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.758673:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dba0d25d/0xf6a94c97d661279b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763043:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361197.763069:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361197.763077:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6612794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763106:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361197.763111:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6612794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763124:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6612794 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763145:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6612794 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763153:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1da797b/0xf6a94c97d6612794 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763171:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361197.763181:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dba0d25d/0xf6a94c97d661279b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763188:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361197.763191:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dba0d25d/0xf6a94c97d661279b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763199:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dba0d25d/0xf6a94c97d661279b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763210:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dba0d25d/0xf6a94c97d661279b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763217:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dba0d25d/0xf6a94c97d661279b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.763230:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.763231:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.763233:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361197.763997:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.764005:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ac506db/0xf6a94c97d66127a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764027:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.764032:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.764039:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ac506db/0xf6a94c97d66127a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764064:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ac506db/0xf6a94c97d66127a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764075:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ac506db/0xf6a94c97d66127a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764083:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ac506db/0xf6a94c97d66127a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764108:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361197.764631:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.764637:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035a47bd1/0xf6a94c97d66127a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764647:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.764650:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.764654:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035a47bd1/0xf6a94c97d66127a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764664:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035a47bd1/0xf6a94c97d66127a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764672:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035a47bd1/0xf6a94c97d66127a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764690:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035a47bd1/0xf6a94c97d66127a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764705:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361197.764715:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361197.764721:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ac506db/0xf6a94c97d66127a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764727:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361197.764731:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac506db/0xf6a94c97d66127a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764738:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ac506db/0xf6a94c97d66127a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764752:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ac506db/0xf6a94c97d66127a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764759:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ac506db/0xf6a94c97d66127a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764773:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361197.764777:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035a47bd1/0xf6a94c97d66127a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764793:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361197.764797:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035a47bd1/0xf6a94c97d66127a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764804:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035a47bd1/0xf6a94c97d66127a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764815:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035a47bd1/0xf6a94c97d66127a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764823:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035a47bd1/0xf6a94c97d66127a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.764836:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.764838:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.764839:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361197.765261:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.765267:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d66127b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.765276:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.765279:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.766041:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d66127b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.766061:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d66127b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.766078:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d66127b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.766150:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d66127b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.766648:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361197.766664:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361197.766669:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d66127b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.766677:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361197.766681:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d66127b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.766690:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d66127b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.766707:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d66127b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.766715:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d66127b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.766729:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.766735:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.766737:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361197.768393:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.768406:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d66127b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.768420:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.768424:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.768430:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d66127b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.768444:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d66127b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.768453:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d66127b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.768459:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d66127b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.768479:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361197.768491:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361197.768496:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d66127b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.768502:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361197.768507:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d66127b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.768524:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d66127b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.768611:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d66127b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.768620:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a54fa4/0xf6a94c97d66127b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.768637:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.768639:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.768641:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361197.769875:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.769884:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d66127be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.769897:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.769902:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.769907:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d66127be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.769920:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d66127be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.769929:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d66127be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.769942:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d66127be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.769961:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361197.769974:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361197.769979:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d66127be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.769987:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361197.769992:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d66127be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770000:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d66127be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770015:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d66127be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770033:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055e214ca/0xf6a94c97d66127be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770049:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.770051:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.770053:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361197.770794:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361197.770809:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d66127c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770821:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=587s v=(0 0) 00010000:00010000:3.0:1788361197.770825:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361197.770830:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d66127c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770842:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d66127c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770852:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d66127c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770859:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d66127c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770877:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361197.770888:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361197.770893:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d66127c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770901:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361197.770905:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d66127c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770913:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d66127c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770931:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d66127c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770939:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029467e1c/0xf6a94c97d66127c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361197.770954:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.770956:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361197.770958:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788361197.772399:0:23933:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:67 00000100:00100000:3.0:1788361197.772521:0:23933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23236:x1875232144110464:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90995us (100999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361197.772610:0:23933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361197.772800:0:23236:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23236:1875232144110464:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788361197.772816:0:23236:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x61:0x0] from OST, last_created [0x240000400:0x61:0x0]last_used is [0x240000400:0x43:0x0] 00000100:00100000:0.0:1788361197.772871:0:23236:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23236:1875232144110592:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788361197.772907:0:23236:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361197.772951:0:23236:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361197.778012:0:23236:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:23236:1875232144110592:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788361197.778039:0:23236:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x61:0x0]-[0x240000400:0x81:0x0] 00010000:00010000:3.0:1788361198.057137:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361198.433312:0:23247:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788361198.433324:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361198.433363:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 5 count 4 00000040:00080000:0.0:1788361198.433370:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 10000000:01000000:0.0:1788361198.496188:0:23210:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788361198.496196:0:23210:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8a84154800 from 13 10000000:01000000:0.0:1788361198.496201:0:23210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361198.496247:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361198.496271:0:23210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361198.496282:0:23210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361198.496310:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144110720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361198.496379:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361198.496433:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361198.496995:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144110720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361198.497010:0:23210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66127d3 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361198.497030:0:23210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66127d3 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361198.497224:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144110848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361198.497259:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361198.497362:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a73c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788361199.073238:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361200.098245:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361201.126320:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361202.146294:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361202.850366:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788361202.850373:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788361202.850382:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361202.850389:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 587 00000100:00080000:1.0:1788361202.850394:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788361202.850401:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8a84584000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361202.850423:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a8926dc00 x1875232144111232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361202.850517:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144110976:0@lo:400:kworker.0 00000100:00100000:1.0:1788361202.850587:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361202.850595:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144111488:0@lo:400:kworker.0 00000100:00100000:0.0:1788361202.850625:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361202.850642:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144111104:0@lo:400:kworker.0 00000100:00100000:0.0:1788361202.850652:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144111360:0@lo:400:kworker.0 00000100:00100000:1.0:1788361202.850667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361202.850671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361202.850693:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144111232:0@lo:8:kworker.0 00000100:00100000:1.0:1788361202.850714:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361202.850744:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144111488 00000100:00100000:1.0:1788361202.850751:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144111488 00000100:00100000:1.0:1788361202.850794:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144111360 00000100:00100000:1.0:1788361202.850797:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144111360 00000100:00100000:1.0:1788361202.850814:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361202.850821:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144111488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361202.850869:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144111488:12345-0@lo:400:kworker.0 Request processed in 48us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361202.850877:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361202.850894:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361202.850899:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144111360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361202.850944:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144111360:12345-0@lo:400:kworker.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361202.850951:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361202.850979:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144111104 00000100:00100000:1.0:1788361202.850995:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144111104 00000100:00100000:1.0:1788361202.851018:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144111232 00000100:00100000:1.0:1788361202.851021:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144111232 00000100:00100000:1.0:1788361202.851035:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361202.851040:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144111104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361202.851075:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144111104:12345-0@lo:400:kworker.0 Request processed in 35us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361202.851082:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361202.851116:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361202.851120:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144111232:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788361202.851135:0:23848:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361202.851418:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144111616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361202.851446:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361202.854122:0:23850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144111616 00000100:00100000:0.0:1788361202.854136:0:23850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144111616 00000100:00100000:0.0:1788361202.854186:0:23850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361202.854196:0:23850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144111616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361202.854233:0:23850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361202.854311:0:23850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144111616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (2862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361202.854319:0:23850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361202.854362:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869185 gen 2 00000100:00100000:0.0:1788361202.854386:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144111616:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788361202.856186:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a8926c380 x1875232144111488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361202.856204:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144111488:0@lo:400:kworker.0 00000100:00080000:0.0:1788361202.856240:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361202.856246:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361202.859190:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144111104:0@lo:400:kworker.0 00000100:00100000:0.0:1788361202.866375:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144111232:12345-0@lo:8:kworker.0 Request processed in 15246us (15652us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361202.866389:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788361202.866457:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361202.866463:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361202.866467:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144111232:0@lo:8:kworker.0 00010000:00010000:0.0:1788361203.172477:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361204.192257:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361205.216315:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361206.241245:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361207.264979:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361207.274252:0:24515:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788361207.274256:0:24515:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788361207.274385:0:24515:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8986fe2800 00000020:01000004:1.0:1788361207.274400:0:24515:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788361207.274414:0:24515:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788361207.274426:0:24515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a8ab7463380) 00000020:00000080:1.0:1788361207.274442:0:24515:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788361207.298934:0:24515:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788361207.299717:0:24515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788361207.299945:0:24515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788361207.300230:0:24515:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xc:0x0] (8/32) 00100000:10000000:3.0:1788361207.300600:0:24515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 589: rc = 0 00100000:10000000:3.0:1788361207.300694:0:24515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 589: rc = 0 00100000:10000000:3.0:1788361207.300783:0:24515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 589: rc = 0 00100000:10000000:3.0:1788361207.301293:0:24515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 776: rc = 0 00100000:10000000:3.0:1788361207.301529:0:24515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 776: rc = 0 00100000:10000000:3.0:1788361207.301759:0:24515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 776: rc = 0 00100000:10000000:3.0:1788361207.303283:0:24515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 776: rc = 0 00100000:10000000:3.0:1788361207.303566:0:24515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 776: rc = 0 00100000:10000000:3.0:1788361207.303936:0:24515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 776: rc = 0 00000020:00000080:3.0:1788361207.304597:0:24515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788361207.304609:0:24515:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788361207.304620:0:24515:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d66127e1 00000020:01000004:3.0:1788361207.304627:0:24515:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788361207.304648:0:24515:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788361207.304651:0:24515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788361207.304656:0:24515:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788361207.304677:0:24515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788361207.304681:0:24515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788361207.314761:0:24515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788361207.314933:0:24515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.160@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788361207.314938:0:24515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788361207.314940:0:24515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361207.314941:0:24515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361207.314942:0:24515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361207.314944:0:24515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361207.314945:0:24515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361207.314947:0:24515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361207.314949:0:24515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361207.314960:0:24515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361207.314964:0:24515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788361207.314966:0:24515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361207.314967:0:24515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361207.314974:0:24515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361207.314975:0:24515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361207.314976:0:24515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361207.314977:0:24515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361207.314978:0:24515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361207.314980:0:24515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361207.314981:0:24515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361207.315007:0:24515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788361207.315027:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144111744:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361207.315120:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.315220:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361207.315266:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144111744 00000100:00100000:0.0:1788361207.315273:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144111744 00000100:00100000:0.0:1788361207.315327:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788361207.315337:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:24515:x1875232144111744:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361207.315368:0:23205:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788361207.315371:0:23205:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788361207.315376:0:23205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788361207.332475:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:24515:x1875232144111744:12345-0@lo:253:mount.lustre.0 Request processed in 17130us (17345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361207.332492:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361207.334701:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144111744:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361207.334721:0:24515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788361207.334725:0:24515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361207.334727:0:24515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361207.334728:0:24515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361207.334729:0:24515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361207.334730:0:24515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361207.334732:0:24515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361207.334733:0:24515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361207.334735:0:24515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361207.334736:0:24515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788361207.334761:0:24515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8986fe2800 from lustre-OST0001 10000000:01000000:3.0:1788361207.334964:0:24515:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788361207.334967:0:24515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788361207.334975:0:24515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8984a5b380 local copy 00010000:00010000:3.0:1788361207.334986:0:24515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6612579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612580 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361207.335255:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144111872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361207.335314:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.335363:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab71459c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361207.335491:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144111872 00000100:00100000:0.0:1788361207.335499:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144111872 00000100:00100000:0.0:1788361207.335546:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788361207.335555:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:24515:x1875232144111872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361207.335754:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:24515:x1875232144111872:12345-0@lo:501:mount.lustre.0 Request processed in 199us (439us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361207.335763:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788361207.335948:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144111872:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788361207.335982:0:24515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788361207.336169:0:24515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788361207.336176:0:24515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6612579 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612580 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.336186:0:24515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6612579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612580 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361207.336208:0:24515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8986fe2800 10000000:01000000:3.0:1788361207.336213:0:24515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788361207.336288:0:24515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788361207.336292:0:24515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361207.336296:0:24515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788361207.336299:0:24515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788361207.336321:0:24515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.336330:0:24515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.336339:0:24515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361207.336353:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361207.336383:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.336499:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab71459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361207.338759:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144112000 00000100:00100000:1.0:1788361207.338773:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144112000 00000100:00100000:1.0:1788361207.339200:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788361207.339212:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:24515:x1875232144112000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361207.339231:0:23205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361207.339249:0:23205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8abeac9800/0xf6a94c97d66127ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66127e8 expref: -99 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361207.339278:0:23205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8abeac9800/0xf6a94c97d66127ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66127e8 expref: 17 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361207.339290:0:23205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8abeac9800/0xf6a94c97d66127ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66127e8 expref: 17 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361207.339299:0:23205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9800, rc 0) 00000100:00100000:1.0:1788361207.339376:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:24515:x1875232144112000:12345-0@lo:101:mount.lustre.0 Request processed in 166us (2991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361207.339382:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788361207.340700:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112000:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361207.340725:0:24515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.340752:0:24515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361207.341470:0:24515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000040:00080000:3.0:1788361207.342323:0:24515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361207.342540:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788361207.342583:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 128 off8544 00000040:00080000:3.0:1788361207.342615:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 112 off8656 00000040:00080000:3.0:1788361207.342656:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8880 00000040:00080000:3.0:1788361207.342692:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9104 00000040:00080000:3.0:1788361207.342726:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 80 off9184 00000040:00080000:3.0:1788361207.342770:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9408 00000040:00080000:3.0:1788361207.342805:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9632 00000040:00080000:3.0:1788361207.342852:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 120 off9752 00000040:00080000:3.0:1788361207.342907:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off9976 00000040:00080000:3.0:1788361207.342915:0:24515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 10 count 11 00000100:00100000:3.0:1788361207.343010:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361207.343068:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.343739:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab71453c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361207.348569:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144112128 00000100:00100000:1.0:1788361207.348583:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144112128 00000100:00100000:1.0:1788361207.348745:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788361207.348757:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:24515:x1875232144112128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361207.349594:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:24515:x1875232144112128:12345-0@lo:501:mount.lustre.0 Request processed in 837us (6523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361207.349605:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788361207.349702:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361207.349751:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361207.349793:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.350168:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab71453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361207.350321:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144112256 00000100:00100000:0.0:1788361207.350328:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144112256 00000100:00100000:0.0:1788361207.350359:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788361207.350366:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:24515:x1875232144112256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361207.350686:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:24515:x1875232144112256:12345-0@lo:503:mount.lustre.0 Request processed in 319us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361207.350693:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788361207.350770:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112256:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788361207.351405:0:24515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361207.351486:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361207.351535:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.351562:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab71453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361207.352382:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144112384 00000100:00100000:0.0:1788361207.352389:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144112384 00000100:00100000:0.0:1788361207.352423:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788361207.352431:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:24515:x1875232144112384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361207.352656:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:24515:x1875232144112384:12345-0@lo:502:mount.lustre.0 Request processed in 226us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361207.352676:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788361207.353040:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361207.353302:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:3.0:1788361207.353356:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 128 off8544 00000040:00080000:3.0:1788361207.353392:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 112 off8656 00000040:00080000:3.0:1788361207.353434:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8880 00000040:00080000:3.0:1788361207.353469:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9104 00000040:00080000:3.0:1788361207.353498:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 80 off9184 00000040:00080000:3.0:1788361207.353544:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9408 00000040:00080000:3.0:1788361207.353580:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9632 00000040:00080000:3.0:1788361207.353629:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 120 off9752 00000100:00100000:3.0:1788361207.353665:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112512:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361207.353730:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.353756:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab71453c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361207.354501:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144112512 00000100:00100000:0.0:1788361207.354509:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144112512 00000100:00100000:0.0:1788361207.354544:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361207.354554:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:24515:x1875232144112512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361207.354773:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:24515:x1875232144112512:12345-0@lo:502:mount.lustre.0 Request processed in 220us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361207.354792:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788361207.355117:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112512:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361207.355211:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off9976 00000040:00080000:3.0:1788361207.355236:0:24515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788361207.356702:0:24516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788361207.356711:0:24516:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788361207.356717:0:24516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361207.356719:0:24516:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788361207.356724:0:24516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361207.356738:0:24516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a8a90bf0000) 00000020:00000080:0.0:1788361207.356758:0:24516:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788361207.356763:0:24516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788361207.356983:0:24516:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8986fe2800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788361207.356991:0:24516:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788361207.356999:0:24516:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d66127fd 00010000:00010000:0.0:1788361207.366456:0:24516:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788361207.367870:0:24516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 12884901897 00080000:10000000:0.0:1788361207.369348:0:24516:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xd:0x0] (8/8/4) registered 00000020:00000080:1.0:1788361207.370744:0:24516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788361207.370754:0:24516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361207.370761:0:24516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361207.370763:0:24516:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788361207.371976:0:24516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361207.371988:0:24516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361207.371990:0:24516:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788361207.371998:0:24516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788361207.372000:0:24516:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788361207.372003:0:24516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361207.372005:0:24516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361207.372006:0:24516:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788361207.372009:0:24516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361207.372010:0:24516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361207.372012:0:24516:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788361207.372014:0:24516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788361207.372072:0:24516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361207.372075:0:24516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361207.372077:0:24516:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788361207.372080:0:24516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 11 count 11 00000020:01000000:3.0:1788361207.378013:0:24515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788361207.378052:0:24515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788361207.379079:0:24515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.379111:0:24515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361207.379120:0:24515:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8986fe2800 from 1 10000000:01000000:3.0:1788361207.379123:0:24515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361207.379168:0:24515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.379177:0:24515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.379188:0:24515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361207.379212:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361207.379285:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.379323:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361207.380680:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144112640 00000100:00100000:0.0:1788361207.380691:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144112640 00000100:00100000:0.0:1788361207.380749:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788361207.380759:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:24515:x1875232144112640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361207.380773:0:23208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361207.380787:0:23208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965c00/0xf6a94c97d661280b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6612804 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.380811:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965c00/0xf6a94c97d661280b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6612804 expref: 18 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.380823:0:23208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965c00/0xf6a94c97d661280b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612804 expref: 18 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.380832:0:23208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965c00, rc 0) 00000100:00100000:0.0:1788361207.381011:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:24515:x1875232144112640:12345-0@lo:101:mount.lustre.0 Request processed in 252us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361207.381018:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788361207.381593:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361207.381611:0:24515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.381621:0:24515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361207.382372:0:24515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000040:00080000:3.0:1788361207.382660:0:24515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361207.383034:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:3.0:1788361207.383208:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 112 off8528 00000040:00080000:3.0:1788361207.383337:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 224 off8752 00000040:00080000:3.0:1788361207.383370:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8976 00000040:00080000:3.0:1788361207.383399:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 112 off9088 00000040:00080000:3.0:1788361207.383441:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 224 off9312 00000040:00080000:3.0:1788361207.383477:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9536 00000040:00080000:3.0:1788361207.383507:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 128 off9664 00000040:00080000:3.0:1788361207.383570:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:3.0:1788361207.383584:0:24515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 9 count 10 00000100:00100000:3.0:1788361207.383655:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361207.383712:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.383806:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361207.386000:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144112768 00000100:00100000:0.0:1788361207.386012:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144112768 00000100:00100000:3.0:1788361207.387365:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361207.387411:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361207.387460:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.387519:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361207.387958:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144112896:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788361207.388418:0:24515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361207.388475:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361207.388512:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.388838:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361207.388948:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144113024 00000100:00100000:0.0:1788361207.388961:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144113024 00000100:00100000:1.0:1788361207.389113:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788361207.389122:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:24515:x1875232144113024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361207.389376:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:24515:x1875232144113024:12345-0@lo:502:mount.lustre.0 Request processed in 255us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361207.389383:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788361207.389468:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361207.389675:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:3.0:1788361207.389718:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 112 off8528 00000040:00080000:3.0:1788361207.389757:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 224 off8752 00000040:00080000:3.0:1788361207.389785:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8976 00000040:00080000:3.0:1788361207.389812:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 112 off9088 00000040:00080000:3.0:1788361207.390014:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 224 off9312 00000040:00080000:3.0:1788361207.390052:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9536 00000040:00080000:3.0:1788361207.390102:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 128 off9664 00000100:00100000:3.0:1788361207.390133:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361207.390170:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.390366:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361207.390725:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361207.390806:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:3.0:1788361207.390815:0:24515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788361207.391663:0:24520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361207.391671:0:24520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361207.391674:0:24520:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788361207.391679:0:24520:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8986fe2800 00000020:00000080:3.0:1788361207.391681:0:24520:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361207.391688:0:24520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361207.391690:0:24520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361207.391691:0:24520:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788361207.391693:0:24520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361207.391695:0:24520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361207.391697:0:24520:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788361207.391700:0:24520:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8986fe2800 00000020:00000080:3.0:1788361207.391701:0:24520:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361207.391779:0:24520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361207.391782:0:24520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361207.391784:0:24520:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788361207.391786:0:24520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361207.391788:0:24520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361207.391790:0:24520:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788361207.391793:0:24520:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8986fe2800 00000020:00000080:3.0:1788361207.391795:0:24520:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361207.393011:0:24520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361207.393017:0:24520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361207.393019:0:24520:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788361207.393023:0:24520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000020:01000000:0.0:1788361207.397969:0:24515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788361207.398009:0:24515:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361207.398028:0:24515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.398052:0:24515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361207.398127:0:24515:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788361207.398130:0:24515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8986fe2800 10000000:01000000:0.0:1788361207.398133:0:24515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8986fe2800 10000000:01000000:0.0:1788361207.398137:0:24515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361207.398142:0:24515:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8986fe2800 from 1 10000000:01000000:0.0:1788361207.398144:0:24515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361207.398185:0:24515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.398193:0:24515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.398203:0:24515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361207.399011:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361207.399078:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361207.399144:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361207.399315:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144113280 00000100:00100000:3.0:1788361207.399322:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144113280 00000100:00100000:3.0:1788361207.399373:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788361207.399382:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:24515:x1875232144113280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361207.399396:0:23205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361207.399416:0:23205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d6612819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6612812 expref: -99 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.399442:0:23205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d6612819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6612812 expref: 19 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.399452:0:23205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d6612819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612812 expref: 19 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.399461:0:23205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e400, rc 0) 00000100:00100000:3.0:1788361207.399499:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:24515:x1875232144113280:12345-0@lo:101:mount.lustre.0 Request processed in 118us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361207.399506:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788361207.399591:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361207.399605:0:24515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.399613:0:24515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361207.400348:0:24515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000040:00080000:0.0:1788361207.400648:0:24515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361207.400895:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:0.0:1788361207.400936:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 120 off8536 00000040:00080000:0.0:1788361207.400984:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 168 off8704 00000040:00080000:0.0:1788361207.401034:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8928 00000040:00080000:0.0:1788361207.401071:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 224 off9152 00000040:00080000:0.0:1788361207.401148:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 120 off9272 00000040:00080000:0.0:1788361207.401185:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 168 off9440 00000040:00080000:0.0:1788361207.401217:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 224 off9664 00000040:00080000:0.0:1788361207.401261:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:0.0:1788361207.401297:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 120 off10008 00000040:00080000:0.0:1788361207.401330:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 224 off10232 00000040:00080000:0.0:1788361207.401377:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10456 00000040:00080000:0.0:1788361207.401410:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].13, 88 off10544 00000040:00080000:0.0:1788361207.401443:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].14, 128 off10672 00000040:00080000:0.0:1788361207.401501:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].15, 144 off10816 00000040:00080000:0.0:1788361207.401538:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].16, 160 off10976 00000040:00080000:0.0:1788361207.401571:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].17, 224 off11200 00000040:00080000:0.0:1788361207.401622:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].18, 224 off11424 00000040:00080000:0.0:1788361207.401659:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].19, 80 off11504 00000040:00080000:0.0:1788361207.401692:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].20, 224 off11728 00000040:00080000:0.0:1788361207.401738:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].21, 224 off11952 00000040:00080000:0.0:1788361207.401772:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].22, 88 off12040 00000040:00080000:0.0:1788361207.401804:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].23, 128 off12168 00000040:00080000:0.0:1788361207.401850:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].24, 144 off12312 00000040:00080000:0.0:1788361207.401887:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].25, 128 off12440 00000040:00080000:0.0:1788361207.401923:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].26, 224 off12664 00000040:00080000:0.0:1788361207.401983:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].27, 224 off12888 00000040:00080000:0.0:1788361207.402021:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].28, 80 off12968 00000040:00080000:0.0:1788361207.402067:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].29, 224 off13192 00000040:00080000:0.0:1788361207.402145:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].30, 224 off13416 00000040:00080000:0.0:1788361207.402179:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].31, 88 off13504 00000040:00080000:0.0:1788361207.402211:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].32, 128 off13632 00000040:00080000:0.0:1788361207.402241:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].33, 144 off13776 00000040:00080000:0.0:1788361207.402300:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].34, 128 off13904 00000040:00080000:0.0:1788361207.402337:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].35, 224 off14128 00000040:00080000:0.0:1788361207.402380:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].36, 224 off14352 00000040:00080000:0.0:1788361207.402420:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].37, 80 off14432 00000040:00080000:0.0:1788361207.402603:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].38, 224 off14656 00000040:00080000:0.0:1788361207.402655:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].39, 224 off14880 00000040:00080000:0.0:1788361207.402693:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].40, 120 off15000 00000040:00080000:0.0:1788361207.402771:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].41, 224 off15224 00000040:00080000:0.0:1788361207.402777:0:24515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 41 count 42 00000100:00100000:0.0:1788361207.402923:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361207.402987:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361207.403032:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361207.403284:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144113408 00000100:00100000:1.0:1788361207.403293:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144113408 00000100:00100000:1.0:1788361207.403340:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788361207.403349:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:24515:x1875232144113408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361207.403572:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:24515:x1875232144113408:12345-0@lo:501:mount.lustre.0 Request processed in 223us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361207.403580:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788361207.403687:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361207.403723:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361207.403762:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361207.403787:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361207.404131:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144113536 00000100:00100000:1.0:1788361207.404136:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144113536 00000100:00100000:1.0:1788361207.404171:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788361207.404177:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:24515:x1875232144113536:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361207.404472:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:24515:x1875232144113536:12345-0@lo:503:mount.lustre.0 Request processed in 294us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361207.404480:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788361207.404639:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113536:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361207.408700:0:24515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361207.408784:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113664:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361207.408965:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361207.409047:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361207.413050:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144113664 00000100:00100000:0.0:1788361207.413065:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144113664 00000100:00100000:0.0:1788361207.413162:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788361207.413171:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:24515:x1875232144113664:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361207.413589:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:24515:x1875232144113664:12345-0@lo:502:mount.lustre.0 Request processed in 419us (4624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361207.413607:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788361207.413671:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361207.415069:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:0.0:1788361207.415163:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 120 off8536 00000040:00080000:0.0:1788361207.415192:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 168 off8704 00000040:00080000:0.0:1788361207.415337:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8928 00000040:00080000:0.0:1788361207.415372:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 224 off9152 00000040:00080000:0.0:1788361207.415410:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 120 off9272 00000040:00080000:0.0:1788361207.415437:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 168 off9440 00000040:00080000:0.0:1788361207.415464:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 224 off9664 00000040:00080000:0.0:1788361207.415501:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:0.0:1788361207.415546:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 120 off10008 00000040:00080000:0.0:1788361207.415582:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 224 off10232 00000040:00080000:0.0:1788361207.415632:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10456 00000040:00080000:0.0:1788361207.415669:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].13, 88 off10544 00000040:00080000:0.0:1788361207.415703:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].14, 128 off10672 00000040:00080000:0.0:1788361207.415747:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].15, 144 off10816 00000040:00080000:0.0:1788361207.415780:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].16, 160 off10976 00000040:00080000:0.0:1788361207.415815:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].17, 224 off11200 00000040:00080000:0.0:1788361207.416987:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].18, 224 off11424 00000040:00080000:0.0:1788361207.417054:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].19, 80 off11504 00000040:00080000:0.0:1788361207.417112:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].20, 224 off11728 00000040:00080000:0.0:1788361207.417177:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].21, 224 off11952 00000040:00080000:0.0:1788361207.417216:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].22, 88 off12040 00000040:00080000:0.0:1788361207.417429:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].23, 128 off12168 00000040:00080000:0.0:1788361207.417472:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].24, 144 off12312 00000040:00080000:0.0:1788361207.417506:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].25, 128 off12440 00000040:00080000:0.0:1788361207.417555:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].26, 224 off12664 00000040:00080000:0.0:1788361207.417604:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].27, 224 off12888 00000040:00080000:0.0:1788361207.417640:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].28, 80 off12968 00000040:00080000:0.0:1788361207.417685:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].29, 224 off13192 00000040:00080000:0.0:1788361207.417732:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].30, 224 off13416 00000040:00080000:0.0:1788361207.417767:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].31, 88 off13504 00000040:00080000:0.0:1788361207.417799:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].32, 128 off13632 00000040:00080000:0.0:1788361207.417832:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].33, 144 off13776 00000040:00080000:0.0:1788361207.418742:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].34, 128 off13904 00000040:00080000:0.0:1788361207.418786:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].35, 224 off14128 00000040:00080000:0.0:1788361207.418832:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].36, 224 off14352 00000040:00080000:0.0:1788361207.418882:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].37, 80 off14432 00000040:00080000:0.0:1788361207.418916:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].38, 224 off14656 00000040:00080000:0.0:1788361207.418975:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].39, 224 off14880 00000040:00080000:0.0:1788361207.419011:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].40, 120 off15000 00000100:00100000:0.0:1788361207.419059:0:24515:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361207.419145:0:24515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361207.419181:0:24515:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361207.419203:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144113792 00000100:00100000:0.0:1788361207.419210:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144113792 00000100:00100000:0.0:1788361207.419487:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788361207.419495:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:24515:x1875232144113792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361207.419692:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:24515:x1875232144113792:12345-0@lo:502:mount.lustre.0 Request processed in 197us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361207.419699:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788361207.419753:0:24515:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:24515:1875232144113792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361207.419816:0:24515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].41, 224 off15224 00000040:00080000:0.0:1788361207.419826:0:24515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788361207.421324:0:24525:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788361207.421350:0:24525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a8985c63380) 00000020:00000080:3.0:1788361207.421371:0:24525:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788361207.421522:0:24525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8986fe2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788361207.421526:0:24525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8986fe2800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788361207.421529:0:24525:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8986fe2800 3 00010000:00080000:3.0:1788361207.421556:0:24525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a89249800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361207.426473:0:24525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788361207.426578:0:24525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788361207.426616:0:24525:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788361207.426629:0:24525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf6a94c97d6612827 00000100:00080000:3.0:1788361207.426640:0:24525:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361207.426646:0:24525:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8a89249800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361207.426676:0:24525:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a843ead80 x1875232144113920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361207.426700:0:24525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788361207.426735:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144113920:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361207.426803:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361207.426969:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361207.426973:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788361207.426975:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361207.426985:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 592 00000100:00080000:0.0:1788361207.426989:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788361207.426993:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8a84584000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361207.427017:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a83540000 x1875232144114176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361207.427613:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144114432:0@lo:400:kworker.0 00000100:00100000:0.0:1788361207.427640:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788361207.428100:0:24525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000100:00100000:1.0:1788361207.428184:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144114176:0@lo:8:kworker.0 00000100:00100000:1.0:1788361207.428215:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.428309:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144114176 00000100:00100000:3.0:1788361207.428314:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144114176 00000100:00100000:3.0:1788361207.428334:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361207.428339:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1875232144114176:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788361207.428385:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1875232144114176:12345-0@lo:8:kworker.0 Request processed in 45us (169us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788361207.428392:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361207.428417:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361207.428423:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361207.428427:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788361207.428430:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144114176:0@lo:8:kworker.0 00000100:00100000:0.0:1788361207.429251:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144114560 00000100:00100000:0.0:1788361207.429321:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144114560 00000100:00100000:0.0:1788361207.429355:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788361207.429362:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:24515:x1875232144114560:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361207.429384:0:23208:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788361207.429397:0:23208:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788361207.429616:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a843ead80 x1875232144113920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361207.429626:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361207.429632:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 4 00000100:00080000:3.0:1788361207.429638:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788361207.429642:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361207.429645:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361207.429650:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144113920:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788361207.467968:0:23208:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361207.467988:0:23208:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788361207.468039:0:23229:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361207.468044:0:23229:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361207.468064:0:23229:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.468082:0:23229:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d66127d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66127cc expref: 19 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.468115:0:23229:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.468155:0:23229:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d66127d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66127cc expref: 19 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.468169:0:23229:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d66127d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66127cc expref: 19 pid: 23205 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361207.468202:0:23229:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23229:1875232144114688:0@lo:104: 00000100:00100000:0.0:1788361207.468276:0:23229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361207.468362:0:23229:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361207.469433:0:23197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144114688 00000100:00100000:3.0:1788361207.469443:0:23197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144114688 00000100:00100000:3.0:1788361207.470075:0:23197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361207.470111:0:23197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+3:23229:x1875232144114688:12345-0@lo:104: 00010000:00010000:3.0:1788361207.470127:0:23197:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66127d3 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.470224:0:23197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788361207.470230:0:23197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+3:23229:x1875232144114688:12345-0@lo:104: Request processed in 148us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361207.470238:0:23197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788361207.470257:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361207.470263:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66127d3 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.470270:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964a00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361207.470273:0:23202:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66127d3 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.470282:0:23202:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66127d3 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361207.470289:0:23202:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66127d3 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361207.470295:0:23202:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361207.470327:0:23202:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66127d3 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.470333:0:23202:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361207.470353:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66127d3 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.470360:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985964a00/0xf6a94c97d66127cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66127d3 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361207.470386:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361207.470388:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361207.470390:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361207.470410:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144114816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361207.470444:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361207.470854:0:23229:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:23229:1875232144114688:0@lo:104: 00010000:00010000:1.0:1788361207.470875:0:23229:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361207.471639:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144114816 00000100:00100000:0.0:1788361207.471648:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144114816 00010000:00010000:0.0:1788361207.471676:0:23199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d66127d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66127cc expref: 20 pid: 23205 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361207.471718:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361207.471728:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+20:3314:x1875232144114816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361207.471740:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361207.471745:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d66127d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66127cc expref: 20 pid: 23205 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471756:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d66127d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66127cc expref: 20 pid: 23205 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471770:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8a00/0xf6a94c97d66127d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66127cc expref: 20 pid: 23205 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471783:0:23199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471801:0:23199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788361207.471817:0:23199:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009809012s 00010000:00010000:0.0:1788361207.471822:0:23199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471845:0:23199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471852:0:23199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471857:0:23199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471863:0:23199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361207.471867:0:23199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471875:0:23199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471890:0:23199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.471899:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361207.471945:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3314:x1875232144114816:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361207.471964:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788361207.471995:0:23229:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.472002:0:23229:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361207.472008:0:23229:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6612835 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23229 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361207.472346:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144114816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361207.480170:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:24515:x1875232144114560:12345-0@lo:253:mount.lustre.0 Request processed in 50800us (51225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361207.480184:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00080000:10000000:0.0:1788361207.481407:0:24515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361207.481653:0:24515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361207.481957:0:24515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361207.482129:0:24515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361207.482419:0:24515:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788361207.483917:0:24515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869184 00002000:00080000:0.0:1788361207.544754:0:24515:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788361207.544763:0:24515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788361207.544879:0:24515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788361207.544939:0:24515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788361207.544963:0:24515:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788361207.544994:0:24515:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:3.0:1788361207.968688:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144114944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361207.968753:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361207.968833:0:23850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144114944 00000100:00100000:3.0:1788361207.968851:0:23850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144114944 00000100:00100000:3.0:1788361207.968895:0:23850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361207.968903:0:23850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144114944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361207.968937:0:23850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361207.968991:0:23850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144114944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361207.968999:0:23850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361207.969040:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144114944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361208.290435:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361208.672377:0:23247:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788361208.672386:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361208.673295:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 4 count 1 00000040:00080000:1.0:1788361208.673377:0:23247:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361208.673412:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 1 00010000:00010000:3.0:1788361209.312257:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788361209.504813:0:23210:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788361209.504820:0:23210:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8a84154800 from 14 10000000:01000000:1.0:1788361209.504826:0:23210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788361209.504877:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361209.504889:0:23210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361209.504900:0:23210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361209.504925:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144115072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361209.504997:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361209.505076:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361209.508753:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144115200 00000100:00100000:1.0:1788361209.508759:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144115200 00000100:00100000:1.0:1788361209.508837:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788361209.508844:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:23210:x1875232144115200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788361209.508858:0:23206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788361209.508873:0:23206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788361209.508877:0:23206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788361209.508996:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:23210:x1875232144115200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361209.509004:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:0.0:1788361210.339407:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361211.360232:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361212.384771:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361212.576839:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361212.576846:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788361212.576927:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361212.576940:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8a84584000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361212.576967:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a843eb100 x1875232144115584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361212.578041:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3312:1875232144115328:0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.578124:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361212.578173:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144115968:0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.578198:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361212.578224:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361212.578230:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144115840:0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.578261:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361212.578296:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144115456:0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.580650:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361212.580698:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361212.580709:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144115712:0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.580816:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361212.580841:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144115456 00000100:00100000:1.0:1788361212.580850:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144115456 00000100:00100000:1.0:1788361212.580904:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361212.580913:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144115456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.580942:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144115584:0@lo:8:kworker.0 00000100:00100000:3.0:1788361212.580981:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361212.580993:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144115456:12345-0@lo:400:kworker.0 Request processed in 80us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361212.581011:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361212.581027:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144115328 00000100:00100000:1.0:1788361212.581032:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144115584 00000100:00100000:3.0:1788361212.581033:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144115328 00000100:00100000:1.0:1788361212.581037:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144115584 00000100:00100000:1.0:1788361212.581066:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361212.581073:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144115584:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788361212.581081:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788361212.581126:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3312:x1875232144115328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.581163:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3312:x1875232144115328:12345-0@lo:400:kworker.0 Request processed in 38us (3040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361212.581170:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788361212.581206:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144115968 00000100:00100000:3.0:1788361212.581210:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144115968 00000100:00100000:3.0:1788361212.581230:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144115840 00000100:00100000:3.0:1788361212.581233:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144115840 00000100:00100000:3.0:1788361212.581253:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144115712 00000100:00100000:3.0:1788361212.581255:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144115712 00000100:00100000:3.0:1788361212.581266:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361212.581271:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144115968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.581301:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144115968:12345-0@lo:400:kworker.0 Request processed in 30us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361212.581307:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361212.581317:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361212.581323:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144115840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.581348:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144115840:12345-0@lo:400:kworker.0 Request processed in 25us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361212.581355:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361212.581373:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361212.581381:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144115712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.581411:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144115712:12345-0@lo:400:kworker.0 Request processed in 32us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361212.581418:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788361212.581471:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a843eb480 x1875232144115712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361212.581486:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144115712:0@lo:400:kworker.0 00010000:00080000:1.0:1788361212.581503:0:23847:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 602 last 0 00000100:00100000:3.0:1788361212.581507:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144115456:0@lo:400:kworker.0 00000020:00000080:1.0:1788361212.581538:0:23847:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d661284a 00002000:00100000:1.0:1788361212.581552:0:23847:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a8aae463000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788361212.581557:0:23847:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00010000:00080000:3.0:1788361212.581560:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a843e8380 x1875232144115840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00100000:1.0:1788361212.581561:0:23847:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788361212.581881:0:23847:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788361212.581902:0:23847:0:(import.c:65:import_set_state_nolock()) ffff9a8aae467800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361212.581955:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144115584:12345-0@lo:8:kworker.0 Request processed in 882us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361212.581962:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361212.582180:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144115840:0@lo:400:kworker.0 00000100:00100000:3.0:1788361212.582201:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3312:1875232144115328:0@lo:400:kworker.0 00010000:00080000:3.0:1788361212.582225:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a843e9880 x1875232144115968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361212.582235:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144115968:0@lo:400:kworker.0 00010000:00080000:3.0:1788361212.582293:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a843eb100 x1875232144115584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361212.582303:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 4 00000100:00080000:3.0:1788361212.582310:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788361212.582315:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788361212.582317:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788361212.582331:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788361212.582336:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144115584:0@lo:8:kworker.0 00000004:00080000:3.0:1788361212.582451:0:23238:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x43:0x0] 00000100:00100000:3.0:1788361212.582473:0:23238:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23238:1875232144116224:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788361212.582509:0:23238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361212.582531:0:23238:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562ca80 going to sleep for 11 seconds 00000004:00080000:3.0:1788361212.582548:0:23237:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:1.0:1788361212.582584:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361212.582590:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788361212.583185:0:23237:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 602598097990ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788361212.583219:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144116096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361212.583258:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361212.583297:0:23933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144116224 00000100:00100000:3.0:1788361212.583303:0:23933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144116224 00000100:00100000:3.0:1788361212.583345:0:23933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361212.583354:0:23933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23238:x1875232144116224:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788361212.588937:0:23933:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788361212.588948:0:23933:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 97 -> diff = -30 00002000:02000040:3.0:1788361212.588958:0:23933:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:68 to 0x280000400:97) 00002000:00010000:3.0:1788361212.598039:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x61:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.598052:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d6612851 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.598068:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.598072:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x61:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.598077:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d6612851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.598111:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d6612851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.598122:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d6612851 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.598130:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d6612851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.598148:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361212.600032:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361212.600044:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d6612851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.600058:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361212.600062:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d6612851 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.600073:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d6612851 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.600274:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d6612851 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.600282:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d6612851 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x61:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.600304:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361212.600306:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361212.600308:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361212.602288:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1788361212.604183:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x60:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.604195:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d6612858 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.604211:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.604216:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x60:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.604229:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d6612858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.604244:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d6612858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.604254:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d6612858 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.604261:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d6612858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.604283:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361212.604885:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.604892:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661285f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.604902:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.604905:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.604910:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661285f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.604931:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661285f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.604939:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661285f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.604957:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661285f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.604972:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361212.605767:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361212.605777:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d6612858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.605786:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361212.605790:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d6612858 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.605801:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d6612858 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.605902:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d6612858 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.605912:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d6612858 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.606006:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361212.606011:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661285f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.606020:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361212.606024:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661285f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.606033:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661285f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.606045:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661285f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.606054:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d661285f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.606067:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361212.606069:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361212.606077:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.606368:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.606376:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d6612866 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.606387:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.606391:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.606396:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d6612866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.606407:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d6612866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.606416:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d6612866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.606425:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d6612866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.606442:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361212.607104:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361212.607111:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d6612866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.607121:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361212.607125:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d6612866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361212.607127:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.607139:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d661286d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.607140:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d6612866 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.607161:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=602s v=(0 0) 00010000:00010000:0.0:1788361212.607161:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d6612866 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.607170:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361212.607178:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d6612866 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.607180:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d661286d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.607202:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d661286d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361212.607203:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361212.607206:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361212.607209:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.607215:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d661286d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.607223:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d661286d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.607241:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361212.607309:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361212.607317:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d661286d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.607325:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361212.607329:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d661286d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.607337:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d661286d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.607349:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d661286d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.607357:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d661286d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.607388:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361212.607391:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361212.607393:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.608533:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.608540:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612874 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.608549:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.608552:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.608556:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612874 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.608565:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612874 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.608585:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612874 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.608593:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612874 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.608610:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.608622:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.608627:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612874 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.608635:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.608637:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612874 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.608643:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612874 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.608653:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612874 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.608657:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612874 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.608668:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.608674:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.608676:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.609145:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.609152:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661287b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.609163:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.609167:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.609171:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661287b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.609181:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661287b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.609189:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661287b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.609197:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661287b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.609400:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361212.609736:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361212.609744:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661287b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.609753:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361212.609758:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661287b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.609767:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661287b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.609783:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661287b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.609792:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661287b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.609814:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361212.609817:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361212.609820:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.618145:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.618154:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6612882 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.618165:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.618170:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6612882 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.618192:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6612882 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.618208:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6612882 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.618215:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6612882 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.618233:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.618235:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.618237:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361212.624164:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361212.624178:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6612889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.624203:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361212.624208:0:23202:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6612889 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.624219:0:23202:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6612889 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.624240:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6612889 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.624248:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6612889 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x59:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361212.624271:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361212.624274:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361212.624277:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.624373:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x58:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.624384:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612890 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.624405:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.624412:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x58:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.624420:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612890 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.624434:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612890 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.624446:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612890 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.624461:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612890 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.624477:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.624487:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.624492:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612890 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.624507:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.624514:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612890 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.624529:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612890 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.624546:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612890 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.624555:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6612890 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x58:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.624582:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.624584:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.624589:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.626632:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x57:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.626651:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6612897 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.626665:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.626676:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x57:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.626681:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6612897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.626694:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6612897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.626705:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6612897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.626713:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6612897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x57:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.626741:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361212.627273:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x56:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.627282:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661289e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.627298:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.627303:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x56:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.627311:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661289e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.627322:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661289e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.627339:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661289e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.627348:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661289e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.627363:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.627374:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.627629:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661289e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.627639:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.627643:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661289e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.627652:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661289e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.627663:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661289e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.627671:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661289e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x56:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.627685:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.627693:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.627695:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.628390:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x55:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.628397:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d66128a5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.628407:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.628411:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x55:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.628416:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d66128a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.628427:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d66128a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.628435:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d66128a5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.628443:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1da797b/0xf6a94c97d66128a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x55:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.628467:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361212.628943:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x54:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.628949:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d66128ac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.628958:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.628960:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x54:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.628964:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d66128ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.628979:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d66128ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.628987:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d66128ac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.628994:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d66128ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629014:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361212.629465:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x53:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.629471:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d66128b3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629480:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.629483:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x53:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.629487:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d66128b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629496:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d66128b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629504:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d66128b3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629522:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d66128b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629537:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361212.629549:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361212.629553:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d66128ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629561:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.629564:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d66128ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629572:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d66128ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629584:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d66128ac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629591:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ac506db/0xf6a94c97d66128ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x54:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629609:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.629612:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d66128b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629628:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.629632:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d66128b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629639:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d66128b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629651:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d66128b3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629658:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035a47bd1/0xf6a94c97d66128b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x53:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.629673:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.629675:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.629678:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.630234:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x52:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.630240:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d66128ba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.630251:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.630254:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x52:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.630259:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d66128ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.630269:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d66128ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.630284:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d66128ba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.630290:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d66128ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x52:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.630305:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361212.630944:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x51:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.630951:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66128c1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.630960:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.630963:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x51:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.630968:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66128c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.630986:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66128c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.630994:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66128c1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631001:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66128c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631025:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.631035:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.631039:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66128c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631046:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.631049:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66128c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631058:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66128c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631068:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66128c1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631076:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66128c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x51:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631122:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.631125:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.631127:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.631563:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x50:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.631569:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d66128c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631577:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.631586:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x50:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.631590:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d66128c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631601:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d66128c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631609:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d66128c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631615:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d66128c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x50:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.631625:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361212.634006:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.634017:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d66128cf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634030:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.634034:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.634039:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d66128cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634052:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d66128cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634061:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d66128cf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634076:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d66128cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634193:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361212.634738:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.634745:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634756:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.634759:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.634763:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634773:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634781:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634788:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634805:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.634814:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.634818:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634832:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.634835:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634842:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634853:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634859:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.634872:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.634873:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.634875:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.639367:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.639379:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d66128dd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.639394:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.639398:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.639404:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d66128dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.639420:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d66128dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.639436:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d66128dd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.639444:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d66128dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.639463:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361212.640216:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.640224:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66128e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640235:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.640239:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.640245:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66128e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640260:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66128e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640276:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66128e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640297:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66128e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640334:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.640347:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.640354:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66128e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640366:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.640370:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66128e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640380:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66128e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640397:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66128e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640406:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66128e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640433:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.640437:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.640440:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.640953:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.640959:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66128eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640968:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.640976:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.640981:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66128eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640990:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66128eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.640998:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66128eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641005:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66128eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641021:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.641030:0:24890:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.641034:0:24890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66128eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641040:0:24890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.641044:0:24890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66128eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641052:0:24890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66128eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641063:0:24890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66128eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641079:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66128eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641121:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.641123:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.641126:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.641661:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.641668:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66128f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641678:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.641681:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.641686:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66128f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641697:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66128f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641705:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66128f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641713:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66128f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.641730:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361212.642215:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x49:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.642227:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.642243:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.642252:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x49:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.642258:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.642272:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.642282:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.642288:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.642304:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.644221:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.644234:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.644247:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.644253:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.644263:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.644296:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.644305:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66128f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x49:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.644328:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.644331:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.644335:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.645065:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x48:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.645073:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6612900 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645108:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.645113:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x48:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.645120:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6612900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645133:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6612900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645142:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6612900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645151:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6612900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645179:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.645191:0:24890:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.645196:0:24890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6612900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645203:0:24890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.645206:0:24890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6612900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645214:0:24890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6612900 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645227:0:24890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6612900 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645234:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6612900 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x48:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645250:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.645253:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.645256:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.645818:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x47:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.645825:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6612907 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645834:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.645845:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x47:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.645850:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6612907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645861:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6612907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645870:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6612907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645878:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6612907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x47:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.645896:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361212.646450:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x46:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.646456:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d661290e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.646465:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.646468:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x46:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.646473:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d661290e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.646483:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d661290e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.646491:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d661290e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.646505:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d661290e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.646521:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.646533:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.646539:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d661290e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.646561:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.646570:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d661290e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.646590:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d661290e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.646617:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d661290e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.646637:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d661290e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x46:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.646673:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.646677:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.646680:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.647695:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x45:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.647710:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d6612915 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.647720:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.647724:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x45:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.647729:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d6612915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.647741:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d6612915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.647750:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d6612915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.647759:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d6612915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.647773:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.647782:0:24890:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.647787:0:24890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d6612915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.647794:0:24890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.647798:0:24890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d6612915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.647806:0:24890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d6612915 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.647824:0:24890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d6612915 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.647831:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d6612915 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x45:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.647846:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.647848:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.647850:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361212.649242:0:23933:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x44:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361212.649251:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba78ea90/0xf6a94c97d661291c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.649263:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=602s v=(0 0) 00010000:00010000:3.0:1788361212.649266:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x44:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361212.649272:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba78ea90/0xf6a94c97d661291c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.649282:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba78ea90/0xf6a94c97d661291c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.649291:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba78ea90/0xf6a94c97d661291c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.649298:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba78ea90/0xf6a94c97d661291c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.649326:0:23933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361212.649337:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361212.649342:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba78ea90/0xf6a94c97d661291c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.649350:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361212.649354:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba78ea90/0xf6a94c97d661291c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.649362:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba78ea90/0xf6a94c97d661291c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.649377:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba78ea90/0xf6a94c97d661291c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.649385:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba78ea90/0xf6a94c97d661291c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x44:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361212.649404:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.649406:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361212.649408:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788361212.649578:0:23933:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:67 00000100:00100000:3.0:1788361212.649673:0:23933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:23238:x1875232144116224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 66317us (67160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361212.649682:0:23933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361212.649740:0:23238:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23238:1875232144116224:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788361212.649754:0:23238:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x61:0x0] from OST, last_created [0x280000400:0x61:0x0]last_used is [0x280000400:0x43:0x0] 00000100:00100000:3.0:1788361212.649938:0:23238:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:23238:1875232144116352:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788361212.649980:0:23238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361212.650024:0:23238:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361212.650041:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144116352 00000100:00100000:3.0:1788361212.650047:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144116352 00000100:00100000:3.0:1788361212.650109:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361212.650118:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:23238:x1875232144116352:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788361212.650154:0:23848:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 98 00000100:00100000:3.0:1788361212.653970:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:23238:x1875232144116352:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3846us (3983us total) trans 17179869185 rc 0/0 00000100:00100000:3.0:1788361212.653983:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000004:00080000:3.0:1788361212.669771:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788361213.088463:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144116480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361213.088530:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361213.088663:0:23850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144116480 00000100:00100000:3.0:1788361213.088671:0:23850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144116480 00000100:00100000:3.0:1788361213.088723:0:23850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361213.088731:0:23850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144116480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361213.088765:0:23850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361213.088817:0:23850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144116480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361213.088823:0:23850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361213.088892:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144116480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361214.045128:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130520320 00000100:00100000:1.0:1788361214.045138:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130520320 00000100:00100000:1.0:1788361214.045184:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:1.0:1788361214.045191:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1875232130520320:12345-192.168.203.60@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788361214.045230:0:23206:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 56ed8cc8-bd19-4f78-a05c-8174b7c5e83c@192.168.203.60@tcp t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:1.0:1788361214.045261:0:23206:0:(genops.c:1406:class_connect()) connect: client 56ed8cc8-bd19-4f78-a05c-8174b7c5e83c, cookie 0xf6a94c97d6612923 00000100:00080000:0.0:1788361214.045434:0:23206:0:(import.c:65:import_set_state_nolock()) ffff9a8a8986a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361214.045818:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+5:2348:x1875232130520320:12345-192.168.203.60@tcp:250:mount.lustre.0 Request processed in 624us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.045828:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:0.0:1788361214.057375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361214.057662:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130520448 00000100:00100000:3.0:1788361214.057673:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130520448 00000100:00100000:3.0:1788361214.057733:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1788361214.057744:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+5:20328:x1875232130520448:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361214.057778:0:23208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361214.057797:0:23208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d661292a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ea2c expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361214.057825:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d661292a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea2c expref: 6 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361214.057837:0:23208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d661292a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea2c expref: 6 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361214.057846:0:23208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fc00, rc 0) 00000100:00100000:3.0:1788361214.057916:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+6:20328:x1875232130520448:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 165us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361214.057924:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1788361214.059983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361214.060277:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130520576 00000100:00100000:0.0:1788361214.060288:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130520576 00000100:00100000:0.0:1788361214.060354:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1788361214.060363:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+6:20328:x1875232130520576:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788361214.060656:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+6:20328:x1875232130520576:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 293us (680us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361214.060664:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1788361214.067603:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130520704 00000100:00100000:3.0:1788361214.067613:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130520704 00000100:00100000:3.0:1788361214.067669:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:3.0:1788361214.067679:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+6:20328:x1875232130520704:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361214.067696:0:23208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361214.067725:0:23208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6612931 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ea33 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361214.067755:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6612931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea33 expref: 7 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361214.067767:0:23208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6612931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea33 expref: 7 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361214.067795:0:23208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f400, rc 0) 00000100:00100000:3.0:1788361214.067972:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84efbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+7:20328:x1875232130520704:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 293us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361214.067980:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:1.0:1788361214.077531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361214.082751:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130520960 00000100:00100000:0.0:1788361214.082762:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130520960 00000100:00100000:0.0:1788361214.082817:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1788361214.082828:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+8:20328:x1875232130520960:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788361214.083446:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84ef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+8:20328:x1875232130520960:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 618us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.083454:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:3.0:1788361214.090642:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361214.090719:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130521088 00000100:00100000:0.0:1788361214.090732:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130521088 00000100:00100000:0.0:1788361214.090788:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:0.0:1788361214.090798:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+8:20347:x1875232130521088:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361214.091145:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84efb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+8:20347:x1875232130521088:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 347us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.091154:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:1.0:1788361214.100564:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361214.100656:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130521216 00000100:00100000:0.0:1788361214.100666:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130521216 00000100:00100000:0.0:1788361214.100763:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:0.0:1788361214.100774:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+8:20347:x1875232130521216:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361214.101125:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+8:20347:x1875232130521216:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 351us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.101133:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:0.0:1788361214.106189:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130521344 00000100:00100000:0.0:1788361214.106200:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130521344 00000100:00100000:0.0:1788361214.107034:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:0.0:1788361214.107048:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+8:20328:x1875232130521344:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361214.107066:0:23208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361214.107083:0:23208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964e00/0xf6a94c97d6612938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ea5d expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361214.107481:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964e00/0xf6a94c97d6612938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea5d expref: 9 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361214.107494:0:23208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964e00/0xf6a94c97d6612938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea5d expref: 9 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361214.107503:0:23208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964e00, rc 0) 00000100:00100000:0.0:1788361214.107672:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+9:20328:x1875232130521344:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 626us (1973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.107681:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788361214.115403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361214.115528:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130521472 00000100:00100000:0.0:1788361214.115539:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130521472 00000100:00100000:0.0:1788361214.115635:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:0.0:1788361214.115645:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+9:20328:x1875232130521472:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788361214.115671:0:23206:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788361214.115701:0:23206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788361214.115705:0:23206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788361214.115708:0:23206:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788361214.115710:0:23206:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 14 00000100:00100000:0.0:1788361214.117640:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+9:20328:x1875232130521472:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 1989us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.117653:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1788361214.120354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361214.120857:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130521600 00000100:00100000:0.0:1788361214.120876:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130521600 00000100:00100000:0.0:1788361214.120938:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:0.0:1788361214.120947:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+9:20328:x1875232130521600:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361214.120964:0:23208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361214.120981:0:23208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965a00/0xf6a94c97d661293f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ea64 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361214.121009:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965a00/0xf6a94c97d661293f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea64 expref: 10 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361214.121021:0:23208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965a00/0xf6a94c97d661293f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea64 expref: 10 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361214.121029:0:23208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965a00, rc 0) 00000100:00100000:0.0:1788361214.121082:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+10:20328:x1875232130521600:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 137us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.121121:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1788361214.123560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361214.123719:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130521728 00000100:00100000:0.0:1788361214.123728:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130521728 00000100:00100000:0.0:1788361214.123783:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:0.0:1788361214.123800:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+10:20328:x1875232130521728:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788361214.124143:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+10:20328:x1875232130521728:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 351us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.124152:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1788361214.125460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361214.132874:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130521984 00000100:00100000:3.0:1788361214.132887:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130521984 00000100:00100000:3.0:1788361214.133012:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:3.0:1788361214.133023:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+10:20351:x1875232130521984:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788361214.133303:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+10:20351:x1875232130521984:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 282us (3702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361214.133312:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:3.0:1788361214.136401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361214.142492:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361214.142741:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130522240 00000100:00100000:3.0:1788361214.142752:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130522240 00000100:00100000:3.0:1788361214.142802:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361214.142811:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875232130522240:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788361214.142841:0:23213:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from a3b5bfdf-7a4d-457e-bbc9-180c7e54f761@192.168.203.60@tcp t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:3.0:1788361214.142886:0:23213:0:(genops.c:1406:class_connect()) connect: client a3b5bfdf-7a4d-457e-bbc9-180c7e54f761, cookie 0xf6a94c97d6612946 00000004:00100000:3.0:1788361214.142925:0:23213:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788361214.142931:0:23213:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869184 00000100:00080000:1.0:1788361214.198949:0:23213:0:(import.c:65:import_set_state_nolock()) ffff9a8aae466800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361214.199046:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2348:x1875232130522240:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 56234us (56563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361214.199058:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361214.204942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361214.205047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361214.205148:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130522368 00000100:00100000:0.0:1788361214.205160:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130522368 00000100:00100000:0.0:1788361214.205241:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00080000:3.0:1788361214.205285:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361214.205325:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:0:x1875232130522368:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788361214.205374:0:23214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788361214.205470:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:0:x1875232130522368:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 149us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.208127:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361214.208170:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361214.208186:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20328:x1875232130522496:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788361214.208220:0:23214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788361214.208374:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20328:x1875232130522496:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 194us (3325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.208382:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361214.216288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361214.217504:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130522624 00000100:00100000:1.0:1788361214.217516:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130522624 00000100:00100000:0.0:1788361214.217890:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361214.217901:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20328:x1875232130522624:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788361214.218018:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20328:x1875232130522624:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 119us (1740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.218025:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361214.227125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361214.227221:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130522752 00000100:00100000:0.0:1788361214.227233:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130522752 00000100:00100000:0.0:1788361214.227293:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361214.227301:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875232130522752:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788361214.227332:0:23849:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a3b5bfdf-7a4d-457e-bbc9-180c7e54f761@192.168.203.60@tcp t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:0.0:1788361214.227366:0:23849:0:(genops.c:1406:class_connect()) connect: client a3b5bfdf-7a4d-457e-bbc9-180c7e54f761, cookie 0xf6a94c97d661294d 00002000:00100000:0.0:1788361214.227377:0:23849:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a3b5bfdf-7a4d-457e-bbc9-180c7e54f761/ffff9a8a89869800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788361214.227388:0:23849:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788361214.227714:0:23849:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788361214.227743:0:23849:0:(import.c:65:import_set_state_nolock()) ffff9a8a89868800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361214.227814:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2348:x1875232130522752:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 512us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.227822:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361214.230399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361214.231813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361214.231956:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130523008 00000100:00100000:1.0:1788361214.231963:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130523008 00000100:00100000:1.0:1788361214.232003:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361214.232010:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20328:x1875232130523008:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788361214.232584:0:23216:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 518us 00000004:00200000:0.0:1788361214.249537:0:23216:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788361214.249712:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20328:x1875232130523008:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 17698us (17895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361214.249727:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361214.409158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1788361214.436258:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361215.456285:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361216.202239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361216.206576:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130523264 00000100:00100000:0.0:1788361216.206593:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130523264 00000100:00100000:0.0:1788361216.206759:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361216.206771:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:20425:x1875232130523264:12345-192.168.203.60@tcp:41:lfs.0 00000004:00000024:0.0:1788361216.206815:0:23213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788361216.206926:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:20425:x1875232130523264:12345-192.168.203.60@tcp:41:lfs.0 Request processed in 157us (4697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361216.206934:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:3.0:1788361216.209444:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361216.213024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361216.213110:0:23850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130523392 00000100:00100000:3.0:1788361216.213119:0:23850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130523392 00000100:00080000:1.0:1788361216.213237:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361216.213300:0:23850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361216.213312:0:23850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20425:x1875232130523392:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:3.0:1788361216.213349:0:23850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361216.213550:0:23850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20425:x1875232130523392:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 240us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.213559:0:23850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361216.215989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361216.216141:0:23850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130523520 00000100:00100000:3.0:1788361216.216151:0:23850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130523520 00000100:00100000:3.0:1788361216.216274:0:23850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361216.216285:0:23850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20425:x1875232130523520:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:3.0:1788361216.216321:0:23850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361216.216407:0:23850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20425:x1875232130523520:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 123us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.216424:0:23850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00080000:1.0:1788361216.216850:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361216.366987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361216.367075:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130523648 00000100:00100000:3.0:1788361216.367125:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130523648 00000100:00100000:3.0:1788361216.367192:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:3.0:1788361216.367202:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+10:20456:x1875232130523648:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361216.367217:0:23208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361216.367233:0:23208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f600/0xf6a94c97d6612969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ea95 expref: -99 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361216.367270:0:23208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f600/0xf6a94c97d6612969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea95 expref: 11 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361216.367283:0:23208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573f600/0xf6a94c97d6612969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea95 expref: 11 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361216.367292:0:23208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:3.0:1788361216.367352:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20456:x1875232130523648:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 151us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.367360:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:3.0:1788361216.376076:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130523776 00000100:00100000:3.0:1788361216.376108:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130523776 00000100:00100000:3.0:1788361216.376157:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:3.0:1788361216.376172:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20456:x1875232130523776:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788361216.376450:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20456:x1875232130523776:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 278us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.376458:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788361216.381794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361216.381943:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130523904 00000100:00100000:0.0:1788361216.381954:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130523904 00000100:00100000:0.0:1788361216.382057:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:0.0:1788361216.382068:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20456:x1875232130523904:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788361216.382359:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20456:x1875232130523904:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 292us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361216.382368:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1788361216.395997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361216.396124:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130524032 00000100:00100000:0.0:1788361216.396136:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130524032 00000100:00100000:0.0:1788361216.396204:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:0.0:1788361216.396215:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20463:x1875232130524032:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361216.396503:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20463:x1875232130524032:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 289us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361216.396510:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:0.0:1788361216.431200:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130524160 00000100:00100000:0.0:1788361216.431215:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130524160 00000100:00100000:0.0:1788361216.431291:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:0.0:1788361216.431301:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20463:x1875232130524160:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361216.431581:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20463:x1875232130524160:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 280us (4209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361216.431589:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1788361216.441615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361216.441702:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130524288 00000100:00100000:3.0:1788361216.441712:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130524288 00000100:00100000:3.0:1788361216.441765:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:3.0:1788361216.441774:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20456:x1875232130524288:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361216.441806:0:23205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361216.441823:0:23205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d6612970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eabf expref: -99 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361216.441852:0:23205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d6612970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eabf expref: 12 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361216.441862:0:23205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d6612970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eabf expref: 12 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361216.441871:0:23205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f800, rc 0) 00000100:00100000:3.0:1788361216.441949:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:20456:x1875232130524288:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 169us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.441957:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:1.0:1788361216.448162:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361216.448241:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130524416 00000100:00100000:3.0:1788361216.448251:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130524416 00000100:00100000:3.0:1788361216.448305:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:3.0:1788361216.448314:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:20456:x1875232130524416:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788361216.448338:0:23208:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788361216.448358:0:23208:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788361216.448362:0:23208:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788361216.448365:0:23208:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788361216.448368:0:23208:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 14 00000100:00100000:3.0:1788361216.451373:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:20456:x1875232130524416:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 3048us (3210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.451387:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361216.454299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361216.457066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361216.457185:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130524672 00000100:00100000:3.0:1788361216.457206:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130524672 00000100:00100000:3.0:1788361216.457258:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:3.0:1788361216.457277:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20456:x1875232130524672:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788361216.457560:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20456:x1875232130524672:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 294us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.457725:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:1.0:1788361216.459511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361216.459672:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130524800 00000100:00100000:3.0:1788361216.459681:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130524800 00000100:00100000:3.0:1788361216.459739:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:3.0:1788361216.459749:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20456:x1875232130524800:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788361216.460064:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20456:x1875232130524800:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 315us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.460072:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:1.0:1788361216.463829:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361216.477926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361216.478022:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130525056 00000100:00100000:3.0:1788361216.478033:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130525056 00000100:00100000:3.0:1788361216.478131:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:3.0:1788361216.478142:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20469:x1875232130525056:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788361216.478526:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20469:x1875232130525056:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 385us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.478535:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:3.0:1788361216.489973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361216.504360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361216.504402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361216.504507:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130525440 00000100:00100000:1.0:1788361216.504533:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130525440 00000100:00100000:1.0:1788361216.504602:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361216.504668:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21603276-4ada-4ef3-bed6-677f5b3076da+7:0:x1875232130525312:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788361216.504706:0:23214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788361216.504776:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21603276-4ada-4ef3-bed6-677f5b3076da+7:0:x1875232130525312:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 112us (373us total) trans 0 rc 0/0 00000100:00080000:3.0:1788361216.504798:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361216.506541:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361216.506733:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361216.506746:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21603276-4ada-4ef3-bed6-677f5b3076da+6:20456:x1875232130525440:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788361216.506775:0:23214:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788361216.507068:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21603276-4ada-4ef3-bed6-677f5b3076da+6:20456:x1875232130525440:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 326us (2717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361216.507076:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361216.509146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361216.514523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361216.514715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361216.514746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361216.515507:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130525696 00000100:00100000:3.0:1788361216.515516:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130525696 00000100:00100000:3.0:1788361216.515550:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130525824 00000100:00100000:3.0:1788361216.515552:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130525824 00000100:00100000:3.0:1788361216.515587:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361216.515593:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875232130525696:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361216.515624:0:23849:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 21603276-4ada-4ef3-bed6-677f5b3076da@192.168.203.60@tcp t0 exp 0000000000000000 cur 606 last 0 00000020:00000080:3.0:1788361216.515655:0:23849:0:(genops.c:1406:class_connect()) connect: client 21603276-4ada-4ef3-bed6-677f5b3076da, cookie 0xf6a94c97d6612985 00002000:00100000:3.0:1788361216.515666:0:23849:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 21603276-4ada-4ef3-bed6-677f5b3076da/ffff9a8a8559c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361216.515676:0:23849:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361216.515768:0:23849:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788361216.515795:0:23849:0:(import.c:65:import_set_state_nolock()) ffff9a8a85598800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361216.515853:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21603276-4ada-4ef3-bed6-677f5b3076da+6:2348:x1875232130525696:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 259us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.515860:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361216.515877:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361216.515881:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875232130525824:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361216.515907:0:23849:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 21603276-4ada-4ef3-bed6-677f5b3076da@192.168.203.60@tcp t0 exp 0000000000000000 cur 606 last 0 00000020:00000080:3.0:1788361216.515922:0:23849:0:(genops.c:1406:class_connect()) connect: client 21603276-4ada-4ef3-bed6-677f5b3076da, cookie 0xf6a94c97d661298c 00002000:00100000:3.0:1788361216.515927:0:23849:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 21603276-4ada-4ef3-bed6-677f5b3076da/ffff9a8a8559d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361216.515933:0:23849:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361216.515979:0:23849:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788361216.515993:0:23849:0:(import.c:65:import_set_state_nolock()) ffff9a8a8559b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361216.516018:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21603276-4ada-4ef3-bed6-677f5b3076da+6:2348:x1875232130525824:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 135us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361216.516025:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361216.684918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361216.685026:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130526080 00000100:00100000:1.0:1788361216.685037:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130526080 00000100:00100000:1.0:1788361216.685148:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361216.685172:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21603276-4ada-4ef3-bed6-677f5b3076da+6:20490:x1875232130526080:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:1.0:1788361216.685199:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361216.685229:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8400/0xf6a94c97d6612993 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eaf0 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361216.685301:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361216.685316:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361216.685353:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361216.685565:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788361216.685571:0:23214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 6 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361216.685809:0:23214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361216.685839:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8400/0xf6a94c97d6612993 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf0 expref: 8 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361216.685855:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf0 expref: 7 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361216.685864:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:1.0:1788361216.685867:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361216.685871:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9000, rc 0) 00000100:00100000:1.0:1788361216.685960:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21603276-4ada-4ef3-bed6-677f5b3076da+7:20490:x1875232130526080:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 802us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361216.685968:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:3.0:1788361217.509079:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361217.697855:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144116608:0@lo:400:kworker.0 00000100:00100000:3.0:1788361217.697918:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361217.697959:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144116736 00000100:00100000:3.0:1788361217.697966:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144116736 00000100:00100000:3.0:1788361217.698021:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361217.698030:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144116736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361217.698910:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144116736:12345-0@lo:400:kworker.0 Request processed in 878us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361217.698919:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788361217.698973:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361217.698991:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144117120:0@lo:400:kworker.0 00000100:00100000:0.0:1788361217.699082:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144117248 00000100:00100000:0.0:1788361217.699104:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144117248 00000100:00100000:0.0:1788361217.699144:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361217.699152:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144117248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361217.699217:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361217.699243:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361217.703773:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144117248:12345-0@lo:400:kworker.0 Request processed in 4611us (4834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361217.703787:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361217.703823:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144117120 00000100:00100000:0.0:1788361217.703831:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144117120 00000100:00100000:0.0:1788361217.703879:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144116992 00000100:00100000:0.0:1788361217.703893:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144116992 00000100:00100000:0.0:1788361217.703909:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361217.703916:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144117120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361217.703970:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144117120:12345-0@lo:400:kworker.0 Request processed in 54us (4753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361217.703976:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361217.703986:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361217.703991:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144116992:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361217.704109:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361217.704113:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361217.704214:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144116608:0@lo:400:kworker.0 00000100:00100000:3.0:1788361217.704287:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144117120:0@lo:400:kworker.0 00000100:00100000:0.0:1788361217.704401:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144116992:12345-0@lo:400:kworker.0 Request processed in 409us (5099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361217.704407:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361217.704454:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144117248:0@lo:400:kworker.0 00000001:00100000:1.0:1788361217.784495:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788361217.784510:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 00000001:00100000:1.0:1788361217.784521:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 21603276-4ada-4ef3-bed6-677f5b3076da 00000001:00080000:1.0:1788361217.784536:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869185 is committed 00000100:00100000:0.0:1788361218.209664:0:23850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144117504 00000100:00100000:0.0:1788361218.209672:0:23850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144117504 00000100:00100000:0.0:1788361218.209741:0:23850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361218.209751:0:23850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144117504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361218.209786:0:23850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361218.210471:0:23850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144117504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 720us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361218.210480:0:23850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788361218.530591:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361218.913719:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788361219.053138:0:25077:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788361219.297680:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 00000001:00100000:1.0:1788361219.297713:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 21603276-4ada-4ef3-bed6-677f5b3076da 00010000:00010000:3.0:1788361220.577253:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361221.606217:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361221.767341:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361221.767455:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130526208 00000100:00100000:1.0:1788361221.767468:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130526208 00000100:00100000:1.0:1788361221.767525:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:1.0:1788361221.767535:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2349:x1875232130526208:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361221.767616:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2349:x1875232130526208:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361221.767624:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:0.0:1788361221.773937:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361221.774033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361221.774068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361221.774118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361221.774146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361221.774192:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130526592 00000100:00100000:3.0:1788361221.774201:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130526592 00000100:00100000:3.0:1788361221.774257:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130526848 00000100:00100000:3.0:1788361221.774261:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130526848 00000100:00100000:3.0:1788361221.774279:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130526464 00000100:00100000:3.0:1788361221.774282:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130526464 00000100:00100000:3.0:1788361221.774304:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361221.774312:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2350:x1875232130526592:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361221.774392:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2350:x1875232130526592:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361221.774406:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361221.774423:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361221.774432:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:2350:x1875232130526848:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361221.774460:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:2350:x1875232130526848:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361221.774466:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361221.774477:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361221.774484:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2350:x1875232130526464:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361221.774507:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2350:x1875232130526464:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361221.774512:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00080000:3.0:1788361221.774529:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361221.774533:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361221.775274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361221.775298:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130526976 00000100:00100000:0.0:1788361221.775303:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130526976 00000100:00100000:0.0:1788361221.775339:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361221.775347:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:2350:x1875232130526976:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361221.775401:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:2350:x1875232130526976:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361221.775408:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00080000:0.0:1788361221.775428:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361221.775615:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130526336 00000100:00100000:1.0:1788361221.775620:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130526336 00000100:00100000:1.0:1788361221.775663:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130526720 00000100:00100000:1.0:1788361221.775666:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130526720 00000100:00100000:1.0:1788361221.775689:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361221.775700:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2350:x1875232130526336:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361221.775735:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2350:x1875232130526336:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 36us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361221.775742:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361221.775756:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361221.775763:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21603276-4ada-4ef3-bed6-677f5b3076da+6:2350:x1875232130526720:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361221.775901:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21603276-4ada-4ef3-bed6-677f5b3076da+6:2350:x1875232130526720:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 138us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361221.775908:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00080000:0.0:1788361221.776361:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788361221.910888:0:25226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788361221.911049:0:25225:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788361221.923367:0:25225:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788361221.923399:0:25225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923446:0:25225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6612675 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661266e expref: 18 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923453:0:25225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985964400/0xf6a94c97d66126c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66126bb expref: 18 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923459:0:25225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985965c00/0xf6a94c97d661280b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612804 expref: 18 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923468:0:25225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985965a00/0xf6a94c97d661293f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea64 expref: 12 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923475:0:25225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6612977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eac6 expref: 12 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923483:0:25225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923527:0:25225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6612977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eac6 expref: 12 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923542:0:25225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6612977 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eac6 expref: 12 pid: 23206 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361221.923556:0:25225:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25225:1875232144117632:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361221.923661:0:25225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985965a00/0xf6a94c97d661293f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea64 expref: 12 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923669:0:25225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985965a00/0xf6a94c97d661293f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea64 expref: 12 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361221.923685:0:25225:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25225:1875232144117760:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361221.923718:0:25225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985965c00/0xf6a94c97d661280b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6612804 expref: 18 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923727:0:25225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985965c00/0xf6a94c97d661280b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6612804 expref: 18 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361221.923737:0:25225:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25225:1875232144117888:0@lo:104: 00000100:00100000:1.0:1788361221.923775:0:25225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788361221.923817:0:25225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985964400/0xf6a94c97d66126c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66126bb expref: 18 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.923826:0:25225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985964400/0xf6a94c97d66126c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66126bb expref: 18 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361221.923834:0:25225:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25225:1875232144118016:0@lo:104: 00000100:00100000:1.0:1788361221.923864:0:25225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361221.923896:0:23197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144117888 00000100:00100000:1.0:1788361221.923903:0:23197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144117888 00000100:00100000:1.0:1788361221.923941:0:23197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144118016 00000100:00100000:1.0:1788361221.923943:0:23197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144118016 00000100:00100000:1.0:1788361221.923956:0:23197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361221.923964:0:23197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+4:25225:x1875232144117888:12345-0@lo:104: 00010000:00010000:1.0:1788361221.923976:0:23197:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.924014:0:23197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361221.924020:0:23197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+4:25225:x1875232144117888:12345-0@lo:104: Request processed in 56us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361221.924032:0:23197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361221.924048:0:23197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361221.924053:0:23197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+3:25225:x1875232144118016:12345-0@lo:104: 00010000:00010000:1.0:1788361221.924060:0:23197:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.924137:0:23197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788361221.924143:0:23197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+3:25225:x1875232144118016:12345-0@lo:104: Request processed in 90us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361221.924149:0:23197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788361221.924183:0:25225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6612675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661266e expref: 18 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.924192:0:25225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6612675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661266e expref: 18 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361221.924200:0:25225:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25225:1875232144118144:0@lo:104: 00000100:00100000:1.0:1788361221.924227:0:25225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361221.924254:0:25225:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aafd8c300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361221.924272:0:23197:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788361221.924286:0:23197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144118144 00000100:00100000:1.0:1788361221.924288:0:25225:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25225:1875232144117888:0@lo:104: 00000100:00100000:0.0:1788361221.924291:0:23197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144118144 00000100:00100000:1.0:1788361221.924300:0:25225:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25225:1875232144118016:0@lo:104: 00000100:00100000:0.0:1788361221.924320:0:23197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361221.924330:0:23197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89861a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+3:25225:x1875232144118144:12345-0@lo:104: 00010000:00010000:0.0:1788361221.924346:0:23197:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d661266e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6612675 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924633:0:24890:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361221.924641:0:24890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924648:0:24890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361221.924652:0:24890:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924661:0:24890:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361221.924669:0:24890:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361221.924682:0:24890:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361221.924714:0:24890:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924720:0:24890:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361221.924740:0:24890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924747:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fa00/0xf6a94c97d6612804 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661280b expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924758:0:24890:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361221.924762:0:24890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924768:0:24890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361221.924771:0:24890:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924779:0:24890:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361221.924785:0:24890:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361221.924790:0:24890:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361221.924808:0:24890:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924815:0:24890:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361221.924828:0:24890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924833:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf000/0xf6a94c97d66126bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66126c2 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.924844:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361221.924846:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361221.924847:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361221.924872:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144118272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361221.924904:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361221.924936:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361221.924942:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144118400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361221.924962:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361221.924989:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144118272 00000100:00100000:3.0:1788361221.924994:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144118272 00010000:00010000:3.0:1788361221.925013:0:23200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985965c00/0xf6a94c97d661280b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6612804 expref: 19 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361221.925033:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144118400 00000100:00100000:3.0:1788361221.925036:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144118400 00010000:00010000:3.0:1788361221.925048:0:23200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985964400/0xf6a94c97d66126c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66126bb expref: 20 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361221.925059:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361221.925064:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+20:3311:x1875232144118272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361221.925074:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361221.925079:0:23200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985965c00/0xf6a94c97d661280b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6612804 expref: 20 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.926329:0:23197:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361221.926345:0:23197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89861a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+3:25225:x1875232144118144:12345-0@lo:104: Request processed in 2010us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361221.926352:0:23197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788361221.926575:0:23200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985965c00/0xf6a94c97d661280b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6612804 expref: 19 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.926587:0:23200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965c00/0xf6a94c97d661280b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6612804 expref: 19 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.926596:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361221.926657:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361221.926663:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d661266e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6612675 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.926671:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361221.926675:0:23201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d661266e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6612675 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.926683:0:23201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d661266e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6612675 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361221.926689:0:23201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d661266e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6612675 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361221.926695:0:23201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361221.926723:0:23201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d661266e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6612675 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.926730:0:23201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361221.926748:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d661266e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6612675 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.926754:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e200/0xf6a94c97d661266e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6612675 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.926768:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361221.926769:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361221.926778:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361221.926797:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144118528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361221.926978:0:25225:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25225:1875232144118144:0@lo:104: 00000100:00100000:3.0:1788361221.927078:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:3311:x1875232144118272:12345-0@lo:103:ldlm_bl.0 Request processed in 2011us (2171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361221.927103:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361221.927392:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361221.927574:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144118528 00000100:00100000:1.0:1788361221.927588:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144118528 00010000:00010000:1.0:1788361221.927610:0:23199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6612675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661266e expref: 17 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361221.927642:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361221.927649:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7474c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:3313:x1875232144118528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361221.927660:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361221.927664:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6612675 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661266e expref: 17 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.927673:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6612675 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661266e expref: 17 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.927685:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6612675 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661266e expref: 17 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.927695:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361221.927734:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7474c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:3313:x1875232144118528:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361221.927742:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361221.927865:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144118528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361221.928016:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144118272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361221.929638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361221.929667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361221.929840:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130527232 00000100:00100000:3.0:1788361221.929849:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130527232 00010000:00010000:3.0:1788361221.929893:0:23200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985965a00/0xf6a94c97d661293f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea64 expref: 13 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361221.929928:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130527104 00000100:00100000:3.0:1788361221.929931:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130527104 00010000:00010000:3.0:1788361221.929943:0:23200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6612977 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eac6 expref: 14 pid: 23206 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361221.929966:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361221.929975:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+14:2349:x1875232130527232:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361221.929987:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361221.929993:0:23200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985965a00/0xf6a94c97d661293f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea64 expref: 14 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.930003:0:23200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985965a00/0xf6a94c97d661293f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea64 expref: 14 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361221.930037:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361221.930107:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+14:2349:x1875232130527232:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 110us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361221.930114:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361221.930214:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361221.930223:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+14:2349:x1875232130527104:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361221.930231:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361221.930237:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6612977 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eac6 expref: 14 pid: 23206 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930246:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6612977 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eac6 expref: 14 pid: 23206 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930259:0:23199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930268:0:23199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930284:0:23199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930291:0:23199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930297:0:23199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930313:0:23199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930318:0:23199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361221.930322:0:23199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930329:0:23199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930348:0:23199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361221.930358:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361221.930379:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+14:2349:x1875232130527104:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 158us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361221.930385:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:1.0:1788361221.931691:0:25225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6612977 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eac6 expref: 12 pid: 23206 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361221.931707:0:25225:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25225:1875232144117632:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361221.931720:0:25225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965a00/0xf6a94c97d661293f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea64 expref: 11 pid: 23208 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361221.931727:0:25225:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25225:1875232144117760:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361221.931765:0:25225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.931774:0:25225:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.931780:0:25225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361221.931786:0:25225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66129a1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.625952:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361222.816598:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361222.816622:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144118656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361222.816681:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144118912:0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.816698:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361222.816729:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361222.816770:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144119040:0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.816796:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361222.816826:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361222.816832:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144119168:0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.816868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361222.816898:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144118912 00000100:00100000:0.0:1788361222.816905:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144118912 00000100:00100000:0.0:1788361222.816970:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144119040 00000100:00100000:0.0:1788361222.816986:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144119040 00000100:00100000:0.0:1788361222.817012:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361222.817020:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144118912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.817069:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144118912:12345-0@lo:400:kworker.0 Request processed in 50us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361222.817077:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361222.817130:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361222.817137:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144119040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.817172:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144119040:12345-0@lo:400:kworker.0 Request processed in 36us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361222.817177:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788361222.817194:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361222.817198:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361222.817223:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869185 gen 2 00000100:00100000:1.0:1788361222.817602:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144118784:0@lo:400:kworker.0 00000100:00100000:1.0:1788361222.817639:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361222.817670:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144119296:0@lo:400:kworker.0 00000100:00100000:1.0:1788361222.817697:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361222.817730:0:23851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144118656 00000100:00100000:1.0:1788361222.817735:0:23851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144118656 00000100:00100000:0.0:1788361222.818142:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144119040:0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.818188:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144119168 00000100:00100000:0.0:1788361222.818192:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144119168 00000100:00100000:0.0:1788361222.818223:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144119296 00000100:00100000:0.0:1788361222.818227:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144119296 00000100:00100000:0.0:1788361222.818714:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361222.818723:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144119168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361222.818976:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144118912:0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.818988:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144119168:12345-0@lo:400:kworker.0 Request processed in 264us (2116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361222.818990:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144119424:0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.819002:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361222.819023:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788361222.819029:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361222.819034:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144119296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361222.819080:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144119424 00000100:00100000:3.0:1788361222.819101:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144119424 00000100:00100000:0.0:1788361222.819125:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144119296:12345-0@lo:400:kworker.0 Request processed in 94us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361222.819128:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361222.819135:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144119424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.819147:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788361222.819171:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361222.819180:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144119424:12345-0@lo:400:kworker.0 Request processed in 44us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361222.819188:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361222.819198:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144119168:0@lo:400:kworker.0 00000100:00100000:3.0:1788361222.819240:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144119424:0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.819960:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144118784 00000100:00100000:0.0:1788361222.819967:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144118784 00000100:00100000:0.0:1788361222.820001:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788361222.820008:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:3311:x1875232144118784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361222.820052:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:3311:x1875232144118784:12345-0@lo:400:kworker.0 Request processed in 45us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361222.820058:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788361222.820157:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144118784:0@lo:400:kworker.0 00000100:00100000:3.0:1788361222.820172:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144119296:0@lo:400:kworker.0 00000100:00100000:1.0:1788361222.820320:0:23851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788361222.820330:0:23851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144118656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361222.820358:0:23851:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361222.820411:0:23851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144118656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (3714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361222.820417:0:23851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788361222.820456:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144118656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361222.858472:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130527360 00000100:00100000:0.0:1788361222.858483:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130527360 00000100:00100000:0.0:1788361222.858588:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1788361222.858598:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:20945:x1875232130527360:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361222.858619:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361222.858644:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d66129a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eaf7 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.858708:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66129af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.858722:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66129af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.858733:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66129af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.858746:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d66129b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.858765:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d66129b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.858772:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d66129b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860619:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d66129bd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860650:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d66129bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860662:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d66129bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361222.860752:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788361222.860757:0:23215:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361222.860858:0:23215:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d66129bd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860871:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66129af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860877:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66129af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860884:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66129af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860890:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361222.860894:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66129af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860903:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66129af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860924:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:1.0:1788361222.860927:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361222.860932:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66129af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860949:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66129af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860962:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d66129b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860969:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d66129b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860975:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d66129b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860980:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361222.860983:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d66129b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860988:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d66129b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.860997:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a8a890c3500) 00010000:00010000:1.0:1788361222.860999:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361222.861003:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d66129b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.861009:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d66129b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.861049:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d66129a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf7 expref: 8 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.861075:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d66129bd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf7 expref: 7 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.861236:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:1.0:1788361222.861240:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361222.861244:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8e00, rc 0) 00000100:00100000:1.0:1788361222.861312:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:20945:x1875232130527360:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2714us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361222.861321:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361222.864767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361222.864872:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130527616 00000100:00100000:0.0:1788361222.864882:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130527616 00000100:00100000:0.0:1788361222.864948:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361222.864957:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:20945:x1875232130527616:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361222.864977:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361222.864996:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66129c4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eafe expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.865070:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d66129cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.865319:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d66129cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.865332:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d66129cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.865347:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d66129d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.865355:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d66129d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.865362:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d66129d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.865805:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66129d9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.865814:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66129d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.865822:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66129d9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361222.865832:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788361222.866676:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d66129cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866687:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d66129cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866693:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d66129cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866699:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361222.866704:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d66129cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866712:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d66129cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866728:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:0.0:1788361222.866731:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361222.866735:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d66129cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866753:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d66129cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866767:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d66129d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866772:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d66129d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866777:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d66129d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866782:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361222.866784:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d66129d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866790:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d66129d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866798:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a890c3c00) 00010000:00010000:0.0:1788361222.866801:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361222.866803:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d66129d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.866808:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d66129d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.867584:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66129c4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eafe expref: 10 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.867627:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66129d9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eafe expref: 9 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.867635:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361222.867638:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361222.867641:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964a00, rc 0) 00000100:00100000:0.0:1788361222.867715:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:20945:x1875232130527616:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2757us (2955us total) trans 17179869185 rc 0/0 00000100:00100000:0.0:1788361222.867723:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361222.873822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361222.873926:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130527744 00000100:00100000:3.0:1788361222.873936:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130527744 00000100:00100000:3.0:1788361222.874000:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361222.874009:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:20945:x1875232130527744:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788361222.874153:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:20945:x1875232130527744:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 145us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361222.874161:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361222.970917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361222.971011:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130527872 00000100:00100000:3.0:1788361222.971021:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130527872 00000100:00100000:3.0:1788361222.971080:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361222.971117:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:20959:x1875232130527872:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361222.971138:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361222.971161:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb05 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971220:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66129ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971235:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66129ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971248:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66129ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971260:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66129f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971267:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66129f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971274:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66129f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971515:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66129ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971523:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66129ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971531:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66129ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971537:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361222.971542:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66129ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971549:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66129ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971561:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788361222.971564:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361222.971569:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66129ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971575:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66129ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971587:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66129f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971593:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66129f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971599:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66129f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971611:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361222.971614:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66129f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971620:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66129f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971628:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361222.971631:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361222.971633:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66129f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971639:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66129f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971669:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb05 expref: 10 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971679:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788361222.971681:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361222.971684:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb05 expref: 10 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.971693:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f000, rc 0) 00000100:00100000:3.0:1788361222.971797:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:20959:x1875232130527872:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 682us (888us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361222.971804:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1788361222.978257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361222.978389:0:23222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130528000 00000100:00100000:3.0:1788361222.978412:0:23222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130528000 00000100:00100000:3.0:1788361222.978499:0:23222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361222.978509:0:23222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:20959:x1875232130528000:12345-192.168.203.60@tcp:700:lfs.0 00000100:00100000:3.0:1788361222.978604:0:23222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:20959:x1875232130528000:12345-192.168.203.60@tcp:700:lfs.0 Request processed in 97us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361222.978611:0:23222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361222.981398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361222.981604:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130528256 00000100:00100000:3.0:1788361222.981614:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130528256 00000100:00100000:3.0:1788361222.981711:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788361222.981721:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:20959:x1875232130528256:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:3.0:1788361222.981791:0:23213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361222.981819:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612962 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea8e expref: 9 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.981864:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788361222.981869:0:23213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361222.982177:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.982194:0:23213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf0 expref: 5 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.982203:0:23213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.982236:0:23213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf0 expref: 5 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361222.982262:0:23213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf0 expref: 5 pid: 23214 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361222.982277:0:23213:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84640e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23213:1875232144119552:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361222.982367:0:23213:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361222.984231:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130528384 00000100:00100000:0.0:1788361222.984238:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130528384 00000100:00100000:0.0:1788361222.984321:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:0.0:1788361222.984330:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:20343:x1875232130528384:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361222.984344:0:23206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361222.984359:0:23206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964200/0xf6a94c97d6612a03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb0c expref: -99 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.984382:0:23206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964200/0xf6a94c97d6612a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb0c expref: 12 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.984393:0:23206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964200/0xf6a94c97d6612a03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb0c expref: 12 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.984401:0:23206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964200, rc 0) 00000100:00100000:0.0:1788361222.984465:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:20343:x1875232130528384:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 137us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361222.984473:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:3.0:1788361222.985138:0:23213:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84640e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23213:1875232144119552:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361222.985162:0:23213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361222.987892:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130528512 00000100:00100000:0.0:1788361222.987901:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130528512 00010000:00010000:0.0:1788361222.987950:0:23199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf0 expref: 6 pid: 23214 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361222.987988:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361222.987998:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21603276-4ada-4ef3-bed6-677f5b3076da+6:2350:x1875232130528512:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361222.988012:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361222.988019:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf0 expref: 6 pid: 23214 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.988032:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf0 expref: 6 pid: 23214 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.988055:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d661299a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf0 expref: 6 pid: 23214 timeout: 712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.988073:0:23199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788361222.988078:0:23199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.988125:0:23199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.988133:0:23199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.988175:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361222.988226:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21603276-4ada-4ef3-bed6-677f5b3076da+5:2350:x1875232130528512:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 228us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361222.988233:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00010000:00010000:0.0:1788361222.988263:0:23213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.988271:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.988294:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.988303:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.988310:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361222.988767:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130528640 00000100:00100000:1.0:1788361222.988775:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130528640 00000100:00100000:1.0:1788361222.988818:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:1.0:1788361222.988827:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:20343:x1875232130528640:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361222.989160:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:20343:x1875232130528640:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 332us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361222.989171:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00000004:00200000:0.0:1788361222.989742:0:23213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788361222.989753:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.989760:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.989767:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.989773:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361222.989777:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.989791:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.989804:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788361222.989806:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361222.989810:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361222.989816:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d66129fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361222.989834:0:23213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb035e8c reply state 0000000042f7d42e transno 17179869186 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361222.989842:0:23213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361222.989917:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+10:20959:x1875232130528256:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 8197us (8528us total) trans 17179869186 rc 0/0 00000100:00100000:0.0:1788361222.989923:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00010000:00010000:1.0:1788361222.992570:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.992588:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.992595:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.992615:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361222.992620:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.992628:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.992644:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff9a8a890c3a00) 00010000:00010000:1.0:1788361222.992647:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361222.992651:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361222.992658:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a0a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361222.996486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361222.997150:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130528768 00000100:00100000:0.0:1788361222.997159:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130528768 00000100:00100000:0.0:1788361222.997213:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:0.0:1788361222.997225:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:20343:x1875232130528768:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361222.997568:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:20343:x1875232130528768:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 344us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361222.997576:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:1.0:1788361223.004405:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130528896 00000100:00100000:1.0:1788361223.004417:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130528896 00000100:00100000:1.0:1788361223.004550:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:1.0:1788361223.004563:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:20343:x1875232130528896:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361223.004583:0:23205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361223.004603:0:23205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8abeac8000/0xf6a94c97d6612a11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb13 expref: -99 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.004637:0:23205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8abeac8000/0xf6a94c97d6612a11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb13 expref: 13 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.004650:0:23205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8abeac8000/0xf6a94c97d6612a11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb13 expref: 13 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.004680:0:23205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8000, rc 0) 00000100:00100000:1.0:1788361223.004742:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20343:x1875232130528896:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 181us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.004750:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:1.0:1788361223.006437:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.006489:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130529024 00000100:00100000:0.0:1788361223.006498:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130529024 00000100:00100000:0.0:1788361223.006544:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:0.0:1788361223.006561:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20343:x1875232130529024:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361223.006956:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20343:x1875232130529024:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 395us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361223.006965:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000040:00080000:0.0:1788361223.008690:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788361223.009298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361223.009392:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130529152 00000100:00100000:1.0:1788361223.009401:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130529152 00000100:00100000:1.0:1788361223.009452:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:1.0:1788361223.009461:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20343:x1875232130529152:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361223.009677:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:20343:x1875232130529152:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 216us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.009686:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:3.0:1788361223.013941:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130529280 00000100:00100000:3.0:1788361223.013951:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130529280 00000100:00100000:1.0:1788361223.014122:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788361223.014133:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:20961:x1875232130529280:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:1.0:1788361223.014205:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788361223.014216:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361223.014228:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb1a expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.014290:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d6612a1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.014301:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d6612a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.014308:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d6612a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361223.014378:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788361223.014381:0:24990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361223.014408:0:24990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d6612a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.014425:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb1a expref: 11 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.014438:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d6612a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb1a expref: 10 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.014443:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:1.0:1788361223.014445:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361223.014448:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9000, rc 0) 00000100:00100000:1.0:1788361223.014495:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+10:20961:x1875232130529280:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 366us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.014499:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:0.0:1788361223.016489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361223.016832:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130529408 00000100:00100000:1.0:1788361223.016842:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130529408 00000100:00100000:1.0:1788361223.016948:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361223.016960:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+10:20961:x1875232130529408:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:1.0:1788361223.016980:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361223.016997:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6612a26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb21 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017060:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612a2d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017113:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612a2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017126:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612a2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017144:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612a34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017152:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612a34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017160:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612a34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017314:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a3b lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017323:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a3b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017330:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a3b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361223.017369:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788361223.017373:0:23215:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361223.017398:0:23215:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a3b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017411:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612a2d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017428:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612a2d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017435:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612a2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017442:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361223.017445:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612a2d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017453:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612a2d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017464:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:1.0:1788361223.017467:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361223.017472:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612a2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017478:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612a2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017491:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612a34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017498:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612a34 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017504:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612a34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017509:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361223.017519:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612a34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017526:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612a34 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017535:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff9a8a90b43d00) 00010000:00010000:1.0:1788361223.017538:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361223.017541:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612a34 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017547:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612a34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017578:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6612a26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb21 expref: 12 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017591:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a3b lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb21 expref: 11 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.017599:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:1.0:1788361223.017602:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361223.017604:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9400, rc 0) 00000100:00100000:1.0:1788361223.017669:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+11:20961:x1875232130529408:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 713us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.017678:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:3.0:1788361223.020945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361223.021030:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130529664 00000100:00100000:1.0:1788361223.021039:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130529664 00000100:00100000:1.0:1788361223.021180:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788361223.021192:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+11:20961:x1875232130529664:12345-192.168.203.60@tcp:36:chmod.0 00010000:00010000:1.0:1788361223.021252:0:23214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361223.021291:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a3b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb21 expref: 11 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.021309:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:1.0:1788361223.021320:0:23214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361223.021343:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.021356:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.021365:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361223.021630:0:23214:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a9be78b reply state 00000000cb712ebd transno 17179869187 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361223.021640:0:23214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788361223.021654:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00000100:00100000:1.0:1788361223.021732:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+12:20961:x1875232130529664:12345-192.168.203.60@tcp:36:chmod.0 Request processed in 542us (794us total) trans 17179869187 rc 0/0 00000100:00100000:1.0:1788361223.021740:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00010000:00010000:0.0:1788361223.023280:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.023295:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.023302:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.023308:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361223.023312:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.023321:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.023335:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:0.0:1788361223.023338:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788361223.023342:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.023347:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612a42 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361223.032632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.032678:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130529792 00000100:00100000:0.0:1788361223.032687:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130529792 00000100:00100000:0.0:1788361223.032739:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788361223.032750:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+11:20963:x1875232130529792:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361223.032775:0:23213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361223.032802:0:23213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb28 expref: -99 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.032880:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.032894:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.032905:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.032920:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.032927:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.032933:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033029:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612a5e lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033036:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612a5e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033055:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612a5e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361223.033327:0:23213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788361223.033332:0:23213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361223.033361:0:23213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612a5e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033374:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033381:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033388:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033395:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361223.033398:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033406:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033418:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:0.0:1788361223.033421:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361223.033426:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033433:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033456:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033463:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033479:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033484:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361223.033487:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033573:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033583:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff9a8a890c3400) 00010000:00010000:0.0:1788361223.033585:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361223.033589:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033595:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033629:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb28 expref: 13 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033643:0:23213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612a5e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb28 expref: 12 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.033671:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361223.033673:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361223.033675:0:23213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964600, rc 0) 00000100:00100000:0.0:1788361223.033733:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+12:20963:x1875232130529792:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 986us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361223.033740:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788361223.040339:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130530048 00000100:00100000:0.0:1788361223.040349:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130530048 00000100:00100000:0.0:1788361223.040416:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361223.040425:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+12:20963:x1875232130530048:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361223.040446:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361223.040465:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612a65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb2f expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361223.040579:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788361223.040705:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612a65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb2f expref: 14 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.040718:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:0.0:1788361223.040721:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361223.040726:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612a65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb2f expref: 14 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.040740:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965800, rc 0) 00000100:00100000:0.0:1788361223.040795:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:20963:x1875232130530048:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 371us (1483us total) trans 17179869188 rc 301/301 00000100:00100000:0.0:1788361223.040818:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:1.0:1788361223.042874:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130530304 00000100:00100000:1.0:1788361223.042883:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130530304 00000100:00100000:1.0:1788361223.042934:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361223.042943:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:20963:x1875232130530304:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:1.0:1788361223.043007:0:23215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361223.043030:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612a5e lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb28 expref: 13 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.043052:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:1.0:1788361223.043064:0:23215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361223.043517:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.043532:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.043543:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361223.043906:0:23215:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073e7843e reply state 00000000ead6a54c transno 17179869189 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361223.043916:0:23215:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788361223.043930:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00000100:00100000:1.0:1788361223.044050:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:20963:x1875232130530304:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 1107us (1451us total) trans 17179869189 rc 0/0 00000100:00100000:1.0:1788361223.044058:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00010000:00010000:1.0:1788361223.046076:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.046122:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.046130:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.046136:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361223.046141:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.046163:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.046181:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:1.0:1788361223.046184:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788361223.046189:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.046195:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612a73 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361223.049041:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130530560 00000100:00100000:3.0:1788361223.049052:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130530560 00000100:00100000:3.0:1788361223.049150:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361223.049162:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:20963:x1875232130530560:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361223.049426:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:20963:x1875232130530560:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 267us (593us total) trans 17179869190 rc 0/0 00000100:00100000:3.0:1788361223.049434:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361223.055706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.055807:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130530816 00000100:00100000:0.0:1788361223.055818:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130530816 00000100:00100000:0.0:1788361223.055887:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788361223.055896:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:20963:x1875232130530816:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361223.055921:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361223.055943:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612a7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb36 expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056014:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056030:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056041:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056057:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056064:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056070:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361223.056355:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788361223.056465:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056490:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056496:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056502:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361223.056506:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056513:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056525:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:0.0:1788361223.056528:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361223.056532:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056538:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612a81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056549:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056555:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056561:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056567:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361223.056577:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056584:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056593:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff9a8a890c3400) 00010000:00010000:0.0:1788361223.056596:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361223.056599:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056605:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6612a88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056645:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612a7a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb36 expref: 16 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056655:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:0.0:1788361223.056658:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361223.056662:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612a7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb36 expref: 16 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.056671:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965800, rc 0) 00000100:00100000:0.0:1788361223.056725:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:20963:x1875232130530816:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 830us (1029us total) trans 17179869191 rc 301/301 00000100:00100000:0.0:1788361223.056733:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788361223.063008:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130530944 00000100:00100000:0.0:1788361223.063024:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130530944 00000100:00100000:0.0:1788361223.063241:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:0.0:1788361223.063262:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:20963:x1875232130530944:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361223.063459:0:23213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361223.063484:0:23213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a96 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb3d expref: -99 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.063571:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612a9d lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.063586:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612a9d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.063598:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612a9d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361223.063649:0:23213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788361223.063653:0:23213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361223.063677:0:23213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612a9d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.063706:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6612a96 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb3d expref: 17 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.063724:0:23213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612a9d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb3d expref: 16 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.063989:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a890c3b00) 00010000:00010000:0.0:1788361223.063993:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361223.063997:0:23213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965a00, rc 0) 00000100:00100000:0.0:1788361223.064298:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:20963:x1875232130530944:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1046us (3268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361223.064306:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788361223.069281:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130531072 00000100:00100000:3.0:1788361223.069291:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130531072 00000100:00100000:3.0:1788361223.069344:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1788361223.069369:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:20963:x1875232130531072:12345-192.168.203.60@tcp:37:lfs.0 00000100:00100000:3.0:1788361223.087114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.087245:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130531328 00000100:00100000:0.0:1788361223.087255:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130531328 00000100:00100000:0.0:1788361223.087318:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361223.087329:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90bee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:20963:x1875232130531328:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361223.087581:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90bee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:20963:x1875232130531328:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 254us (498us total) trans 17179869192 rc 0/0 00000100:00100000:0.0:1788361223.087588:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361223.135164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361223.135446:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130531456 00000100:00100000:1.0:1788361223.135458:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130531456 00000100:00100000:1.0:1788361223.135514:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:1.0:1788361223.135524:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:20969:x1875232130531456:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:1.0:1788361223.135548:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361223.135566:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612aa4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb44 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156402:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612aab lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156422:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612aab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156433:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612aab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156447:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6612ab2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156454:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6612ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156460:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6612ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156576:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612ab9 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156585:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612ab9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156592:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612ab9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361223.156619:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788361223.156622:0:23214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361223.156656:0:23214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612ab9 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156680:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612aab lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156687:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612aab lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156695:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612aab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156701:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361223.156705:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612aab lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156713:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612aab lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.156726:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:3.0:1788361223.156729:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361223.156734:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612aab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157407:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612aab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157418:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6612ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157424:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6612ab2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157429:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6612ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157443:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361223.157446:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6612ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157452:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6612ab2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157461:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361223.157464:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361223.157466:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6612ab2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157473:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6612ab2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157523:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612aa4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb44 expref: 19 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157539:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612ab9 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb44 expref: 18 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.157546:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a890c3b00) 00010000:00010000:3.0:1788361223.157548:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788361223.157551:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e000, rc 0) 00000100:00100000:3.0:1788361223.157615:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+18:20969:x1875232130531456:12345-192.168.203.60@tcp:101:dd.500 Request processed in 22091us (22459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361223.157625:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:3.0:1788361223.161019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.161874:0:23198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130531584 00000100:00100000:0.0:1788361223.161884:0:23198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130531584 00000100:00100000:0.0:1788361223.161960:0:23198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361223.161976:0:23198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+18:2349:x1875232130531584:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361223.161997:0:23198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361223.162024:0:23198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612ab9 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb44 expref: 18 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.162040:0:23198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a890c3b00) 00010000:00010000:0.0:1788361223.162046:0:23198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361223.162128:0:23198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:2349:x1875232130531584:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 155us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361223.162136:0:23198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361223.162199:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130531840 00000100:00100000:1.0:1788361223.162205:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130531840 00000100:00100000:1.0:1788361223.162242:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:1.0:1788361223.162250:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:20969:x1875232130531840:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:1.0:1788361223.162347:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361223.162350:0:23215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361223.162364:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612a9d lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb3d expref: 17 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.162389:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a890c3b00) 00010000:00010000:1.0:1788361223.162398:0:23215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361223.162412:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612ac0 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb4b expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.162694:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612ac7 lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.162721:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612ac7 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.162732:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612ac7 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.162746:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.162753:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.162760:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.163574:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8c00/0xf6a94c97d6612ad5 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.163586:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8c00/0xf6a94c97d6612ad5 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.163595:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8c00/0xf6a94c97d6612ad5 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361223.163613:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788361223.163642:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612ac7 lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.163652:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612ac7 lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.163658:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612ac7 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.163665:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361223.163669:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612ac7 lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.163678:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612ac7 lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.163689:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:1.0:1788361223.163692:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361223.163696:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612ac7 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.163702:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612ac7 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361223.163725:0:23215:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dcd5f91a reply state 0000000067a7a81c transno 17179869193 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361223.163734:0:23215:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361223.163818:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612ac0 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb4b expref: 19 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.163839:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8c00/0xf6a94c97d6612ad5 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb4b expref: 18 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.163872:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:0.0:1788361223.163875:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788361223.163877:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8c00, rc 0) 00000100:00100000:0.0:1788361223.163950:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:20969:x1875232130531840:12345-192.168.203.60@tcp:101:dd.500 Request processed in 1699us (1986us total) trans 17179869193 rc 0/0 00000100:00100000:0.0:1788361223.163958:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00010000:00010000:0.0:1788361223.168978:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.168996:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.169004:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.169011:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361223.169016:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.169024:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.169041:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff9a8a90b43d00) 00010000:00010000:0.0:1788361223.169044:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361223.169049:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.169055:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612ace lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361223.174893:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130532096 00000100:00100000:3.0:1788361223.174906:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130532096 00000100:00100000:3.0:1788361223.174967:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361223.174979:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+18:20969:x1875232130532096:12345-192.168.203.60@tcp:35:dd.500 00000100:00100000:3.0:1788361223.175554:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:20969:x1875232130532096:12345-192.168.203.60@tcp:35:dd.500 Request processed in 575us (766us total) trans 17179869194 rc 0/0 00000100:00100000:3.0:1788361223.175563:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361223.235015:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130532352 00000100:00100000:0.0:1788361223.235026:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130532352 00000100:00100000:0.0:1788361223.235125:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:0.0:1788361223.235153:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:20979:x1875232130532352:12345-192.168.203.60@tcp:101:lfs.0 00000100:00100000:1.0:1788361223.241656:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.241756:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130532608 00000100:00100000:0.0:1788361223.241765:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130532608 00000100:00100000:0.0:1788361223.241873:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361223.241884:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+20:20979:x1875232130532608:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361223.242175:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+21:20979:x1875232130532608:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 292us (526us total) trans 17179869196 rc 0/0 00000100:00100000:0.0:1788361223.242183:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 10000000:01000000:0.0:1788361223.264149:0:23210:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361223.264156:0:23210:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8986fe2800 from 10 10000000:01000000:0.0:1788361223.264162:0:23210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361223.264217:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.264229:0:23210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.264241:0:23210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361223.264267:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144119680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361223.264345:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361223.264411:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361223.264765:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144119680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361223.264785:0:23210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.264793:0:23210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361223.264871:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144119808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361223.264897:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361223.264922:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361223.264963:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144119808 00000100:00100000:1.0:1788361223.264974:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144119808 00000100:00100000:1.0:1788361223.265007:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788361223.265015:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:23210:x1875232144119808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361223.265330:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:23210:x1875232144119808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.265337:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788361223.265346:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144119808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361223.265373:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144119936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361223.265411:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361223.265439:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361223.265830:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144119936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361223.267141:0:25241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788361223.267265:0:23210:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788361223.267286:0:23210:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361223.267296:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.267307:0:23210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361223.267319:0:23210:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361223.267322:0:23210:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a83778000 from 10 10000000:01000000:3.0:1788361223.267325:0:23210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361223.267361:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.267369:0:23210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.267379:0:23210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361223.267404:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361223.267468:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361223.267505:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361223.267549:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144120064 00000100:00100000:1.0:1788361223.267555:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144120064 00000100:00100000:1.0:1788361223.267594:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788361223.267602:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:23210:x1875232144120064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361223.267615:0:23205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361223.267627:0:23205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8abeac8400/0xf6a94c97d6612b14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6612b0d expref: -99 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.267650:0:23205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8abeac8400/0xf6a94c97d6612b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6612b0d expref: 18 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.267660:0:23205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8abeac8400/0xf6a94c97d6612b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612b0d expref: 18 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.267667:0:23205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8400, rc 0) 00000100:00100000:1.0:1788361223.267703:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:23210:x1875232144120064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.267831:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788361223.267872:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361223.267888:0:23210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.267896:0:23210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361223.267936:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361223.267954:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361223.267970:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361223.268038:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144120192 00000100:00100000:0.0:1788361223.268042:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144120192 00000100:00100000:0.0:1788361223.268069:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788361223.268076:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:23210:x1875232144120192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361223.268374:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:23210:x1875232144120192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361223.268381:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788361223.268446:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361223.268470:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361223.268498:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361223.268519:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361223.268536:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144120320 00000100:00100000:1.0:1788361223.268540:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144120320 00000100:00100000:1.0:1788361223.268570:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788361223.268576:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:23210:x1875232144120320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361223.268802:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361223.268939:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:23210:x1875232144120320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.268947:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000040:00080000:1.0:1788361223.269706:0:25242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788361223.270041:0:23210:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788361223.270062:0:23210:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361223.270072:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.270081:0:23210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361223.270161:0:23210:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361223.270174:0:23210:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a84154800 from 10 10000000:01000000:3.0:1788361223.270178:0:23210:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361223.270210:0:23210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.270218:0:23210:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.270227:0:23210:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361223.270249:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361223.270297:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361223.270335:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361223.270375:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144120448 00000100:00100000:0.0:1788361223.270382:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144120448 00000100:00100000:0.0:1788361223.270424:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788361223.270433:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:23210:x1875232144120448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361223.270445:0:23206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361223.270463:0:23206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965600/0xf6a94c97d6612b22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6612b1b expref: -99 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.270491:0:23206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965600/0xf6a94c97d6612b22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6612b1b expref: 19 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.270502:0:23206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965600/0xf6a94c97d6612b22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6612b1b expref: 19 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.270510:0:23206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965600, rc 0) 00000100:00100000:0.0:1788361223.270556:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:23210:x1875232144120448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361223.270562:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788361223.270684:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361223.270697:0:23210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.270706:0:23210:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361223.270809:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361223.270835:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361223.270865:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96000 going to sleep for 11 seconds 00000100:00100000:1.0:1788361223.270874:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144120576 00000100:00100000:1.0:1788361223.270878:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144120576 00000100:00100000:1.0:1788361223.270905:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788361223.270913:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:23210:x1875232144120576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361223.271188:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:23210:x1875232144120576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.271196:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788361223.271611:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361223.271638:0:23210:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361223.271671:0:23210:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361223.271696:0:23210:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96000 going to sleep for 11 seconds 00000100:00100000:3.0:1788361223.272120:0:23210:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:23210:1875232144120704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361223.279058:0:25243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788361223.279704:0:23210:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788361223.279736:0:23210:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361223.279747:0:23210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.279759:0:23210:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361223.311589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.311665:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130532736 00000100:00100000:0.0:1788361223.311675:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130532736 00000100:00100000:1.0:1788361223.312606:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788361223.312621:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+21:20985:x1875232130532736:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:1.0:1788361223.312652:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361223.312673:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612b29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb59 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.312808:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b30 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.312824:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.312836:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.312862:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.312884:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.312891:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313005:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612b3e lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313014:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612b3e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313021:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612b3e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361223.313046:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788361223.313049:0:23215:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361223.313069:0:23215:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612b3e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313082:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b30 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313124:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b30 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313131:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313138:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361223.313142:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b30 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313156:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b30 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313169:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:1.0:1788361223.313172:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361223.313177:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313183:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313196:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313203:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b37 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313209:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313214:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361223.313217:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313223:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b37 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313229:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x209c883c (ffff9a8a90b43d00) 00010000:00010000:1.0:1788361223.313231:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361223.313234:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313250:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x209c883c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313280:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612b29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb59 expref: 23 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313293:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612b3e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb59 expref: 22 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.313301:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:1.0:1788361223.313303:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788361223.313305:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8200, rc 0) 00000100:00100000:1.0:1788361223.313374:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+22:20985:x1875232130532736:12345-192.168.203.60@tcp:101:dd.500 Request processed in 758us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.313382:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:3.0:1788361223.316574:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130532992 00000100:00100000:3.0:1788361223.316585:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130532992 00000100:00100000:3.0:1788361223.316644:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:3.0:1788361223.316654:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+22:20985:x1875232130532992:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:3.0:1788361223.316686:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361223.316709:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612b45 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb60 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.316812:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612b4c lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.316826:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612b4c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.316839:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612b4c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361223.316866:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788361223.318405:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612b45 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb60 expref: 25 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.318452:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612b4c lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb60 expref: 24 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.318461:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:3.0:1788361223.318464:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361223.318468:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:3.0:1788361223.320466:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+24:20985:x1875232130532992:12345-192.168.203.60@tcp:101:dd.500 Request processed in 2831us (3085us total) trans 17179869197 rc 0/0 00000100:00100000:3.0:1788361223.320482:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:3.0:1788361223.323699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361223.328922:0:23851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144120832 00000100:00100000:3.0:1788361223.328932:0:23851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144120832 00000100:00100000:3.0:1788361223.328982:0:23851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361223.329000:0:23851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144120832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361223.329034:0:23851:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361223.329583:0:23851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144120832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361223.329592:0:23851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361223.401364:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130533504 00000100:00100000:0.0:1788361223.401373:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130533504 00000100:00100000:0.0:1788361223.401431:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1788361223.401439:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+25:20991:x1875232130533504:12345-192.168.203.60@tcp:36:truncate.500 00010000:00010000:0.0:1788361223.401492:0:23213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361223.401517:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612b4c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb60 expref: 25 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.401535:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:0.0:1788361223.401539:0:23213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361223.401922:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.401936:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361223.401957:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361223.402005:0:23213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869199 00000004:00010000:0.0:1788361223.402027:0:23213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ce92bf92 reply state 00000000fc0268e4 transno 17179869200 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361223.402035:0:23213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361223.402953:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+27:20991:x1875232130533504:12345-192.168.203.60@tcp:36:truncate.500 Request processed in 1510us (1732us total) trans 17179869200 rc 0/0 00000100:00100000:0.0:1788361223.402962:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000020:00080000:0.0:1788361223.402967:0:23213:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788361223.405884:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.405903:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.405911:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.405917:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361223.405921:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.405930:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.405961:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:1.0:1788361223.405964:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361223.405968:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.405974:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612b5a lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361223.470350:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130533632 00000100:00100000:1.0:1788361223.470360:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130533632 00000100:00100000:1.0:1788361223.470472:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361223.470484:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+26:20997:x1875232130533632:12345-192.168.203.60@tcp:101:truncate.500 00010000:00010000:1.0:1788361223.470508:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361223.470531:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612b61 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb67 expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470598:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b68 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470614:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b68 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470626:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b68 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470641:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b6f lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470648:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b6f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470671:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b6f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470815:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612b76 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470823:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612b76 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470830:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612b76 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361223.470943:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 256 00000004:00200000:1.0:1788361223.470948:0:24990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361223.470971:0:24990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612b76 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470983:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612b76 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470990:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b68 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.470996:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b68 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471002:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b68 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471009:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361223.471013:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b68 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471028:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b68 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471040:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:1.0:1788361223.471043:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361223.471048:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b68 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471054:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612b68 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471067:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b6f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471073:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b6f lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471079:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b6f lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471131:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361223.471135:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b6f lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471141:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b6f lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471149:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff9a8a90b43d00) 00010000:00010000:1.0:1788361223.471151:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361223.471154:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b6f lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471170:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612b6f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471203:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612b61 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb67 expref: 28 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471215:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612b76 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb67 expref: 27 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.471223:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:1.0:1788361223.471225:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361223.471228:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9600, rc 0) 00000100:00100000:1.0:1788361223.471295:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+27:20997:x1875232130533632:12345-192.168.203.60@tcp:101:truncate.500 Request processed in 813us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.471302:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1788361223.473384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361223.473453:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130533888 00000100:00100000:1.0:1788361223.473462:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130533888 00000100:00100000:1.0:1788361223.473557:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:1.0:1788361223.473567:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+27:20997:x1875232130533888:12345-192.168.203.60@tcp:36:truncate.500 00010000:00010000:1.0:1788361223.473621:0:23215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361223.473645:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612b76 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb67 expref: 27 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.473661:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:1.0:1788361223.473665:0:23215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361223.473872:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.473895:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.473904:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361223.473953:0:23215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869201 00000004:00010000:1.0:1788361223.473978:0:23215:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c23855ba reply state 000000006466f3af transno 17179869202 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361223.473986:0:23215:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361223.474073:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:20997:x1875232130533888:12345-192.168.203.60@tcp:36:truncate.500 Request processed in 508us (697us total) trans 17179869202 rc 0/0 00000100:00100000:1.0:1788361223.474080:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000020:00080000:1.0:1788361223.474116:0:23215:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361223.475507:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.475518:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.475524:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.475538:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361223.475542:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.475550:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.475564:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:3.0:1788361223.475567:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361223.475571:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.475575:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6612b7d lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361223.546993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.554318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.555818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361223.556827:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130534528 00000100:00100000:1.0:1788361223.556839:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130534528 00000100:00100000:1.0:1788361223.556923:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:1.0:1788361223.556932:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+30:2349:x1875232130534528:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361223.556947:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361223.556982:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6612b99 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb6e expref: 30 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.557001:0:23199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:1.0:1788361223.557006:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361223.557074:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:2349:x1875232130534528:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 142us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361223.557081:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361223.560324:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130534400 00000100:00100000:3.0:1788361223.560339:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130534400 00000100:00100000:3.0:1788361223.560405:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:3.0:1788361223.560415:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:21003:x1875232130534400:12345-192.168.203.60@tcp:36:dd.500 00010000:00010000:3.0:1788361223.560696:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.560714:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.560928:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361223.560989:0:23213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869204 00000004:00010000:3.0:1788361223.561042:0:23213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3a9dd6a reply state 000000007acf13e5 transno 17179869205 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361223.561052:0:23213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361223.561239:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+32:21003:x1875232130534400:12345-192.168.203.60@tcp:36:dd.500 Request processed in 823us (6926us total) trans 17179869205 rc 0/0 00000100:00100000:3.0:1788361223.561249:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000020:00080000:3.0:1788361223.561255:0:23213:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788361223.564881:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.564898:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.564906:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.564913:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361223.564919:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.564927:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.564945:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:1.0:1788361223.564948:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361223.564953:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.564959:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ba7 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361223.566064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.650704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361223.650848:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130535040 00000100:00100000:1.0:1788361223.650857:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130535040 00000100:00100000:1.0:1788361223.650955:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:1.0:1788361223.650965:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+32:21013:x1875232130535040:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361223.651001:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361223.651020:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612bae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb75 expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361223.651180:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788361223.651283:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612bae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb75 expref: 34 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.651297:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:1.0:1788361223.651300:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361223.651305:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612bae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb75 expref: 34 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361223.651316:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9600, rc 0) 00000100:00100000:1.0:1788361223.651361:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+33:21013:x1875232130535040:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 399us (666us total) trans 17179869207 rc 301/301 00000100:00100000:1.0:1788361223.651367:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:3.0:1788361223.658789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.658888:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130535296 00000100:00100000:0.0:1788361223.658898:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130535296 00000100:00100000:0.0:1788361223.658950:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361223.658958:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+33:21013:x1875232130535296:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361223.659546:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+34:21013:x1875232130535296:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 585us (762us total) trans 17179869208 rc 0/0 00000100:00100000:0.0:1788361223.659555:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361223.968630:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361223.968719:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130535424 00000100:00100000:3.0:1788361223.968739:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130535424 00000100:00100000:3.0:1788361223.968799:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:3.0:1788361223.968810:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+34:21050:x1875232130535424:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361223.968836:0:23213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361223.968869:0:23213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb7c expref: -99 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.968938:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612bc3 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.968954:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612bc3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.968966:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612bc3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361223.969024:0:23213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 512 00000004:00200000:3.0:1788361223.969029:0:23213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361223.969067:0:23213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612bc3 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.969138:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb7c expref: 36 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.969155:0:23213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612bc3 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb7c expref: 35 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.969163:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:3.0:1788361223.969166:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361223.969170:0:23213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:3.0:1788361223.969237:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+35:21050:x1875232130535424:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 429us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361223.969244:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:3.0:1788361223.980263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.986770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361223.995665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361223.995743:0:25227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130536064 00000100:00100000:3.0:1788361223.995753:0:25227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130536064 00000100:00100000:3.0:1788361223.995816:0:25227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361223.995825:0:25227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21050:x1875232130536064:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:3.0:1788361223.995850:0:25227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788361223.995872:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6612bdf lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb8a expref: 38 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.995889:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612bd1 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb83 expref: 37 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.995899:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8c00/0xf6a94c97d6612ad5 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb4b expref: 36 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361223.995925:0:25227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:3.0:1788361223.995933:0:25227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361223.995990:0:25227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+35:21050:x1875232130536064:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 166us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361223.995996:0:25227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1788361224.002911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361224.003017:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130536192 00000100:00100000:1.0:1788361224.003028:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130536192 00000100:00100000:1.0:1788361224.003109:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788361224.003119:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+35:21050:x1875232130536192:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:1.0:1788361224.003279:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.003295:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.003305:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361224.004961:0:24990:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361224.005058:0:24990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 64 off8448 00000040:00080000:1.0:1788361224.005159:0:24990:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].1, 136 off8328 00000100:00100000:1.0:1788361224.005282:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+35:21050:x1875232130536192:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 2160us (2375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361224.005293:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788361224.008412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361224.008551:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130536320 00000100:00100000:3.0:1788361224.008776:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130536320 00000100:00100000:3.0:1788361224.008954:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1788361224.008968:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+35:21050:x1875232130536320:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361224.008989:0:23213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361224.009007:0:23213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bf4 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb91 expref: -99 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.009063:0:23213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 2/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.009073:0:23213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bf4 lrc: 4/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb91 expref: 36 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.009136:0:23213:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.009150:0:23213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bf4 lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb91 expref: 36 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.009164:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:3.0:1788361224.009181:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361224.009186:0:23213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bf4 lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb91 expref: 36 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.009193:0:23213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:3.0:1788361224.009244:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+36:21050:x1875232130536320:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 280us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361224.009251:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000040:00080000:0.0:1788361224.032520:0:23247:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788361224.032529:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361224.032583:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 2 count 2 00000040:00080000:0.0:1788361224.032589:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1788361224.032696:0:23247:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23247:1875232144120960:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361224.032792:0:23247:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361224.041890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361224.042351:0:23224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130536448 00000100:00100000:3.0:1788361224.042361:0:23224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130536448 00000100:00100000:3.0:1788361224.042418:0:23224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361224.042429:0:23224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21051:x1875232130536448:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788361224.042521:0:23224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21051:x1875232130536448:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 Request processed in 94us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361224.042529:0:23224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361224.042735:0:23247:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23247:1875232144120960:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361224.048305:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361224.059331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:2.0:1788361224.059882:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c02 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.059898:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c02 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.059907:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xbe39250a (ffff9a8aa8ee1400) 00010000:00010000:2.0:1788361224.060203:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361224.060208:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c02 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.060214:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c02 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xbe39250a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.060230:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c09 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.060237:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c09 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.060242:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c09 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.060247:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361224.060250:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c09 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.060256:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c09 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.060263:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:2.0:1788361224.060266:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361224.060269:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c09 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.060285:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c09 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.060353:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+36:21051:x1875232130536704:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 858us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361224.060362:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:0.0:1788361224.067003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.067075:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130536960 00000100:00100000:2.0:1788361224.067127:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130536960 00000100:00100000:2.0:1788361224.067176:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:2.0:1788361224.067185:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+36:21051:x1875232130536960:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361224.067206:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361224.067226:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c10 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb98 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067321:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c17 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067337:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c17 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067348:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c17 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361224.067360:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788361224.067455:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c17 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067463:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c17 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067486:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c17 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067492:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361224.067496:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c17 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067505:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c17 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067516:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:2.0:1788361224.067519:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361224.067534:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c17 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067541:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c17 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067583:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c10 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb98 expref: 38 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067593:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361224.067596:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361224.067600:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c10 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb98 expref: 38 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.067609:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:2.0:1788361224.067665:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21051:x1875232130536960:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 480us (671us total) trans 17179869210 rc 301/301 00000100:00100000:2.0:1788361224.067681:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:2.0:1788361224.071542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361224.071656:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130537088 00000100:00100000:3.0:1788361224.071666:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130537088 00000100:00100000:3.0:1788361224.071733:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:3.0:1788361224.071743:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21051:x1875232130537088:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788361224.071778:0:23215:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200001b71:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788361224.071886:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21051:x1875232130537088:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 145us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361224.071894:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1788361224.081176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.081312:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130537344 00000100:00100000:2.0:1788361224.081322:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130537344 00000100:00100000:2.0:1788361224.081377:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:2.0:1788361224.081389:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21051:x1875232130537344:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361224.081409:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361224.081413:0:23214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361224.081441:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612bc3 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb7c expref: 37 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.081457:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:2.0:1788361224.081463:0:23214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361224.081475:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c25 lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eb9f expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361224.082511:0:23214:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x44:0x0], count =30 00000004:00080000:2.0:1788361224.082519:0:23214:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x44:0x0]+30 in llog 00000004:00080000:2.0:1788361224.082586:0:23214:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x62:0x0], index 0: 0 00010000:00010000:2.0:1788361224.082891:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c2c lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.082907:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c2c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.082929:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c2c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.083006:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c25 lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb9f expref: 39 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.083023:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c2c lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb9f expref: 38 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.083032:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8aa8ee1400) 00010000:00010000:2.0:1788361224.083035:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361224.083038:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9800, rc 0) 00000100:00100000:2.0:1788361224.083137:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21051:x1875232130537344:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1749us (1970us total) trans 17179869211 rc 0/0 00000100:00100000:2.0:1788361224.083145:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:0.0:1788361224.089247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361224.089336:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130537600 00000100:00100000:3.0:1788361224.089346:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130537600 00000100:00100000:3.0:1788361224.089401:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788361224.089410:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21051:x1875232130537600:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788361224.089481:0:23215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361224.089507:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612c2c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb9f expref: 38 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089537:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8aa8ee1400) 00010000:00010000:3.0:1788361224.089548:0:23215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361224.089569:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612c3a lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089583:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612c3a lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089593:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612c3a lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089607:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612c41 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x1:0x0].0xbce8376e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089615:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612c41 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xbce8376e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089622:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612c41 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xbce8376e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089693:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612c3a lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089702:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612c3a lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089709:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612c3a lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089721:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361224.089726:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612c3a lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089746:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612c3a lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089756:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:3.0:1788361224.089759:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361224.089763:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612c3a lrc: 2/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089769:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612c3a lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089779:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612c41 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x1:0x0].0xbce8376e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089785:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612c41 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xbce8376e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089792:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612c41 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xbce8376e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.089797:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361224.089801:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612c41 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xbce8376e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.090078:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612c41 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x1:0x0].0xbce8376e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.090129:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xbce8376e (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361224.090132:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361224.090136:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612c41 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xbce8376e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.090142:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612c41 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x1:0x0].0xbce8376e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361224.090272:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21051:x1875232130537600:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 861us (1033us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361224.090280:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788361224.097403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361224.097493:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130537728 00000100:00100000:1.0:1788361224.097504:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130537728 00000100:00100000:1.0:1788361224.097618:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:1.0:1788361224.097628:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21051:x1875232130537728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361224.097647:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361224.097669:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6612c48 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eba6 expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.097702:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.097715:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.097735:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.097851:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6612c48 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eba6 expref: 39 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.097870:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eba6 expref: 38 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.097885:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:1.0:1788361224.097888:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361224.097891:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9c00, rc 0) 00000100:00100000:1.0:1788361224.098395:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21051:x1875232130537728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 767us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361224.098404:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:0.0:1788361224.102776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.103118:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130537984 00000100:00100000:2.0:1788361224.103129:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130537984 00000100:00100000:2.0:1788361224.103187:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1788361224.103199:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21051:x1875232130537984:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361224.103302:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.103319:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.103331:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361224.104311:0:23213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].2, 88 off8344 00000004:00080000:2.0:1788361224.104325:0:23213:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 614119238326ns, next at 615119235891ns, rc = 0 00000004:00010000:2.0:1788361224.104428:0:23213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab1cd97c reply state 00000000ab52867d transno 17179869212 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.104439:0:23213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361224.104549:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:21051:x1875232130537984:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1351us (1778us total) trans 17179869212 rc 0/0 00000100:00100000:2.0:1788361224.104558:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00010000:00010000:3.0:1788361224.111323:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.111342:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.111349:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.111355:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361224.111360:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.111368:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.111384:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:3.0:1788361224.111387:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788361224.111406:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.111411:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612c56 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361224.111816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.111925:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130538112 00000100:00100000:2.0:1788361224.111937:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130538112 00000100:00100000:2.0:1788361224.111997:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:2.0:1788361224.112007:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+39:21051:x1875232130538112:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361224.112032:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361224.112049:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c5d lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebad expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.112150:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c5d lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebad expref: 40 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.112173:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c5d lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebad expref: 40 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.112192:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:2.0:1788361224.112195:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361224.112198:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361224.112251:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:21051:x1875232130538112:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 246us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361224.112258:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:0.0:1788361224.117578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.117683:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130538240 00000100:00100000:2.0:1788361224.117708:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130538240 00000100:00100000:2.0:1788361224.117820:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361224.117831:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2349:x1875232130538240:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788361224.118215:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2349:x1875232130538240:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 386us (645us total) trans 17179869186 rc 0/0 00000100:00100000:2.0:1788361224.118224:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00080000:0.0:1788361224.118398:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361224.124650:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.124829:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130538496 00000100:00100000:2.0:1788361224.124848:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130538496 00000100:00100000:2.0:1788361224.124903:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1788361224.124912:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90bee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:21051:x1875232130538496:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361224.125177:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90bee450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+41:21051:x1875232130538496:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 264us (534us total) trans 17179869213 rc 0/0 00000100:00100000:2.0:1788361224.125184:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361224.127305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.127927:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130538752 00000100:00100000:2.0:1788361224.127939:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130538752 00000100:00100000:2.0:1788361224.127997:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:2.0:1788361224.128006:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+41:21051:x1875232130538752:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788361224.128161:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+41:21051:x1875232130538752:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 154us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361224.128169:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:1.0:1788361224.131185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.131304:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130538880 00000100:00100000:2.0:1788361224.131314:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130538880 00000100:00100000:2.0:1788361224.131369:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:2.0:1788361224.131378:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+41:21051:x1875232130538880:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361224.131408:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361224.131443:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c64 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebb4 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.131510:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612c6b lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.131524:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612c6b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.131534:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612c6b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361224.131568:0:23214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361224.131587:0:23214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612c6b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.131614:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c64 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebb4 expref: 43 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.131630:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612c6b lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebb4 expref: 42 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.131638:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:2.0:1788361224.131641:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788361224.131645:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:2.0:1788361224.131708:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+42:21051:x1875232130538880:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 330us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361224.131715:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:3.0:1788361224.135126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361224.135230:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130539008 00000100:00100000:0.0:1788361224.135240:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130539008 00000100:00100000:0.0:1788361224.135298:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788361224.135308:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2349:x1875232130539008:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361224.135329:0:23847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361224.135348:0:23847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d6612c72 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebbb expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361224.135384:0:23847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983a08, blocks: 0x1 00010000:00010000:0.0:1788361224.135404:0:23847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=614s v=(0 0) 00010000:00010000:0.0:1788361224.135408:0:23847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361224.135417:0:23847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d6612c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebbb expref: 7 pid: 23847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.135456:0:23847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d6612c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebbb expref: 7 pid: 23847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.135470:0:23847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965e00, rc 0) 00000100:00100000:0.0:1788361224.135532:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2349:x1875232130539008:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 225us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361224.135540:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361224.142444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.142543:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130539264 00000100:00100000:2.0:1788361224.142552:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130539264 00000100:00100000:2.0:1788361224.142649:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:2.0:1788361224.142669:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+42:21051:x1875232130539264:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788361224.142781:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+42:21051:x1875232130539264:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 114us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361224.142789:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1788361224.147590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.147815:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130539392 00000100:00100000:2.0:1788361224.147826:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130539392 00000100:00100000:2.0:1788361224.147898:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361224.147909:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:21051:x1875232130539392:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361224.147928:0:23849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361224.147948:0:23849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebc2 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.147978:0:23849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d6612c72 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebbb expref: 8 pid: 23847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.147987:0:23849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361224.147992:0:23849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361224.147998:0:23849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 8 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.148039:0:23849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d6612c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebbb expref: 8 pid: 23847 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.148053:0:23849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d6612c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebbb expref: 8 pid: 23847 timeout: 714 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.148126:0:23849:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:23849:1875232144121088:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361224.148227:0:23849:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361224.151378:0:23849:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:23849:1875232144121088:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361224.151418:0:23849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 8 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.151440:0:23849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361224.151500:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+8:21051:x1875232130539392:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 3593us (3918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361224.151510:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361224.152195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361224.153187:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130539520 00000100:00100000:1.0:1788361224.153198:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130539520 00010000:00010000:1.0:1788361224.153241:0:23199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d6612c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebbb expref: 8 pid: 23847 timeout: 714 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361224.153331:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361224.153341:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7475450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+8:2350:x1875232130539520:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361224.153357:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361224.153380:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d6612c72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebbb expref: 8 pid: 23847 timeout: 714 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.153394:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d6612c72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebbb expref: 8 pid: 23847 timeout: 714 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.153418:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d6612c72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebbb expref: 8 pid: 23847 timeout: 714 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.153457:0:23199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361224.153462:0:23199:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361224.153471:0:23199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 7 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.153481:0:23199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 7 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361224.153520:0:23199:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 7 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361224.153534:0:23199:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:23199:1875232144121216:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361224.153623:0:23199:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83f119c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361224.159470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361224.159579:0:23199:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:23199:1875232144121216:192.168.203.60@tcp:105: 00010000:00010000:0.0:1788361224.159604:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361224.159673:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7475450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2350:x1875232130539520:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 6333us (7479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361224.159685:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361224.161164:0:23852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130539648 00000100:00100000:3.0:1788361224.161178:0:23852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130539648 00002000:00100000:3.0:1788361224.161228:0:23852:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x62:0x0] (0->255) req@ffff9a8a90b2d880 x1875232130539648/t0(0) o4->a3b5bfdf-7a4d-457e-bbc9-180c7e54f761@192.168.203.60@tcp:285/0 lens 744/0 e 0 to 0 dl 1788361235 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788361224.161240:0:23852:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a90b2d880 with x1875232130539648 ext(0->255) 00002000:00010000:3.0:1788361224.161246:0:23852:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a90b2d880 00000100:00100000:3.0:1788361224.161280:0:23852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361224.161288:0:23852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2349:x1875232130539648:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361224.161757:0:23852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:2349:x1875232130539648:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 468us (2295us total) trans 17179869187 rc 0/0 00000100:00100000:3.0:1788361224.161766:0:23852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:3.0:1788361224.161774:0:23852:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x62:0x0] (0->255) req@ffff9a8a90b2d880 x1875232130539648/t17179869187(0) o4->a3b5bfdf-7a4d-457e-bbc9-180c7e54f761@192.168.203.60@tcp:285/0 lens 744/448 e 0 to 0 dl 1788361235 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788361224.161782:0:23852:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a90b2d880 with x1875232130539648 ext(0->255) 00002000:00010000:3.0:1788361224.161786:0:23852:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a90b2d880 00000100:00100000:1.0:1788361224.166552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361224.166751:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130539776 00000100:00100000:3.0:1788361224.166775:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130539776 00000100:00100000:3.0:1788361224.166832:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:3.0:1788361224.166853:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+42:21051:x1875232130539776:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788361224.220302:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+42:21051:x1875232130539776:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 53440us (53748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361224.220315:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000001:00080000:1.0:1788361224.220402:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869208 is committed 00000001:00080000:1.0:1788361224.220438:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869213 is committed 00000004:00080000:1.0:1788361224.220447:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788361224.220639:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361224.220655:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144121344:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788361224.220708:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361224.221451:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144121344 00000100:00100000:0.0:1788361224.221459:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144121344 00000100:00100000:0.0:1788361224.221568:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361224.221577:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144121344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788361224.221728:0:23847:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb size from disk: 0 -> 256 00002000:00010000:0.0:1788361224.221732:0:23847:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb mtime from disk: 0 -> 1788361224 00002000:00010000:0.0:1788361224.221734:0:23847:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788361224.221737:0:23847:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb ctime from disk: 1788361224 -> 1788361224 00002000:00010000:0.0:1788361224.221739:0:23847:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788361224.221793:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144121344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 218us (1085us total) trans 17179869188 rc 0/0 00000100:00100000:0.0:1788361224.221801:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1788361224.221917:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ac0a50000/2, rc 0, transno 17179869188 00000100:00100000:1.0:1788361224.221924:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144121344:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788361224.222055:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361224.225644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361224.225746:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130539904 00000100:00100000:1.0:1788361224.225756:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130539904 00000100:00100000:1.0:1788361224.225813:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361224.225823:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:2352:x1875232130539904:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788361224.261556:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869188 is committed 00000001:00080000:0.0:1788361224.261576:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869186 is committed 00000001:00080000:0.0:1788361224.261584:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869187 is committed 00000100:00100000:1.0:1788361224.261889:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2352:x1875232130539904:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 36061us (36248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361224.261910:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361224.266571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361224.266679:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130540160 00000100:00100000:0.0:1788361224.266690:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130540160 00000100:00100000:0.0:1788361224.266789:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:0.0:1788361224.266800:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:21051:x1875232130540160:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361224.266865:0:23213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361224.266892:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612c6b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebb4 expref: 13 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.266922:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:0.0:1788361224.266927:0:23213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361224.266955:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.266969:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.266979:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361224.267890:0:23213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bc0a6715 reply state 0000000063b5382d transno 17179869214 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361224.267966:0:23213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361224.268323:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:21051:x1875232130540160:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1523us (1807us total) trans 17179869214 rc 0/0 00000100:00100000:0.0:1788361224.268331:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00010000:00010000:2.0:1788361224.272631:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.272648:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.272656:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.272675:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361224.272679:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.272685:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.272698:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:2.0:1788361224.272700:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361224.272705:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.272711:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612c80 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361224.274326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361224.274785:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130540288 00000100:00100000:0.0:1788361224.274807:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130540288 00000100:00100000:0.0:1788361224.274919:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1788361224.274931:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2349:x1875232130540288:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788361224.275234:0:23847:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb size from disk: 256 -> 256 00002000:00010000:0.0:1788361224.275238:0:23847:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb mtime from disk: 1788361224 -> 1788361224 00002000:00010000:0.0:1788361224.275241:0:23847:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb atime from disk: 0 -> 1788361223 00002000:00010000:0.0:1788361224.275243:0:23847:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb ctime from disk: 1788361224 -> 1788361224 00002000:00010000:0.0:1788361224.275246:0:23847:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x62:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788361224.275301:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2349:x1875232130540288:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 372us (982us total) trans 17179869189 rc 0/0 00000100:00100000:0.0:1788361224.275310:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1788361224.281852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.281984:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130540544 00000100:00100000:2.0:1788361224.281993:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130540544 00000100:00100000:2.0:1788361224.282136:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:2.0:1788361224.282210:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:21051:x1875232130540544:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788361224.282276:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.282294:0:24990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eba6 expref: 13 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.282304:0:24990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 4/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.282339:0:24990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eba6 expref: 13 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.282429:0:24990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eba6 expref: 13 pid: 24990 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.282445:0:24990:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24990:1875232144121472:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361224.282545:0:24990:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788361224.286489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361224.286575:0:25227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130540672 00000100:00100000:3.0:1788361224.286585:0:25227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130540672 00010000:00010000:3.0:1788361224.286622:0:25227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eba6 expref: 14 pid: 24990 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361224.286662:0:25227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361224.286670:0:25227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:2349:x1875232130540672:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361224.286686:0:25227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361224.286694:0:25227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eba6 expref: 14 pid: 24990 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.286706:0:25227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eba6 expref: 14 pid: 24990 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.286728:0:25227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:3.0:1788361224.286733:0:25227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.286743:0:25227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.286751:0:25227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.286783:0:25227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361224.286848:0:25227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:2349:x1875232130540672:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 178us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361224.286856:0:25227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00010000:00010000:2.0:1788361224.288605:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6612c4f lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eba6 expref: 13 pid: 24990 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.288627:0:24990:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24990:1875232144121472:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361224.288653:0:24990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.288663:0:24990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.288669:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.288697:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.288705:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.288711:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.288717:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361224.288733:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.288741:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.288756:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:2.0:1788361224.288759:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788361224.288764:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.288771:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c87 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.288894:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+12:21051:x1875232130540544:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 6749us (7060us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788361224.288911:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:1.0:1788361224.291308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.291455:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130540800 00000100:00100000:2.0:1788361224.291465:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130540800 00000100:00100000:2.0:1788361224.291551:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:2.0:1788361224.291561:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2350:x1875232130540800:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788361224.291602:0:23849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.291622:0:23849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 7 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.291630:0:23849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361224.291635:0:23849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361224.291655:0:23849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.291689:0:23849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 7 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.291702:0:23849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 7 pid: 23849 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.291717:0:23849:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:23849:1875232144121600:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361224.291798:0:23849:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361224.294305:0:23849:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:23849:1875232144121600:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361224.294332:0:23849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361224.295112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.295390:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130540928 00000100:00100000:2.0:1788361224.295397:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130540928 00010000:00010000:2.0:1788361224.295428:0:23200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 8 pid: 23849 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.295465:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788361224.295474:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+8:2349:x1875232130540928:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361224.295488:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361224.295510:0:23200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 8 pid: 23849 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.295542:0:23200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 8 pid: 23849 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.295565:0:23200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612c79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc2 expref: 8 pid: 23849 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.295580:0:23200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361224.295585:0:23200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361224.295590:0:23200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.295599:0:23200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.295639:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361224.295693:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2349:x1875232130540928:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 219us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361224.295701:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00010000:00010000:3.0:1788361224.295761:0:23849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.295770:0:23849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.295793:0:23849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.295800:0:23849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.295808:0:23849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.295815:0:23849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361224.295819:0:23849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.295827:0:23849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.295869:0:23849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.295877:0:23849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004e1ec07/0xf6a94c97d6612c8e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361224.295922:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2350:x1875232130540800:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 4363us (4622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361224.295930:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788361224.308477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.310479:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130541184 00000100:00100000:2.0:1788361224.310492:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130541184 00000100:00100000:2.0:1788361224.310616:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:2.0:1788361224.310627:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+12:21051:x1875232130541184:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788361224.310707:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c95 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.310725:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c95 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.310753:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c95 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.310982:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.310994:0:23215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c5d lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebad expref: 13 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.311003:0:23215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 4/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.311035:0:23215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c5d lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebad expref: 13 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.311048:0:23215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c5d lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebad expref: 13 pid: 23214 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.311061:0:23215:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23215:1875232144121728:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361224.311177:0:23215:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361224.314414:0:23215:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23215:1875232144121728:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361224.314443:0:23215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361224.314701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.314778:0:25227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130541312 00000100:00100000:2.0:1788361224.314785:0:25227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130541312 00010000:00010000:2.0:1788361224.314816:0:25227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c5d lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebad expref: 14 pid: 23214 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.314882:0:25227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361224.314890:0:25227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:2349:x1875232130541312:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361224.314913:0:25227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361224.314921:0:25227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c5d lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebad expref: 14 pid: 23214 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.314932:0:25227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c5d lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebad expref: 14 pid: 23214 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.314953:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612c5d lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebad expref: 14 pid: 23214 timeout: 714 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.314970:0:25227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:2.0:1788361224.314975:0:25227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.314984:0:25227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.314991:0:25227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.315019:0:25227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361224.315070:0:25227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:2349:x1875232130541312:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 180us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361224.315078:0:25227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00010000:00010000:3.0:1788361224.315288:0:23215:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.315296:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361224.315474:0:23215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869215 00000001:00080000:3.0:1788361224.315619:0:23215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869216 00000001:00080000:3.0:1788361224.315664:0:23215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869217 00000100:00100000:3.0:1788361224.315735:0:23215:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23215:1875232144121856:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361224.315850:0:23215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361224.315912:0:23215:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361224.317792:0:23218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144121856 00000100:00100000:2.0:1788361224.317809:0:23218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144121856 00000100:00100000:2.0:1788361224.317927:0:23218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361224.317937:0:23218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:23215:x1875232144121856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361224.318065:0:23218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:23215:x1875232144121856:12345-0@lo:1000:mdt00_002.0 Request processed in 130us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361224.318073:0:23218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361224.318304:0:23215:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869188 gen 2 00000004:00080000:3.0:1788361224.318310:0:23215:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ac0a50000, transno 17179869188 00000100:00100000:3.0:1788361224.318335:0:23215:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23215:1875232144121856:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788361224.319082:0:23215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869218 00000100:00100000:3.0:1788361224.319357:0:23215:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23215:1875232144121984:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361224.319408:0:23215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361224.320750:0:23215:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a831ec300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361224.321403:0:23218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144121984 00000100:00100000:2.0:1788361224.321413:0:23218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144121984 00000100:00100000:2.0:1788361224.321459:0:23218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361224.321468:0:23218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:23215:x1875232144121984:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361224.321727:0:23218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23215:x1875232144121984:12345-0@lo:1000:mdt00_002.0 Request processed in 259us (2318us total) trans 17179869190 rc 0/0 00000100:00100000:2.0:1788361224.321735:0:23218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361224.321877:0:23215:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:23215:1875232144121984:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788361224.321933:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.321944:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.321952:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.321960:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361224.321964:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.321973:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.321990:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a90b43900) 00010000:00010000:3.0:1788361224.321993:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361224.321997:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.322002:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612c9c lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.322036:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.322056:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.322062:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.322067:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361224.322069:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.322075:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.322116:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:3.0:1788361224.322119:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361224.322126:0:23215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bf4 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb91 expref: 16 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.322136:0:23215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bf4 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb91 expref: 16 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.322145:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bf4 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb91 expref: 16 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361224.322175:0:23215:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bf4 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb91 expref: 16 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361224.322190:0:23215:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23215:1875232144122112:192.168.203.60@tcp:105: 00000100:00100000:3.0:1788361224.322261:0:23215:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a831ec300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361224.328035:0:23215:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:23215:1875232144122112:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361224.328066:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328077:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612bed lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328468:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612ca3 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328483:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612ca3 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328493:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612ca3 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328503:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612ca3 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328522:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612ca3 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328539:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612ca3 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328545:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361224.328549:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612ca3 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328557:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612ca3 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328568:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:2.0:1788361224.328571:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361224.328575:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612ca3 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328581:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6612ca3 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328591:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c95 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328597:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c95 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328603:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c95 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328609:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361224.328618:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c95 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328624:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c95 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328633:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:2.0:1788361224.328635:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361224.328638:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c95 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.328643:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612c95 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361224.328885:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21051:x1875232130541184:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 18258us (20416us total) trans 17179869219 rc 0/0 00000100:00100000:2.0:1788361224.328904:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000020:00080000:2.0:1788361224.328970:0:23215:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788361224.329382:0:23247:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788361224.329387:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361224.329431:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 2 count 2 00000040:00080000:3.0:1788361224.329437:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1788361224.329561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361224.329668:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130541440 00000100:00100000:3.0:1788361224.329684:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130541440 00000100:00100000:3.0:1788361224.329728:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361224.329737:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21050:x1875232130541440:12345-192.168.203.60@tcp:49:lfs.0 00000100:00100000:3.0:1788361224.329853:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21050:x1875232130541440:12345-192.168.203.60@tcp:49:lfs.0 Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361224.329861:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788361224.333262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361224.333385:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130541696 00000100:00100000:3.0:1788361224.333395:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130541696 00000100:00100000:3.0:1788361224.333453:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:3.0:1788361224.333464:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21050:x1875232130541696:12345-192.168.203.60@tcp:58:lfs.0 00000040:00080000:3.0:1788361224.334027:0:23214:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].2, 136 off8464 00000100:00100000:3.0:1788361224.334446:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21050:x1875232130541696:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 980us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361224.334457:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:1.0:1788361224.337269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361224.337351:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130541952 00000100:00100000:3.0:1788361224.337362:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130541952 00000100:00100000:3.0:1788361224.337416:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361224.337426:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21050:x1875232130541952:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:3.0:1788361224.337960:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21050:x1875232130541952:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 534us (700us total) trans 17179869220 rc 0/0 00000100:00100000:3.0:1788361224.337986:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361224.340952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361224.342385:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130542208 00000100:00100000:2.0:1788361224.342399:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130542208 00000100:00100000:2.0:1788361224.342470:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361224.342480:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21051:x1875232130542208:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788361224.347934:0:23216:0:(mdd_object.c:4016:mdd_close()) Object [0x200001b71:0x4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788361224.348046:0:23216:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869221 00010000:00010000:0.0:1788361224.348153:0:23216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.348169:0:23216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.348181:0:23216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.348190:0:23216:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.348197:0:23216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.348202:0:23216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.348307:0:23216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788361224.348431:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:21051:x1875232130542208:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 5948us (7484us total) trans 17179869222 rc 0/0 00000100:00100000:0.0:1788361224.348441:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000020:00080000:0.0:1788361224.348446:0:23216:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788361224.349249:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361224.349259:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.349268:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361224.349272:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.349293:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.349439:0:23201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x4:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:2.0:1788361224.349444:0:23201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361224.349449:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361224.349457:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612caa lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23216 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.349612:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361224.349615:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361224.349617:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361224.383107:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361224.383240:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130542336 00000100:00100000:0.0:1788361224.383251:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130542336 00000100:00100000:0.0:1788361224.383390:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:0.0:1788361224.383401:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:21053:x1875232130542336:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361224.383425:0:23213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361224.383447:0:23213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612cb1 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebc9 expref: -99 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.383548:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612cb8 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.383564:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612cb8 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.383576:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612cb8 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.383590:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612cbf lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.383597:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612cbf lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.383613:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612cbf lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.383930:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612cc6 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.383940:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612cc6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.383948:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612cc6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361224.383980:0:23213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 2048 00000004:00200000:0.0:1788361224.383984:0:23213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361224.384001:0:23213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612cc6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384012:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612cc6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384020:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612cb8 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384027:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612cb8 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384034:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612cb8 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384041:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361224.384045:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612cb8 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384059:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612cb8 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384071:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:0.0:1788361224.384074:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361224.384079:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612cb8 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384109:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612cb8 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384123:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612cbf lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384129:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612cbf lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384134:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612cbf lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384139:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361224.384142:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612cbf lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384147:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612cbf lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384155:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0xfd26ebc1 (ffff9a8a890c3200) 00010000:00010000:0.0:1788361224.384157:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361224.384160:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612cbf lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384176:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6612cbf lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0xfd26ebc1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384207:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612cb1 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc9 expref: 21 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384221:0:23213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612cc6 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc9 expref: 20 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361224.384230:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:0.0:1788361224.384232:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361224.384234:0:23213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964600, rc 0) 00000100:00100000:0.0:1788361224.384300:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+20:21053:x1875232130542336:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 901us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361224.384308:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00010000:00010000:3.0:1788361224.673558:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361225.098408:0:25282:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788361225.098841:0:25282:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361225.098894:0:25282:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:0.0:1788361225.098900:0:25282:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:3.0:1788361225.376315:0:23247:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788361225.376326:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361225.376362:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:3.0:1788361225.376368:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1788361225.376500:0:23247:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23247:1875232144122240:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788361225.376679:0:23247:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565180 going to sleep for 11 seconds 00000100:00100000:2.0:1788361225.382006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361225.382199:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130542464 00000100:00100000:0.0:1788361225.382209:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130542464 00000100:00100000:0.0:1788361225.382284:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1788361225.382294:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+21:21065:x1875232130542464:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788361225.382324:0:23214:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200001b71:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788361225.382427:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+21:21065:x1875232130542464:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 133us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361225.382452:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:3.0:1788361225.382708:0:23247:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23247:1875232144122240:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1788361225.383019:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361225.389960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361225.390056:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130542720 00000100:00100000:2.0:1788361225.390065:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130542720 00000100:00100000:2.0:1788361225.390165:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:2.0:1788361225.390175:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+20:21065:x1875232130542720:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361225.390227:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361225.390248:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612ccd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebd0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361225.390344:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612cd4 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361225.390359:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612cd4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361225.390372:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612cd4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361225.390395:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2:0x0]: returning size 2048 00010000:00010000:2.0:1788361225.390526:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612ccd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebd0 expref: 23 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361225.390544:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612cd4 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebd0 expref: 22 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361225.390553:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:2.0:1788361225.390556:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361225.390560:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8400, rc 0) 00000100:00100000:2.0:1788361225.390618:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+22:21065:x1875232130542720:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 445us (667us total) trans 17179869223 rc 0/0 00000100:00100000:2.0:1788361225.390626:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:0.0:1788361225.394431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361225.394845:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130542976 00000100:00100000:3.0:1788361225.394856:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130542976 00000100:00100000:3.0:1788361225.394971:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:3.0:1788361225.394983:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+22:21065:x1875232130542976:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788361225.395076:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612ce2 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361225.395141:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612ce2 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361225.395155:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612ce2 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361225.395378:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612ce2 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361225.395387:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612ce2 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361225.395412:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612ce2 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361225.395419:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361225.395423:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612ce2 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361225.395431:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612ce2 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361225.395444:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:3.0:1788361225.395447:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361225.395451:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612ce2 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361225.395457:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612ce2 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361225.395627:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+23:21065:x1875232130542976:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 644us (1204us total) trans 17179869224 rc 0/0 00000100:00100000:3.0:1788361225.395635:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000040:00080000:0.0:1788361225.395933:0:23247:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788361225.395938:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361225.395967:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:0.0:1788361225.395972:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1788361225.396636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361225.396712:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130543104 00000100:00100000:3.0:1788361225.396719:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130543104 00000100:00100000:3.0:1788361225.396938:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1788361225.396948:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+23:2350:x1875232130543104:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361225.396964:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361225.396984:0:23200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612cd4 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebd0 expref: 23 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361225.397014:0:23200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:3.0:1788361225.397019:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361225.397068:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+22:2350:x1875232130543104:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 122us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361225.397075:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:2.0:1788361225.397676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361225.397750:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130543360 00000100:00100000:3.0:1788361225.397757:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130543360 00000100:00100000:3.0:1788361225.397795:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361225.397803:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+22:21065:x1875232130543360:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361225.398040:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+23:21065:x1875232130543360:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 237us (365us total) trans 17179869225 rc 0/0 00000100:00100000:3.0:1788361225.398047:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:2.0:1788361225.696229:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361226.721861:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361226.746891:0:25333:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788361226.746901:0:25333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361226.746946:0:25333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:3.0:1788361226.746952:0:25333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1788361226.841451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361226.841543:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130543616 00000100:00100000:2.0:1788361226.841553:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130543616 00000100:00100000:2.0:1788361226.841608:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1788361226.841616:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+23:21082:x1875232130543616:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361226.841639:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361226.841659:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6612ce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebd7 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361226.841996:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6612cf0 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361226.842020:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6612cf0 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361226.842033:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6612cf0 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361226.842048:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788361226.842767:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6612ce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebd7 expref: 26 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361226.842784:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6612cf0 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebd7 expref: 25 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361226.842793:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:2.0:1788361226.842795:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788361226.842799:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361226.842875:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+25:21082:x1875232130543616:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1259us (1433us total) trans 17179869226 rc 0/0 00000100:00100000:2.0:1788361226.842882:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1788361226.892267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361226.892303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361226.892430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361226.892462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361226.892487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361226.892698:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130544128 00000100:00100000:2.0:1788361226.892706:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130544128 00000100:00100000:2.0:1788361226.892772:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361226.892782:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21603276-4ada-4ef3-bed6-677f5b3076da+5:2352:x1875232130544128:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361226.892891:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21603276-4ada-4ef3-bed6-677f5b3076da+5:2352:x1875232130544128:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 110us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361226.892899:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361226.893018:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130543744 00000100:00100000:2.0:1788361226.893022:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130543744 00000100:00100000:2.0:1788361226.893047:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:2.0:1788361226.893053:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2352:x1875232130543744:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361226.893079:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2352:x1875232130543744:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361226.893102:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:1.0:1788361226.893169:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130544000 00000100:00100000:1.0:1788361226.893173:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130544000 00000100:00100000:1.0:1788361226.893200:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130543872 00000100:00100000:1.0:1788361226.893202:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130543872 00000100:00100000:1.0:1788361226.893213:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130544384 00000100:00100000:1.0:1788361226.893215:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130544384 00000100:00100000:1.0:1788361226.893228:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361226.893234:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2351:x1875232130544000:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361226.893259:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2351:x1875232130544000:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361226.893264:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361226.893275:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361226.893280:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2352:x1875232130543872:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361226.893298:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2352:x1875232130543872:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 18us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361226.893303:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361226.893320:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361226.893326:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21603276-4ada-4ef3-bed6-677f5b3076da+5:2352:x1875232130544384:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361226.893360:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21603276-4ada-4ef3-bed6-677f5b3076da+5:2352:x1875232130544384:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361226.893366:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361226.893612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361226.893698:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130544256 00000100:00100000:1.0:1788361226.893702:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130544256 00000100:00100000:1.0:1788361226.893722:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361226.893728:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21603276-4ada-4ef3-bed6-677f5b3076da+5:2351:x1875232130544256:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361226.893767:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21603276-4ada-4ef3-bed6-677f5b3076da+5:2351:x1875232130544256:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 39us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361226.893772:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00080000:2.0:1788361226.894434:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361226.894439:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361226.894442:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788361227.744253:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361227.937386:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144122368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361227.937453:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361227.937535:0:23850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144122368 00000100:00100000:3.0:1788361227.937543:0:23850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144122368 00000100:00100000:3.0:1788361227.937592:0:23850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361227.937600:0:23850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144122368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361227.937633:0:23850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361227.937676:0:23850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144122368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361227.937690:0:23850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361227.937736:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144122368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361227.938345:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144122624:0@lo:400:kworker.0 00000100:00100000:0.0:1788361227.938383:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361227.938409:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361227.938415:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144122752:0@lo:400:kworker.0 00000100:00100000:0.0:1788361227.938438:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361227.938477:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144122624 00000100:00100000:0.0:1788361227.938482:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144122624 00000100:00100000:0.0:1788361227.938516:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361227.938524:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144122624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361227.938560:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144122624:12345-0@lo:400:kworker.0 Request processed in 37us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361227.938565:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361227.938584:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144122752 00000100:00100000:0.0:1788361227.938588:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144122752 00000100:00100000:0.0:1788361227.938612:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361227.938619:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144122752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361227.938647:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144122752:12345-0@lo:400:kworker.0 Request processed in 29us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361227.938664:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361227.938694:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144122752:0@lo:400:kworker.0 00000100:00100000:0.0:1788361227.938704:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144122624:0@lo:400:kworker.0 00000100:00100000:3.0:1788361227.939321:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3312:1875232144122496:0@lo:400:kworker.0 00000100:00100000:3.0:1788361227.939359:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361227.939386:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144123008:0@lo:400:kworker.0 00000100:00100000:3.0:1788361227.939411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361227.939433:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361227.939438:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144122880:0@lo:400:kworker.0 00000100:00100000:3.0:1788361227.939527:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361227.939562:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144123008 00000100:00100000:3.0:1788361227.939567:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144123008 00000100:00100000:3.0:1788361227.939596:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144122880 00000100:00100000:3.0:1788361227.939599:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144122880 00000100:00100000:3.0:1788361227.939617:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361227.939623:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144123008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361227.939664:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144123008:12345-0@lo:400:kworker.0 Request processed in 39us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361227.939671:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361227.939684:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361227.939691:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144122880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361227.939717:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144122880:12345-0@lo:400:kworker.0 Request processed in 27us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361227.939723:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361227.939754:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144122880:0@lo:400:kworker.0 00000100:00100000:3.0:1788361227.939764:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144123008:0@lo:400:kworker.0 00000100:00080000:3.0:1788361227.940139:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361227.940144:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361227.940146:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361227.940279:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144122496 00000100:00100000:0.0:1788361227.940284:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144122496 00000100:00100000:0.0:1788361227.940312:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788361227.940318:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3312:x1875232144122496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361227.940363:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3312:x1875232144122496:12345-0@lo:400:kworker.0 Request processed in 45us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361227.940369:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788361227.940404:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3312:1875232144122496:0@lo:400:kworker.0 00000040:00080000:0.0:1788361228.448301:0:23247:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:0.0:1788361228.448310:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361228.448340:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 3 count 3 00000040:00080000:0.0:1788361228.448346:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1788361228.448562:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144123136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361228.448624:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361228.449054:0:23850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144123136 00000100:00100000:2.0:1788361228.449062:0:23850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144123136 00000100:00100000:2.0:1788361228.449141:0:23850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361228.449152:0:23850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144123136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361228.449187:0:23850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361228.449248:0:23850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144123136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361228.449255:0:23850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361228.449300:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144123136:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788361228.774955:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788361229.508013:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869189 is committed 00000001:00080000:0.0:1788361229.508032:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869190 is committed 00000001:00080000:1.0:1788361229.540175:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869222 is committed 00000001:00080000:1.0:1788361229.540195:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869226 is committed 00000020:00080000:1.0:1788361229.540224:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a831ec6c0 refcount 2 committed 0 result 0 batchid 12884902006 00000020:00080000:1.0:1788361229.540229:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8abeb7a500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a84ed0a80 00000020:00080000:1.0:1788361229.540232:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8abeb7a900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ab6aec800 00000020:00080000:3.0:1788361229.540267:0:23250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12884902006 committed batchid 8589934632 00000020:00080000:3.0:1788361229.540436:0:23250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8589934632 00010000:00010000:3.0:1788361229.792553:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361230.558847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361230.558943:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130544512 00000100:00100000:3.0:1788361230.558953:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130544512 00000100:00080000:2.0:1788361230.559112:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361230.559186:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:3.0:1788361230.559198:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+12:20945:x1875232130544512:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788361230.559356:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+12:20945:x1875232130544512:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 161us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361230.559364:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:1.0:1788361230.565136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361230.565324:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130544768 00000100:00100000:3.0:1788361230.565334:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130544768 00000100:00100000:3.0:1788361230.565391:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361230.565400:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+12:20945:x1875232130544768:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361230.566914:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:20945:x1875232130544768:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1505us (1775us total) trans 17179869227 rc 0/0 00000100:00100000:3.0:1788361230.566926:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361230.777466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361230.777645:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130544896 00000100:00100000:3.0:1788361230.777655:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130544896 00000100:00100000:3.0:1788361230.777726:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:3.0:1788361230.777735:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:21522:x1875232130544896:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:3.0:1788361230.777755:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361230.777788:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612cfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebde expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361230.777862:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361230.777876:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361230.777889:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361230.778153:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1788361230.778764:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788361230.778770:0:23215:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361230.778887:0:23215:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361230.778917:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612cfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebde expref: 7 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361230.779342:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebde expref: 6 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361230.779354:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:3.0:1788361230.779357:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361230.779361:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:3.0:1788361230.779441:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21603276-4ada-4ef3-bed6-677f5b3076da+6:21522:x1875232130544896:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 1704us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361230.779449:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00010000:00010000:2.0:1788361230.816927:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361231.840289:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361232.009569:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361232.009671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361232.009705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361232.009856:0:23933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130545280 00000100:00100000:0.0:1788361232.009870:0:23933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130545280 00000100:00100000:0.0:1788361232.009944:0:23933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361232.009954:0:23933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2351:x1875232130545280:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361232.010039:0:23933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2351:x1875232130545280:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 87us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361232.010047:0:23933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00080000:3.0:1788361232.010470:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361232.010620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361232.010652:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361232.010682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361232.010703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361232.010818:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130545792 00000100:00100000:3.0:1788361232.010824:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130545792 00000100:00100000:3.0:1788361232.010875:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130545408 00000100:00100000:3.0:1788361232.010878:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130545408 00000100:00100000:3.0:1788361232.010890:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130545664 00000100:00100000:3.0:1788361232.010892:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130545664 00000100:00100000:3.0:1788361232.010907:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361232.010913:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21603276-4ada-4ef3-bed6-677f5b3076da+5:2351:x1875232130545792:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361232.011123:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21603276-4ada-4ef3-bed6-677f5b3076da+5:2351:x1875232130545792:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 209us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361232.011131:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361232.011147:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361232.011154:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2351:x1875232130545408:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361232.011180:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2351:x1875232130545408:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361232.011187:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361232.011199:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788361232.011205:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21603276-4ada-4ef3-bed6-677f5b3076da+5:2351:x1875232130545664:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361232.011228:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:21603276-4ada-4ef3-bed6-677f5b3076da+5:2351:x1875232130545664:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 23us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361232.011234:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788361232.011252:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130545536 00000100:00100000:3.0:1788361232.011256:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130545536 00000100:00100000:3.0:1788361232.011278:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130545152 00000100:00100000:3.0:1788361232.011281:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130545152 00000100:00100000:2.0:1788361232.013690:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130545024 00000100:00100000:2.0:1788361232.013719:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130545024 00000100:00100000:2.0:1788361232.013883:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:2.0:1788361232.013892:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2351:x1875232130545024:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361232.013957:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2351:x1875232130545024:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (4397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361232.013964:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00080000:1.0:1788361232.014114:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361232.014159:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361232.014171:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21603276-4ada-4ef3-bed6-677f5b3076da+6:2351:x1875232130545536:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361232.014205:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21603276-4ada-4ef3-bed6-677f5b3076da+6:2351:x1875232130545536:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (4500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361232.014211:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00080000:1.0:1788361232.014262:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361232.014264:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361232.014804:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788361232.014824:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:2351:x1875232130545152:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361232.014875:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:2351:x1875232130545152:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 54us (4221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361232.014882:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00010000:00010000:3.0:1788361232.864484:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361233.056868:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361233.056891:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144123264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361233.056959:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361233.057024:0:23851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144123264 00000100:00100000:1.0:1788361233.057033:0:23851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144123264 00000100:00100000:1.0:1788361233.057131:0:23851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361233.057141:0:23851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144123264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361233.057177:0:23851:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361233.057229:0:23851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144123264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361233.057236:0:23851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788361233.057259:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361233.057293:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144123264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361233.063369:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361233.063390:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3312:1875232144123392:0@lo:400:kworker.0 00000100:00100000:2.0:1788361233.063458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361233.063508:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144123392 00000100:00100000:2.0:1788361233.063515:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144123392 00000100:00100000:2.0:1788361233.063558:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788361233.063567:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3312:x1875232144123392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361233.063616:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3312:x1875232144123392:12345-0@lo:400:kworker.0 Request processed in 49us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361233.063623:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788361233.063669:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3312:1875232144123392:0@lo:400:kworker.0 00000100:00100000:2.0:1788361233.063703:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144123520:0@lo:400:kworker.0 00000100:00100000:2.0:1788361233.063728:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361233.063755:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144123520 00000100:00100000:2.0:1788361233.063759:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144123520 00000100:00100000:2.0:1788361233.063807:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361233.063813:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144123520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361233.063852:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144123520:12345-0@lo:400:kworker.0 Request processed in 39us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361233.063858:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361233.063906:0:3312:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869190 gen 2 00000004:00080000:2.0:1788361233.063912:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869190 committed transno 17179869190 00000100:00100000:2.0:1788361233.063929:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144123520:0@lo:400:kworker.0 00000100:00080000:2.0:1788361233.063945:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361233.063976:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144123648:0@lo:400:kworker.0 00000100:00100000:2.0:1788361233.064002:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361233.064032:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144123648 00000100:00100000:2.0:1788361233.064036:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144123648 00000100:00100000:2.0:1788361233.064062:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361233.064068:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144123648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361233.064124:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144123648:12345-0@lo:400:kworker.0 Request processed in 56us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361233.064130:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361233.064160:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144123648:0@lo:400:kworker.0 00000100:00100000:3.0:1788361233.064364:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144123904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361233.064391:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361233.065209:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144123904 00000100:00100000:1.0:1788361233.065217:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144123904 00000100:00100000:2.0:1788361233.065250:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361233.065261:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144123776:0@lo:400:kworker.0 00000100:00100000:1.0:1788361233.065279:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361233.065289:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144123904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361233.065304:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361233.065343:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144123776 00000100:00100000:2.0:1788361233.065347:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144123776 00000100:00100000:1.0:1788361233.065352:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144123904:12345-0@lo:400:kworker.0 Request processed in 63us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361233.065359:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361233.065378:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788361233.065424:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361233.065457:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144123776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361233.065553:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144123776:12345-0@lo:400:kworker.0 Request processed in 167us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361233.066365:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144123904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361233.066566:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144123776:0@lo:400:kworker.0 00000100:00100000:1.0:1788361233.066628:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788361233.573572:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144124032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361233.573648:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361233.573799:0:23851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144124032 00000100:00100000:0.0:1788361233.573807:0:23851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144124032 00000100:00100000:0.0:1788361233.573853:0:23851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788361233.573862:0:23851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144124032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361233.573894:0:23851:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361233.574031:0:23851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144124032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361233.574040:0:23851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361233.575825:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144124032:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788361233.617505:0:25532:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1g: General permission test for RW-PCC ========================================================== 11:00:33 (1788361233) 00010000:00010000:2.0:1788361233.888238:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361234.608966:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361234.609041:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130546048 00000100:00100000:1.0:1788361234.609051:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130546048 00000100:00100000:1.0:1788361234.609139:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:1.0:1788361234.609150:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:21779:x1875232130546048:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361234.609169:0:23213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361234.609191:0:23213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612d0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebe5 expref: -99 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.609260:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612d13 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.609275:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612d13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.609288:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612d13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.609303:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612d1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.609310:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612d1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361234.609401:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361234.609820:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612d1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610315:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612d21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610346:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612d21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610355:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612d21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361234.610366:0:23213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788361234.610543:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612d13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610552:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612d13 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610559:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612d13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610565:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361234.610569:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612d13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610576:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612d13 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610601:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:1.0:1788361234.610605:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361234.610609:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612d13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610616:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d6612d13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610627:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612d1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610638:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612d1a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610644:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612d1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610649:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361234.610652:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612d1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610658:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612d1a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610665:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a90b43700) 00010000:00010000:1.0:1788361234.610668:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361234.610670:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612d1a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.610676:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612d1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.611039:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612d0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebe5 expref: 16 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.611056:0:23213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612d21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebe5 expref: 15 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.611062:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361234.611065:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361234.611074:0:23213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9a00, rc 0) 00000100:00100000:1.0:1788361234.611162:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:21779:x1875232130546048:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2013us (2207us total) trans 17179869228 rc 0/0 00000100:00100000:1.0:1788361234.611170:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:1.0:1788361234.615672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361234.616208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361234.616311:0:23198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130546304 00000100:00100000:0.0:1788361234.616320:0:23198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130546304 00000100:00100000:0.0:1788361234.616386:0:23198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361234.616397:0:23198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:2352:x1875232130546304:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361234.616413:0:23198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361234.616437:0:23198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612d21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebe5 expref: 15 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.616455:0:23198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361234.616469:0:23198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361234.616527:0:23198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:2352:x1875232130546304:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 131us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361234.616534:0:23198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361234.617352:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130546176 00000100:00100000:3.0:1788361234.617359:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130546176 00000100:00100000:3.0:1788361234.617508:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:3.0:1788361234.617518:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:21779:x1875232130546176:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788361234.617603:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:21779:x1875232130546176:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 87us (1942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361234.617611:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000001:00080000:3.0:1788361234.635273:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869227 is committed 00000020:00080000:3.0:1788361234.635289:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 12884902006 batchid updated 00000020:00080000:1.0:1788361234.635596:0:23250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902006 00000020:00080000:1.0:1788361234.635612:0:23250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902006 00000100:00100000:1.0:1788361234.692877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361234.692971:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130546560 00000100:00100000:3.0:1788361234.692982:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130546560 00000100:00100000:3.0:1788361234.693044:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:3.0:1788361234.693070:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+13:21788:x1875232130546560:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1788361234.693137:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361234.693140:0:23214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788361234.693170:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d6612a1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb1a expref: 13 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.693190:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:3.0:1788361234.693195:0:23214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361234.693210:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d2f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebec expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.693608:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.693623:0:23214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebde expref: 5 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.693630:0:23214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.693662:0:23214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebde expref: 5 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.693675:0:23214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebde expref: 5 pid: 23215 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361234.693689:0:23214:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23214:1875232144124160:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361234.693800:0:23214:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361234.698914:0:23214:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23214:1875232144124160:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361234.698943:0:23214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361234.699577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361234.699658:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130546688 00000100:00100000:3.0:1788361234.699666:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130546688 00010000:00010000:3.0:1788361234.699720:0:23200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebde expref: 6 pid: 23215 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361234.699828:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361234.699875:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361234.699886:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21603276-4ada-4ef3-bed6-677f5b3076da+6:2349:x1875232130546688:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361234.699901:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361234.699909:0:23200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebde expref: 6 pid: 23215 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.699920:0:23200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebde expref: 6 pid: 23215 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.699940:0:23200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebde expref: 6 pid: 23215 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.699956:0:23200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:3.0:1788361234.699961:0:23200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.699970:0:23200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.699977:0:23200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.700020:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361234.700118:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:2349:x1875232130546688:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 202us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361234.700126:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:2.0:1788361234.700188:0:23214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.700206:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.700226:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.700234:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.700241:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361234.701245:0:23214:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x44:0x0], count =30 00000004:00080000:2.0:1788361234.701252:0:23214:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x44:0x0]+30 in llog 00000004:00080000:2.0:1788361234.701294:0:23214:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x62:0x0], index 1: 0 00010000:00010000:2.0:1788361234.701538:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d44 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701550:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d44 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701560:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d44 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701592:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701598:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701604:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701615:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361234.701619:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701626:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701637:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:2.0:1788361234.701640:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361234.701644:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701649:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d36 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361234.701660:0:23214:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000003d67507 reply state 00000000ecf0779e transno 17179869229 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361234.701669:0:23214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361234.701700:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d2f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebec expref: 15 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701719:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d44 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebec expref: 14 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.701726:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8aa8ee1600) 00010000:00010000:2.0:1788361234.701728:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361234.701730:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9800, rc 0) 00000100:00100000:2.0:1788361234.701792:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:21788:x1875232130546560:12345-192.168.203.60@tcp:101:dd.0 Request processed in 8723us (8923us total) trans 17179869229 rc 0/0 00000100:00100000:2.0:1788361234.701805:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00010000:00010000:3.0:1788361234.704148:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.704167:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.704175:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.704249:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361234.704255:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.704263:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.704280:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8aa8ee1000) 00010000:00010000:3.0:1788361234.704283:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361234.704287:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.704293:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d3d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361234.704504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361234.704715:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130546816 00000100:00100000:0.0:1788361234.704725:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130546816 00000100:00100000:0.0:1788361234.705000:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:0.0:1788361234.705013:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:21788:x1875232130546816:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361234.705031:0:23849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361234.705049:0:23849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebf3 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361234.705075:0:23849:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361234.705124:0:23849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=624s v=(0 0) 00010000:00010000:0.0:1788361234.705130:0:23849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361234.705139:0:23849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 6 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.705156:0:23849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 6 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.705167:0:23849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965a00, rc 0) 00000100:00100000:0.0:1788361234.705220:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:21788:x1875232130546816:12345-192.168.203.60@tcp:101:dd.0 Request processed in 211us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361234.705228:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00080000:2.0:1788361234.705727:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361234.707701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361234.707788:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130547072 00000100:00100000:0.0:1788361234.707797:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130547072 00000100:00100000:0.0:1788361234.707858:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361234.707867:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90bee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+14:21788:x1875232130547072:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:0.0:1788361234.708342:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90bee850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:21788:x1875232130547072:12345-192.168.203.60@tcp:35:dd.0 Request processed in 474us (646us total) trans 17179869230 rc 0/0 00000100:00100000:0.0:1788361234.708349:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1788361234.718451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361234.718552:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130547200 00000100:00100000:2.0:1788361234.718563:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130547200 00000100:00100000:2.0:1788361234.718723:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:2.0:1788361234.718735:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:21789:x1875232130547200:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:2.0:1788361234.718761:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361234.718800:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ebfa expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.718864:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6612d60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.718877:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6612d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.718888:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6612d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361234.718947:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361234.718952:0:23215:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 8 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361234.718978:0:23215:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6612d60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.719001:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebfa expref: 17 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.719021:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6612d60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebfa expref: 16 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.719046:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788361234.719049:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361234.719052:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8c00, rc 0) 00000100:00100000:2.0:1788361234.719157:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21789:x1875232130547200:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 424us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361234.719163:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:1.0:1788361234.724909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361234.724997:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130547456 00000100:00100000:2.0:1788361234.725008:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130547456 00000100:00100000:2.0:1788361234.725124:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:2.0:1788361234.725133:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21789:x1875232130547456:12345-192.168.203.60@tcp:36:chmod.0 00010000:00010000:2.0:1788361234.725183:0:23213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361234.725206:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d44 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebec expref: 16 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.725225:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8aa8ee1600) 00010000:00010000:2.0:1788361234.725236:0:23213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361234.725263:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.725275:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.725295:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361234.725527:0:23213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b48e100 reply state 00000000941d16b7 transno 17179869231 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361234.725546:0:23213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361234.725906:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21789:x1875232130547456:12345-192.168.203.60@tcp:36:chmod.0 Request processed in 773us (1004us total) trans 17179869231 rc 0/0 00000100:00100000:2.0:1788361234.725914:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:1.0:1788361234.732751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:2.0:1788361234.733129:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.733142:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.733150:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.733157:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361234.733162:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.733170:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.733187:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8aa8ee1d00) 00010000:00010000:2.0:1788361234.733190:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361234.733195:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.733200:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d67 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361234.733593:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130547584 00000100:00100000:3.0:1788361234.733614:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130547584 00000100:00100000:3.0:1788361234.733712:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:3.0:1788361234.733722:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21789:x1875232130547584:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:3.0:1788361234.733745:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361234.733775:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d6e lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec01 expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.733845:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d6e lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec01 expref: 17 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.733858:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d6e lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec01 expref: 17 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.733875:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361234.733878:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361234.733881:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:3.0:1788361234.733941:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21789:x1875232130547584:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 220us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361234.733948:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:1.0:1788361234.737476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361234.737547:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130547712 00000100:00100000:2.0:1788361234.737558:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130547712 00000100:00100000:2.0:1788361234.737636:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788361234.737645:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2350:x1875232130547712:12345-192.168.203.60@tcp:2:chmod.0 00002000:00010000:2.0:1788361234.737949:0:23847:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788361234.737953:0:23847:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788361234.737956:0:23847:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361234.737958:0:23847:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb ctime from disk: 0 -> 1788361235 00002000:00010000:2.0:1788361234.737960:0:23847:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361234.738031:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2350:x1875232130547712:12345-192.168.203.60@tcp:2:chmod.0 Request processed in 387us (564us total) trans 17179869186 rc 0/0 00000100:00100000:2.0:1788361234.738039:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361234.796528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361234.796619:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130547968 00000100:00100000:3.0:1788361234.796630:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130547968 00000100:00100000:3.0:1788361234.796690:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:3.0:1788361234.796700:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21795:x1875232130547968:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:3.0:1788361234.796722:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361234.796743:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612d75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec08 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.796834:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.796864:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.796876:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.796892:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.796899:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.796906:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797063:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612d8a lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797071:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612d8a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797079:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612d8a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361234.797127:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1788361234.797152:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612d8a lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797160:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612d8a lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797167:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612d8a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797179:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361234.797184:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612d8a lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797191:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612d8a lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797205:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361234.797208:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361234.797212:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612d8a lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797218:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612d8a lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797236:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797242:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d7c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797248:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797253:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361234.797255:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797261:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797284:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361234.797286:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361234.797289:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797295:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612d7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797304:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797310:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d83 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797316:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797321:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361234.797324:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797331:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d83 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797337:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361234.797340:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361234.797342:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d83 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797347:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612d83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797389:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612d75 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec08 expref: 18 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797399:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361234.797401:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361234.797405:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612d75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec08 expref: 18 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.797413:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:3.0:1788361234.797481:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21795:x1875232130547968:12345-192.168.203.60@tcp:101:dd.500 Request processed in 782us (964us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361234.797488:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:1.0:1788361234.848276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361234.848473:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130548224 00000100:00100000:2.0:1788361234.848483:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130548224 00000100:00100000:2.0:1788361234.848542:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:2.0:1788361234.848552:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21801:x1875232130548224:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:2.0:1788361234.848572:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361234.848593:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec0f expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848733:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848748:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848758:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848784:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848803:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848810:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848931:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612da6 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848940:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612da6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848946:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612da6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361234.848956:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:2.0:1788361234.848974:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612da6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848980:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612da6 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848987:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612da6 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.848992:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361234.848996:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612da6 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849004:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612da6 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849025:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:2.0:1788361234.849028:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361234.849134:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612da6 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849142:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612da6 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849159:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849165:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849172:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849177:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361234.849180:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849186:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849193:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788361234.849195:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361234.849198:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849203:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612d98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849221:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849227:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849233:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849238:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361234.849241:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849247:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849254:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8aa8ee1d00) 00010000:00010000:2.0:1788361234.849257:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361234.849259:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849365:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612d9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849400:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec0f expref: 18 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849411:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788361234.849414:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361234.849423:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612d91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec0f expref: 18 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.849432:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:2.0:1788361234.849567:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21801:x1875232130548224:12345-192.168.203.60@tcp:101:dd.500 Request processed in 1016us (1311us total) trans 0 rc 301/301 00000100:00100000:2.0:1788361234.849575:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:1.0:1788361234.901500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361234.901834:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130548352 00000100:00100000:3.0:1788361234.901845:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130548352 00000100:00100000:3.0:1788361234.901908:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1788361234.901918:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21807:x1875232130548352:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361234.901937:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361234.901959:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec16 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902048:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612db4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902063:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612db4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902075:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612db4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902141:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dbb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902150:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902158:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902485:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902494:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902500:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361234.902530:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00000004:00200000:3.0:1788361234.902534:0:23214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361234.902555:0:23214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902566:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902574:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612db4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902580:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612db4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902596:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612db4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902601:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361234.902605:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612db4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902612:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612db4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902623:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361234.902626:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361234.902630:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612db4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902635:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612db4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902649:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dbb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902655:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dbb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902660:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902665:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361234.902667:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dbb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902683:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dbb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902691:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361234.902693:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361234.902696:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dbb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902702:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dbb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902734:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec16 expref: 19 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902747:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec16 expref: 18 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.902754:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361234.902756:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361234.902758:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:3.0:1788361234.902874:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+18:21807:x1875232130548352:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 958us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361234.902881:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:1.0:1788361234.907177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361234.907421:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130548608 00000100:00100000:3.0:1788361234.907432:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130548608 00000100:00100000:3.0:1788361234.907493:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:3.0:1788361234.907504:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+18:21807:x1875232130548608:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361234.907543:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361234.907563:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec1d expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.907666:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dd0 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.907680:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dd0 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.907693:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dd0 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361234.907702:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1788361234.907826:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec1d expref: 21 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.907840:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dd0 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec1d expref: 20 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.907848:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361234.907851:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361234.907853:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e600, rc 0) 00000100:00100000:3.0:1788361234.907911:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+20:21807:x1875232130548608:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 410us (743us total) trans 17179869232 rc 0/0 00000100:00100000:3.0:1788361234.907918:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00010000:00010000:3.0:1788361234.912708:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361234.915614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361234.915666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361234.915793:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130548736 00000100:00100000:0.0:1788361234.915803:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130548736 00000100:00100000:0.0:1788361234.915868:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361234.915878:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7477850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+20:2351:x1875232130548736:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361234.915894:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361234.915918:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6612dd0 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec1d expref: 20 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.915936:0:23199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:0.0:1788361234.915942:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361234.916001:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7477850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:2351:x1875232130548736:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 125us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361234.916009:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361234.916571:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130548992 00000100:00100000:2.0:1788361234.916576:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130548992 00000100:00100000:2.0:1788361234.916614:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:2.0:1788361234.916633:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:21807:x1875232130548992:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361234.916651:0:23213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361234.916666:0:23213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612dde lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec24 expref: -99 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.916750:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612de5 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.916774:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612de5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.916787:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612de5 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361234.916802:0:23213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:2.0:1788361234.916921:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6612dde lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec24 expref: 22 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.916936:0:23213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612de5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec24 expref: 21 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.916955:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:2.0:1788361234.916957:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361234.916960:0:23213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9c00, rc 0) 00000100:00100000:2.0:1788361234.917005:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+21:21807:x1875232130548992:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 374us (1400us total) trans 17179869233 rc 0/0 00000100:00100000:2.0:1788361234.917011:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:1.0:1788361234.925129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361234.925236:0:23933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130549120 00000100:00100000:0.0:1788361234.925246:0:23933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130549120 00000100:00100000:0.0:1788361234.925415:0:23933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361234.925426:0:23933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2349:x1875232130549120:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:0.0:1788361234.925469:0:23933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.925488:0:23933:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 7 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.925506:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361234.925510:0:23933:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361234.925515:0:23933:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.925545:0:23933:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 7 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.925557:0:23933:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 7 pid: 23849 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361234.925570:0:23933:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:23933:1875232144124288:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361234.925652:0:23933:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361234.929737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361234.930190:0:23852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130549248 00000100:00100000:2.0:1788361234.930200:0:23852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130549248 00002000:00100000:2.0:1788361234.930248:0:23852:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x62:0x0] (0->1023) req@ffff9a898514d880 x1875232130549248/t0(0) o4->a3b5bfdf-7a4d-457e-bbc9-180c7e54f761@192.168.203.60@tcp:295/0 lens 1512/0 e 0 to 0 dl 1788361245 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361234.930260:0:23852:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898514d880 with x1875232130549248 ext(0->1023) 00010000:00010000:2.0:1788361234.930271:0:23852:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 8 pid: 23849 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.930288:0:23852:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 8 pid: 23849 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361234.930296:0:23852:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a898514d880 00000100:00100000:2.0:1788361234.930370:0:23852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788361234.930382:0:23852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+8:2349:x1875232130549248:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:0.0:1788361234.930464:0:23933:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:23933:1875232144124288:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361234.930484:0:23933:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361234.930846:0:23852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+10:2349:x1875232130549248:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 465us (1125us total) trans 17179869187 rc 0/0 00000100:00100000:2.0:1788361234.930854:0:23852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:2.0:1788361234.930862:0:23852:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x62:0x0] (0->1023) req@ffff9a898514d880 x1875232130549248/t17179869187(0) o4->a3b5bfdf-7a4d-457e-bbc9-180c7e54f761@192.168.203.60@tcp:295/0 lens 1512/448 e 0 to 0 dl 1788361245 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361234.930876:0:23852:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898514d880 with x1875232130549248 ext(0->1023) 00010000:00010000:2.0:1788361234.930882:0:23852:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 10 pid: 23849 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.930894:0:23852:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 10 pid: 23849 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361234.930902:0:23852:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a898514d880 00000100:00100000:3.0:1788361234.933236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361234.933406:0:25227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130549376 00000100:00100000:0.0:1788361234.933416:0:25227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130549376 00010000:00010000:0.0:1788361234.933450:0:25227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 10 pid: 23849 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361234.933491:0:25227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1788361234.933501:0:25227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+10:2351:x1875232130549376:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361234.933523:0:25227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788361234.933542:0:25227:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1788361234.933546:0:25227:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb mtime from disk: 0 -> 1788361235 00002000:00010000:0.0:1788361234.933548:0:25227:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x62:0x0] updating lvb atime from disk: 0 -> 1788361235 00010000:00010000:0.0:1788361234.933554:0:25227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 10 pid: 23849 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.933567:0:25227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 10 pid: 23849 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.933589:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f5f6355/0xf6a94c97d6612d52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebf3 expref: 10 pid: 23849 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.933605:0:25227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361234.933610:0:25227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361234.933615:0:25227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.933625:0:25227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.933659:0:25227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361234.933718:0:25227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:2351:x1875232130549376:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 219us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361234.933726:0:25227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00010000:00010000:1.0:1788361234.933847:0:23933:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.933857:0:23933:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.933892:0:23933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.933900:0:23933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.933908:0:23933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.933915:0:23933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361234.933919:0:23933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.933928:0:23933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.933941:0:23933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361234.933948:0:23933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cce3e1d3/0xf6a94c97d6612df3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361234.933995:0:23933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+8:2349:x1875232130549120:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 8570us (8873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361234.934001:0:23933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788361234.940330:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361234.940411:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130549632 00000100:00100000:3.0:1788361234.940422:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130549632 00000100:00100000:3.0:1788361234.940478:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361234.940488:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+21:21807:x1875232130549632:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:3.0:1788361234.940548:0:23217:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200001b71:0x5:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612de5 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec24 expref: 21 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361234.940849:0:23217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869234 00000001:00080000:3.0:1788361234.940908:0:23217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869235 00000001:00080000:3.0:1788361234.941800:0:23217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869236 00010000:00010000:3.0:1788361234.941866:0:23217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.941888:0:23217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d6e lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec01 expref: 25 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.941896:0:23217:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec16 expref: 25 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.941904:0:23217:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 5/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.941937:0:23217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec16 expref: 25 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.941954:0:23217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec16 expref: 25 pid: 23214 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361234.941967:0:23217:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:23217:1875232144124416:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361234.942068:0:23217:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d6e lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec01 expref: 25 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.942078:0:23217:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d6e lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec01 expref: 25 pid: 24990 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361234.942122:0:23217:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:23217:1875232144124544:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361234.942151:0:23217:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a5659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361234.945209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361234.945234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361234.945343:0:23217:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:23217:1875232144124416:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361234.945356:0:23217:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:23217:1875232144124544:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361234.945398:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130549888 00000100:00100000:0.0:1788361234.945418:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130549888 00010000:00010000:0.0:1788361234.945454:0:23199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d6e lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec01 expref: 26 pid: 24990 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.945467:0:23217:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361234.945599:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130549760 00000100:00100000:0.0:1788361234.945603:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130549760 00010000:00010000:0.0:1788361234.945618:0:23199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec16 expref: 27 pid: 23214 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361234.945649:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361234.945658:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+27:2350:x1875232130549888:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361234.945672:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361234.945679:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d6e lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec01 expref: 27 pid: 24990 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.945689:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d6e lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec01 expref: 27 pid: 24990 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.945711:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612d6e lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec01 expref: 27 pid: 24990 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.945736:0:23199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:0.0:1788361234.945742:0:23199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.945751:0:23199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.945758:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361234.945829:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+26:2350:x1875232130549888:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 171us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361234.945837:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361234.945853:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788361234.945992:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+25:2350:x1875232130549760:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361234.946002:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361234.946007:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec16 expref: 25 pid: 23214 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.946017:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec16 expref: 25 pid: 23214 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.946030:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612dc2 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec16 expref: 25 pid: 23214 timeout: 724 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.946039:0:23199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:0.0:1788361234.946043:0:23199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.946051:0:23199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.946059:0:23199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361234.946107:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361234.946130:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+24:2350:x1875232130549760:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 270us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361234.946136:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00010000:00010000:3.0:1788361234.946197:0:23217:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.946204:0:23217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361234.946333:0:23217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869237 00000001:00080000:3.0:1788361234.946539:0:23217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869238 00000100:00100000:3.0:1788361234.947831:0:23217:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:23217:1875232144124672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788361234.947885:0:23217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361234.947955:0:23217:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361234.947997:0:23219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144124672 00000100:00100000:1.0:1788361234.948004:0:23219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144124672 00000100:00100000:1.0:1788361234.948079:0:23219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361234.948104:0:23219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:23217:x1875232144124672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788361234.948169:0:23219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:23217:x1875232144124672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361234.948176:0:23219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361234.948285:0:23217:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:23217:1875232144124672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788361234.949727:0:23217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869239 00000100:00100000:2.0:1788361234.949818:0:23217:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:23217:1875232144124800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788361234.949866:0:23217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361234.949940:0:23217:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361234.950659:0:23218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144124800 00000100:00100000:3.0:1788361234.950666:0:23218:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144124800 00000100:00100000:3.0:1788361234.950753:0:23218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361234.950771:0:23218:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:23217:x1875232144124800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788361234.951040:0:23218:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23217:x1875232144124800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 271us (1166us total) trans 17179869188 rc 0/0 00000100:00100000:3.0:1788361234.951048:0:23218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361234.951359:0:23217:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834ca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:23217:1875232144124800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788361234.951421:0:23217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869240 00010000:00010000:2.0:1788361234.951463:0:23217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.951549:0:23217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.951559:0:23217:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.951578:0:23217:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361234.951582:0:23217:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.951589:0:23217:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.951605:0:23217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:2.0:1788361234.951609:0:23217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788361234.951614:0:23217:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361234.951620:0:23217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612dfa lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361234.952350:0:23217:0:(mdd_object.c:4016:mdd_close()) Object [0x200001b71:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788361234.952636:0:23217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x18:0x0].2, 64 off8320 00000004:00080000:2.0:1788361234.952650:0:23217:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 624967563914ns, next at 625967560854ns, rc = 0 00000001:00080000:2.0:1788361234.952660:0:23217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869241 00010000:00010000:2.0:1788361234.952704:0:23217:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:2.0:1788361234.952708:0:23217:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361234.952716:0:23217:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612de5 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec24 expref: 28 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361234.952941:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+27:21807:x1875232130549632:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 12453us (12619us total) trans 17179869242 rc 0/0 00000100:00100000:2.0:1788361234.952951:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000020:00080000:2.0:1788361234.952955:0:23217:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788361234.956670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361234.956804:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130550016 00000100:00100000:3.0:1788361234.956814:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130550016 00000100:00100000:3.0:1788361234.956867:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:3.0:1788361234.956877:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+27:21807:x1875232130550016:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361234.956899:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361234.956920:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612e01 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec2b expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.956980:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612e01 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec2b expref: 28 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.956996:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612e01 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec2b expref: 28 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361234.957015:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361234.957019:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361234.957022:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:3.0:1788361234.957128:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+28:21807:x1875232130550016:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 252us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361234.957136:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:1.0:1788361234.960741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361234.960879:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130550272 00000100:00100000:0.0:1788361234.960888:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130550272 00000100:00100000:0.0:1788361234.960975:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1788361234.960985:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+28:21807:x1875232130550272:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361234.961226:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:21807:x1875232130550272:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 241us (493us total) trans 17179869243 rc 0/0 00000100:00100000:0.0:1788361234.961233:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1788361235.038062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.038822:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130550400 00000100:00100000:3.0:1788361235.038834:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130550400 00000100:00100000:3.0:1788361235.038900:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:3.0:1788361235.038912:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:21817:x1875232130550400:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788361235.039000:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e08 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039016:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039029:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039041:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e0f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039047:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039053:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039190:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039199:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039206:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361235.039249:0:23214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039262:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e08 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039278:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e08 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039286:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039293:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.039297:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e08 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039304:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e08 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039318:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.039321:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.039325:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039332:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039346:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e0f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039352:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e0f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039358:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039363:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.039371:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e0f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039377:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e0f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039392:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361235.039395:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.039398:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e0f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039403:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e0f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039417:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039423:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039429:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039435:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.039438:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039444:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039457:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.039460:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.039468:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.039474:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e16 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.039559:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:21817:x1875232130550400:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 649us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.039567:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:1.0:1788361235.111231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.111329:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130550656 00000100:00100000:3.0:1788361235.111341:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130550656 00000100:00100000:3.0:1788361235.111400:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:3.0:1788361235.111410:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:21823:x1875232130550656:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:3.0:1788361235.111431:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361235.111450:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec32 expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111526:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111541:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111552:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111566:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111573:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111598:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111726:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e32 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111735:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e32 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111741:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e32 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361235.111751:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1788361235.111791:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e32 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111798:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e32 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111804:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e32 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111810:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.111813:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e32 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111820:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e32 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111831:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.111834:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361235.111844:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e32 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111849:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e32 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111865:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111870:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111875:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111880:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.111883:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111888:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111895:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.111897:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.111900:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111905:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111912:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111917:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111928:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111933:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.111936:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111942:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111949:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361235.111951:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.111953:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111959:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111987:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec32 expref: 30 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.111995:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.111998:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361235.112001:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec32 expref: 30 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.112009:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e000, rc 0) 00000100:00100000:3.0:1788361235.112067:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:21823:x1875232130550656:12345-192.168.203.60@tcp:101:dd.500 Request processed in 659us (846us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361235.112145:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1788361235.166293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.166421:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130550912 00000100:00100000:3.0:1788361235.166432:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130550912 00000100:00100000:3.0:1788361235.166491:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788361235.166502:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:21829:x1875232130550912:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:3.0:1788361235.166523:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361235.166544:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec39 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166616:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e40 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166630:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166641:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166655:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166662:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166668:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166805:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e4e lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166829:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e4e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166837:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e4e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361235.166848:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:3.0:1788361235.166869:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e4e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166876:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e4e lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166882:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e4e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166888:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.166892:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e4e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166898:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e4e lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166909:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.166912:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361235.166916:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e4e lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166922:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e4e lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166951:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e40 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166957:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e40 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166963:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166967:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.166971:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e40 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166977:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e40 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166985:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.166987:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.166990:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.166996:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.167004:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.167010:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e47 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.167016:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.167025:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.167040:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.167047:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e47 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.167055:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361235.167057:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.167060:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e47 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.167066:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.167146:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e39 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec39 expref: 30 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.167155:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.167158:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361235.167161:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec39 expref: 30 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.167170:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e000, rc 0) 00000100:00100000:3.0:1788361235.167231:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:21829:x1875232130550912:12345-192.168.203.60@tcp:101:dd.500 Request processed in 731us (956us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361235.167239:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:1.0:1788361235.184380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.184508:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130551040 00000100:00100000:3.0:1788361235.184532:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130551040 00000100:00100000:3.0:1788361235.184590:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1788361235.184599:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21603276-4ada-4ef3-bed6-677f5b3076da+5:21830:x1875232130551040:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:3.0:1788361235.184620:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361235.184641:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec40 expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.184704:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.184718:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.184729:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361235.184797:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788361235.184801:0:24990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 8 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361235.184827:0:24990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.184850:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec40 expref: 7 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.184867:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec40 expref: 6 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.184875:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.184877:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361235.184880:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:3.0:1788361235.184944:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21603276-4ada-4ef3-bed6-677f5b3076da+6:21830:x1875232130551040:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 346us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.184951:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:1.0:1788361235.187666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.188028:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130551168 00000100:00100000:3.0:1788361235.188050:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130551168 00000100:00100000:3.0:1788361235.188130:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1788361235.188140:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21603276-4ada-4ef3-bed6-677f5b3076da+6:21830:x1875232130551168:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:3.0:1788361235.188160:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361235.188178:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec47 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188238:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188253:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188276:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188295:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612e71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188303:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188311:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188414:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612e78 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188438:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612e78 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188445:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612e78 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361235.188483:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00000004:00200000:3.0:1788361235.188488:0:23214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361235.188508:0:23214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612e78 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188519:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612e78 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188528:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188534:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188542:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188548:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.188553:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188561:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188572:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.188581:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.188585:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188592:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188605:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188611:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612e71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188616:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612e71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188621:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.188624:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612e71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188630:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612e71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188637:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361235.188640:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.188642:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612e71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188649:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612e71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188676:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec47 expref: 8 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188703:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612e78 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec47 expref: 7 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.188710:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.188712:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361235.188715:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:3.0:1788361235.188947:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:21603276-4ada-4ef3-bed6-677f5b3076da+7:21830:x1875232130551168:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 807us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.188954:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:1.0:1788361235.194548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.194613:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130551424 00000100:00100000:3.0:1788361235.194622:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130551424 00000100:00100000:3.0:1788361235.194679:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:3.0:1788361235.194688:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21603276-4ada-4ef3-bed6-677f5b3076da+7:21830:x1875232130551424:12345-192.168.203.60@tcp:36:chmod.0 00010000:00010000:3.0:1788361235.194738:0:24990:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361235.194772:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612e78 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec47 expref: 7 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.194795:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.194799:0:24990:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361235.194822:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.194834:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.194843:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361235.195021:0:24990:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006b67058b reply state 00000000d06fad9b transno 17179869244 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.195037:0:24990:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361235.195469:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21603276-4ada-4ef3-bed6-677f5b3076da+8:21830:x1875232130551424:12345-192.168.203.60@tcp:36:chmod.0 Request processed in 779us (927us total) trans 17179869244 rc 0/0 00000100:00100000:3.0:1788361235.195477:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00010000:00010000:3.0:1788361235.200472:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.200492:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.200499:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.200505:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.200509:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.200517:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.200535:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.200538:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788361235.200542:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.200548:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612e7f lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.203867:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.204165:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130551552 00000100:00100000:2.0:1788361235.204176:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130551552 00000100:00100000:2.0:1788361235.204232:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:2.0:1788361235.204241:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21603276-4ada-4ef3-bed6-677f5b3076da+7:21830:x1875232130551552:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:2.0:1788361235.204264:0:23213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361235.204366:0:23213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612e86 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec4e expref: -99 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.204429:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612e86 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec4e expref: 8 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.204443:0:23213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612e86 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec4e expref: 8 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.204460:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.204463:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361235.204466:0:23213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9c00, rc 0) 00000100:00100000:2.0:1788361235.204561:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:21603276-4ada-4ef3-bed6-677f5b3076da+8:21830:x1875232130551552:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 321us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.204568:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:1.0:1788361235.252298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.252370:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130551808 00000100:00100000:2.0:1788361235.252380:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130551808 00000100:00100000:2.0:1788361235.252449:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:2.0:1788361235.252459:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+29:21836:x1875232130551808:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:2.0:1788361235.252478:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361235.252497:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612e8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec55 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252594:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612e94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252608:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612e94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252619:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612e94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252632:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612e9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252639:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252646:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252780:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612ea2 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252790:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612ea2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252797:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612ea2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361235.252807:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:2.0:1788361235.252898:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612e94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252916:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612e94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252922:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612e94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252928:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361235.252933:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612e94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252941:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612e94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252952:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788361235.252955:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361235.252960:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612e94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252966:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252978:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612e9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252985:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612e9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252992:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612e9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.252997:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361235.253007:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612e9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.253013:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612e9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.253020:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8aa8ee1d00) 00010000:00010000:2.0:1788361235.253023:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361235.253026:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612e9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.253031:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612e9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.253068:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612e8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec55 expref: 32 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.253081:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612ea2 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec55 expref: 31 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.253138:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.253141:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361235.253143:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:2.0:1788361235.253284:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+31:21836:x1875232130551808:12345-192.168.203.60@tcp:101:dd.500 Request processed in 825us (993us total) trans 17179869245 rc 0/0 00000100:00100000:2.0:1788361235.253291:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:1.0:1788361235.256961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.257633:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130552064 00000100:00100000:2.0:1788361235.257644:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130552064 00000100:00100000:2.0:1788361235.257747:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:2.0:1788361235.257759:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+31:21836:x1875232130552064:12345-192.168.203.60@tcp:36:dd.500 00010000:00010000:2.0:1788361235.257843:0:23213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361235.257870:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612ea2 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec55 expref: 31 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.257889:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.257894:0:23213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361235.258143:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.258158:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.258169:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361235.258477:0:23213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869246 00000004:00010000:2.0:1788361235.258503:0:23213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c3d333a reply state 00000000128836fa transno 17179869247 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361235.258512:0:23213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361235.258653:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+33:21836:x1875232130552064:12345-192.168.203.60@tcp:36:dd.500 Request processed in 896us (1701us total) trans 17179869247 rc 0/0 00000100:00100000:2.0:1788361235.258661:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000020:00080000:2.0:1788361235.258666:0:23213:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788361235.261251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:2.0:1788361235.261285:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.261297:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.261304:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.261332:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361235.261336:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.261343:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.261359:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.261363:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361235.261368:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.261374:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612eb0 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.261863:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130552320 00000100:00100000:3.0:1788361235.261873:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130552320 00000100:00100000:3.0:1788361235.261972:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788361235.261982:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+32:21836:x1875232130552320:12345-192.168.203.60@tcp:35:dd.500 00000100:00100000:3.0:1788361235.262359:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+33:21836:x1875232130552320:12345-192.168.203.60@tcp:35:dd.500 Request processed in 377us (1114us total) trans 17179869248 rc 0/0 00000100:00100000:3.0:1788361235.262366:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1788361235.305889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.305985:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130552448 00000100:00100000:3.0:1788361235.305995:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130552448 00000100:00100000:3.0:1788361235.306058:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:3.0:1788361235.306068:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+33:21842:x1875232130552448:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361235.306131:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361235.306153:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec5c expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306243:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612ebe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306258:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306271:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306285:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ec5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306293:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306308:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306411:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306419:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306426:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361235.306453:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00000004:00200000:3.0:1788361235.306457:0:24990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361235.306475:0:24990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306487:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306495:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612ebe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306500:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612ebe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306507:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612ebe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306512:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.306516:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612ebe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306529:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612ebe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306540:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.306543:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.306547:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612ebe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306553:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612ebe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306565:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306571:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306578:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306584:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.306586:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306592:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306599:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361235.306601:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.306604:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ec5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306620:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ec5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306647:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec5c expref: 35 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306661:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec5c expref: 34 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.306668:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.306670:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361235.306672:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:3.0:1788361235.306733:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+34:21842:x1875232130552448:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 665us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.306740:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:1.0:1788361235.310255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.310385:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130552704 00000100:00100000:3.0:1788361235.310395:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130552704 00000100:00100000:3.0:1788361235.310456:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:3.0:1788361235.310465:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+34:21842:x1875232130552704:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361235.310488:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361235.310508:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612ed3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec63 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.310600:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.310613:0:23214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec5c expref: 35 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.310631:0:23214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 4/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.310660:0:23214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec5c expref: 35 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.310673:0:23214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec5c expref: 35 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.310685:0:23214:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23214:1875232144124928:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361235.310787:0:23214:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361235.312493:0:23214:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23214:1875232144124928:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361235.312516:0:23214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.314693:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.314958:0:23198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130552832 00000100:00100000:3.0:1788361235.314967:0:23198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130552832 00010000:00010000:3.0:1788361235.315004:0:23198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec5c expref: 36 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.315158:0:23198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361235.315168:0:23198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+36:2349:x1875232130552832:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361235.315187:0:23198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361235.315194:0:23198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec5c expref: 36 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.315226:0:23198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec5c expref: 36 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.315248:0:23198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ecc lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec5c expref: 36 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.315264:0:23198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.315269:0:23198:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.315278:0:23198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.315337:0:23198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 4/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.315443:0:23198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361235.315498:0:23198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+35:2349:x1875232130552832:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 331us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.315506:0:23198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00010000:00010000:0.0:1788361235.318206:0:23214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.318220:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361235.318241:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00010000:00010000:0.0:1788361235.318516:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6612ed3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec63 expref: 36 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.318539:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec63 expref: 35 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.318547:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361235.318550:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361235.318553:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:0.0:1788361235.318668:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+35:21842:x1875232130552704:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 8202us (8420us total) trans 17179869249 rc 0/0 00000100:00100000:0.0:1788361235.318676:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788361235.321617:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361235.321684:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130553088 00000100:00100000:0.0:1788361235.321694:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130553088 00000100:00100000:0.0:1788361235.321770:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:0.0:1788361235.321778:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+35:21842:x1875232130553088:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:0.0:1788361235.321989:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+36:21842:x1875232130553088:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 211us (378us total) trans 17179869250 rc 0/0 00000100:00100000:0.0:1788361235.321996:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788361235.340385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.340488:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130553216 00000100:00100000:3.0:1788361235.340500:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130553216 00000100:00100000:3.0:1788361235.340559:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:3.0:1788361235.340569:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+36:21843:x1875232130553216:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:3.0:1788361235.340593:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361235.340614:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec6a expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340700:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340714:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340726:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340741:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ef6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340749:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340755:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340871:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340881:0:24990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec63 expref: 37 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340889:0:24990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 4/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340922:0:24990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec63 expref: 37 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.340945:0:24990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec63 expref: 37 pid: 23214 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.340959:0:24990:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24990:1875232144125056:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361235.341044:0:24990:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361235.344331:0:24990:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24990:1875232144125056:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361235.344359:0:24990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.348113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361235.348154:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130553344 00000100:00100000:0.0:1788361235.348164:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130553344 00010000:00010000:0.0:1788361235.348203:0:23199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec63 expref: 38 pid: 23214 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.348253:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788361235.348262:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:2350:x1875232130553344:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361235.348280:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361235.348288:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec63 expref: 38 pid: 23214 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.348301:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec63 expref: 38 pid: 23214 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.348324:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6612eda lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec63 expref: 38 pid: 23214 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.348340:0:23199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361235.348345:0:23199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.348355:0:23199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.348374:0:23199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 4/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.348410:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361235.348472:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:2350:x1875232130553344:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 210us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361235.348481:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00010000:00010000:3.0:1788361235.351686:0:24990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351704:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361235.351756:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00000004:00200000:3.0:1788361235.351770:0:24990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361235.351841:0:24990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351857:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351867:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351873:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351890:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351897:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.351901:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351909:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351925:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.351929:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.351933:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351939:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612eef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351952:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351958:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351962:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351966:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.351969:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351984:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.351992:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361235.351994:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.351997:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ef6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.352002:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612ef6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.352056:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612ee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec6a expref: 37 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.352072:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec6a expref: 36 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.352078:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.352081:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361235.352113:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:3.0:1788361235.352174:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+36:21843:x1875232130553216:12345-192.168.203.60@tcp:101:chown.0 Request processed in 11606us (11798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.352257:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1788361235.361429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.361486:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130553472 00000100:00100000:2.0:1788361235.361496:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130553472 00000100:00100000:2.0:1788361235.361553:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:2.0:1788361235.361563:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+36:21843:x1875232130553472:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361235.361585:0:23213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361235.361604:0:23213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f04 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec71 expref: -99 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.361639:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.361654:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.361665:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.361990:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f04 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec71 expref: 38 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.362009:0:23213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec71 expref: 37 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.362017:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.362020:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361235.362023:0:23213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:2.0:1788361235.362126:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21843:x1875232130553472:12345-192.168.203.60@tcp:101:chown.0 Request processed in 564us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.362134:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:1.0:1788361235.365427:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.365554:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130553728 00000100:00100000:2.0:1788361235.365564:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130553728 00000100:00100000:2.0:1788361235.365614:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:2.0:1788361235.365623:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21843:x1875232130553728:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:2.0:1788361235.365674:0:23215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361235.365706:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6612efd lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec6a expref: 37 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.365726:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.365731:0:23215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361235.365759:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.365782:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.365807:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361235.366019:0:23215:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e473698f reply state 00000000ba7bbb47 transno 17179869251 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361235.366029:0:23215:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361235.366158:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21843:x1875232130553728:12345-192.168.203.60@tcp:36:chown.0 Request processed in 536us (738us total) trans 17179869251 rc 0/0 00000100:00100000:2.0:1788361235.366165:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00010000:00010000:3.0:1788361235.370267:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.370294:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.370320:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.370327:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.370332:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.370339:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.370355:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.370358:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788361235.370362:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.370369:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6612f12 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.434669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361235.435113:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130553856 00000100:00100000:0.0:1788361235.435124:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130553856 00000100:00100000:0.0:1788361235.435184:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:0.0:1788361235.435194:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+37:21849:x1875232130553856:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:0.0:1788361235.435218:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361235.435248:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612f19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec78 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435314:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435330:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435342:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435355:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612f27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435363:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612f27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435379:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612f27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435475:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435482:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435489:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361235.435515:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00000004:00200000:0.0:1788361235.435518:0:23214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361235.435536:0:23214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435546:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435554:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435559:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435565:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435571:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361235.435574:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435587:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435600:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:0.0:1788361235.435602:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361235.435607:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435613:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435626:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612f27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435632:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612f27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435638:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612f27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435643:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361235.435646:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612f27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435651:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612f27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435658:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8a890c3500) 00010000:00010000:0.0:1788361235.435660:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361235.435662:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612f27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435676:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6612f27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435713:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d6612f19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec78 expref: 39 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435725:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec78 expref: 38 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.435732:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361235.435734:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361235.435736:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965c00, rc 0) 00000100:00100000:0.0:1788361235.435805:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21849:x1875232130553856:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 611us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361235.435818:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:1.0:1788361235.440268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.440357:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130554112 00000100:00100000:3.0:1788361235.440367:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130554112 00000100:00100000:3.0:1788361235.440425:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:3.0:1788361235.440435:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21849:x1875232130554112:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361235.440455:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361235.440475:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612f35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec7f expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.440573:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.440588:0:24990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec78 expref: 39 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.440609:0:24990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 4/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.440644:0:24990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec78 expref: 39 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.440657:0:24990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec78 expref: 39 pid: 23214 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.440671:0:24990:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24990:1875232144125184:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361235.440785:0:24990:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361235.445419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.445525:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130554240 00000100:00100000:2.0:1788361235.445534:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130554240 00010000:00010000:2.0:1788361235.445571:0:23200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec78 expref: 40 pid: 23214 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361235.445613:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1788361235.445621:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:2350:x1875232130554240:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361235.445636:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361235.445642:0:23200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec78 expref: 40 pid: 23214 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.445654:0:23200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec78 expref: 40 pid: 23214 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.445675:0:23200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.445680:0:23200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 3/0,1 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.445708:0:23200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.445716:0:23200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 4/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.445734:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361235.445804:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:2350:x1875232130554240:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 183us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.445812:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00010000:00010000:3.0:1788361235.446584:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6612f2e lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec78 expref: 39 pid: 23214 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.446602:0:24990:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24990:1875232144125184:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361235.446621:0:24990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.446630:0:24990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.446636:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 3/0,1 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361235.446654:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00010000:00010000:3.0:1788361235.446808:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612f35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec7f expref: 40 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.446840:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec7f expref: 39 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.446847:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.446850:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788361235.446852:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f200, rc 0) 00000100:00100000:3.0:1788361235.446936:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+39:21849:x1875232130554112:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 6503us (6678us total) trans 17179869252 rc 0/0 00000100:00100000:3.0:1788361235.446944:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361235.449913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361235.450001:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130554496 00000100:00100000:0.0:1788361235.450010:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130554496 00000100:00100000:0.0:1788361235.450070:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361235.450080:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7475c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+39:21849:x1875232130554496:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:0.0:1788361235.450139:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361235.450163:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6612e01 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec2b expref: 39 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.450193:0:23199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361235.450198:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361235.450258:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7475c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21849:x1875232130554496:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 178us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361235.450286:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361235.459860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.459956:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130554624 00000100:00100000:2.0:1788361235.459965:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130554624 00000100:00100000:2.0:1788361235.460025:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:2.0:1788361235.460035:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21849:x1875232130554624:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:2.0:1788361235.460175:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.460923:0:23213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612e86 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec4e expref: 7 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.460933:0:23213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 4/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.460968:0:23213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612e86 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec4e expref: 7 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.460982:0:23213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612e86 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec4e expref: 7 pid: 23213 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361235.461014:0:23213:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23213:1875232144125312:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361235.461373:0:23213:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361235.463690:0:23213:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23213:1875232144125312:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361235.463716:0:23213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.466356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.466484:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130554752 00000100:00100000:2.0:1788361235.466494:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130554752 00010000:00010000:2.0:1788361235.466533:0:23200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612e86 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec4e expref: 8 pid: 23213 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361235.466604:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788361235.466614:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21603276-4ada-4ef3-bed6-677f5b3076da+8:2349:x1875232130554752:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361235.466629:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361235.466637:0:23200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612e86 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec4e expref: 8 pid: 23213 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.466650:0:23200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612e86 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec4e expref: 8 pid: 23213 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.466673:0:23200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612e86 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec4e expref: 8 pid: 23213 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.466700:0:23200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.466706:0:23200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.466730:0:23200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.466738:0:23200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.466780:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361235.466841:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:21603276-4ada-4ef3-bed6-677f5b3076da+7:2349:x1875232130554752:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 228us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.466849:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00010000:00010000:3.0:1788361235.469305:0:23213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.469322:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361235.470566:0:23213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].3, 136 off8600 00000100:00100000:3.0:1788361235.470719:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21849:x1875232130554624:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 10681us (10864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.470730:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:1.0:1788361235.478951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.479048:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130554880 00000100:00100000:2.0:1788361235.479058:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130554880 00000100:00100000:2.0:1788361235.479218:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:2.0:1788361235.479228:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+38:21849:x1875232130554880:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361235.479248:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361235.479266:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612f51 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec86 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.479318:0:23215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 2/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.479329:0:23215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612f51 lrc: 4/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec86 expref: 39 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.479345:0:23215:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.479358:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612f51 lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec86 expref: 39 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.479383:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.479386:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361235.479391:0:23215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612f51 lrc: 3/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec86 expref: 39 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.479399:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9c00, rc 0) 00000100:00100000:2.0:1788361235.479461:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+39:21849:x1875232130554880:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 234us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.479467:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000040:00080000:2.0:1788361235.617177:0:23247:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1788361235.617186:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361235.617222:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 4 count 4 00000040:00080000:2.0:1788361235.617232:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1788361235.617355:0:23247:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23247:1875232144125440:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788361235.617448:0:23247:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361235.625566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.625961:0:23247:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23247:1875232144125440:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361235.626230:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130555008 00000100:00100000:0.0:1788361235.626242:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130555008 00000100:00100000:0.0:1788361235.626295:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:0.0:1788361235.626304:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+39:21850:x1875232130555008:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788361235.626333:0:23214:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200001b71:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788361235.626423:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+39:21850:x1875232130555008:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 120us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361235.626431:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:1.0:1788361235.629773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.629911:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130555136 00000100:00100000:2.0:1788361235.629920:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130555136 00000100:00100000:2.0:1788361235.629970:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:2.0:1788361235.629980:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+39:21850:x1875232130555136:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788361235.630062:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612f58 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630081:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612f58 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630136:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612f58 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630191:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f5f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630199:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630207:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630230:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630238:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630249:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361235.630288:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00000004:00200000:2.0:1788361235.630292:0:23215:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361235.630304:0:23215:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630315:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612f58 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630321:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612f58 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630338:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612f58 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630344:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361235.630348:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612f58 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630356:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612f58 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630367:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361235.630370:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361235.630375:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612f58 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630382:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612f58 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630395:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630402:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f5f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630408:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f5f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630413:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361235.630416:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f5f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630433:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f5f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630442:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x2d0f3245 (ffff9a8aa8ee1d00) 00010000:00010000:2.0:1788361235.630444:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361235.630448:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f5f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630454:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f5f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x2d0f3245 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630467:0:23215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630471:0:23215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630477:0:23215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630482:0:23215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361235.630484:0:23215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630489:0:23215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630495:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.630498:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361235.630501:0:23215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.630516:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f66 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361235.630594:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+39:21850:x1875232130555136:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 614us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.630602:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:1.0:1788361235.635581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361235.637194:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130555392 00000100:00100000:0.0:1788361235.637209:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130555392 00000100:00100000:0.0:1788361235.637372:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:0.0:1788361235.637384:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+39:21850:x1875232130555392:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361235.637405:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361235.637426:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612f6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec8d expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637521:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f74 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637550:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f74 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637563:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f74 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361235.637574:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 0 00010000:00010000:0.0:1788361235.637681:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f74 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637689:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f74 lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637695:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f74 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637701:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361235.637705:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f74 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637713:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f74 lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637725:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361235.637728:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788361235.637732:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f74 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637738:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612f74 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637788:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612f6d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec8d expref: 41 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637798:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361235.637801:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361235.637805:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6612f6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec8d expref: 41 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.637825:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964400, rc 0) 00000100:00100000:0.0:1788361235.637890:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:21850:x1875232130555392:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 508us (2317us total) trans 17179869253 rc 301/301 00000100:00100000:0.0:1788361235.637898:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:1.0:1788361235.641300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.641460:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130555520 00000100:00100000:2.0:1788361235.641474:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130555520 00000100:00100000:2.0:1788361235.641533:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:2.0:1788361235.641651:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:21850:x1875232130555520:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361235.641688:0:23215:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200001b71:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361235.641791:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:21850:x1875232130555520:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 143us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.643633:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:1.0:1788361235.645947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.646066:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130555776 00000100:00100000:3.0:1788361235.646076:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130555776 00000100:00100000:3.0:1788361235.646298:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:3.0:1788361235.646309:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:21850:x1875232130555776:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361235.646329:0:23213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361235.646333:0:23213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788361235.646371:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6612d60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebfa expref: 40 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.646405:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.646411:0:23213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361235.646426:0:23213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612f82 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec94 expref: -99 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361235.647043:0:23213:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x63:0x0], index 0: 0 00010000:00010000:3.0:1788361235.647466:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612f89 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.647481:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612f89 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.647493:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612f89 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.648434:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612f82 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec94 expref: 42 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.648456:0:23213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612f89 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec94 expref: 41 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.648837:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361235.648840:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361235.648844:0:23213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e000, rc 0) 00000100:00100000:3.0:1788361235.648963:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+41:21850:x1875232130555776:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2655us (3031us total) trans 17179869254 rc 0/0 00000100:00100000:3.0:1788361235.648971:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:1.0:1788361235.657047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.657773:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130555904 00000100:00100000:2.0:1788361235.657785:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130555904 00000100:00100000:2.0:1788361235.657896:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:2.0:1788361235.657908:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+41:21850:x1875232130555904:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361235.657933:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361235.657954:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ec9b expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.658038:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.658054:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.658082:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361235.658185:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361235.658190:0:24990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 8 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361235.658220:0:24990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.658245:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6612f97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec9b expref: 43 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.658264:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec9b expref: 42 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.658273:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:2.0:1788361235.658276:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361235.658279:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9400, rc 0) 00000100:00100000:2.0:1788361235.658352:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+42:21850:x1875232130555904:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 447us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.658359:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:1.0:1788361235.663754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361235.663847:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130556160 00000100:00100000:0.0:1788361235.663857:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130556160 00000100:00100000:0.0:1788361235.663970:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:0.0:1788361235.663981:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+42:21850:x1875232130556160:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361235.664056:0:23214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788361235.664123:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6612f89 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec94 expref: 42 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.664144:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:0.0:1788361235.664162:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6612f9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec9b expref: 41 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.664173:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:0.0:1788361235.664177:0:23214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361235.664199:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.664213:0:23214:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec40 expref: 6 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.664221:0:23214:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.664270:0:23214:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec40 expref: 6 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.664296:0:23214:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec40 expref: 6 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.664312:0:23214:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23214:1875232144125568:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361235.664386:0:23214:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361235.667140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361235.667665:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130556288 00000100:00100000:1.0:1788361235.667675:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130556288 00010000:00010000:1.0:1788361235.667722:0:23199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec40 expref: 7 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.667774:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788361235.667783:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21603276-4ada-4ef3-bed6-677f5b3076da+7:2349:x1875232130556288:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361235.667799:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361235.667806:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec40 expref: 7 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.667819:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec40 expref: 7 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.667842:0:23199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:1.0:1788361235.667860:0:23199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.667870:0:23199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.667877:0:23199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.667896:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361235.667948:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:21603276-4ada-4ef3-bed6-677f5b3076da+7:2349:x1875232130556288:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 165us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361235.667955:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00010000:00010000:3.0:1788361235.669725:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612e5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec40 expref: 6 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.669746:0:23214:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:23214:1875232144125568:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361235.669776:0:23214:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669785:0:23214:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669790:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669812:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc80c5465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669822:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc80c5465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669832:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc80c5465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669912:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669920:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669927:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669933:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.669949:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669958:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669970:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1500) 00010000:00010000:3.0:1788361235.669973:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.669977:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.669983:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6612fa5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.670213:0:23214:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc80c5465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.670221:0:23214:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc80c5465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.670227:0:23214:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc80c5465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.670233:0:23214:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.670236:0:23214:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc80c5465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.670242:0:23214:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc80c5465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.670250:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc80c5465 (ffff9a8ac20d4d00) 00010000:00010000:3.0:1788361235.670253:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.670263:0:23214:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc80c5465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.670270:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc80c5465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.670439:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:21850:x1875232130556160:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 6458us (6760us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361235.670449:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:0.0:1788361235.677466:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361235.680034:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130556416 00000100:00100000:1.0:1788361235.680048:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130556416 00000100:00100000:1.0:1788361235.680233:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:1.0:1788361235.680245:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+40:21850:x1875232130556416:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361235.680266:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361235.680289:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6612fb3 lrc: 2/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eca2 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.680324:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.680337:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.680348:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.680442:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6612fb3 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca2 expref: 42 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.680465:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca2 expref: 41 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.680473:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:1.0:1788361235.680475:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361235.680478:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9600, rc 0) 00000100:00100000:1.0:1788361235.680581:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+41:21850:x1875232130556416:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 338us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361235.680588:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:1.0:1788361235.686943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.687239:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130556672 00000100:00100000:3.0:1788361235.687250:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130556672 00000100:00100000:3.0:1788361235.687312:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:3.0:1788361235.687323:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+41:21850:x1875232130556672:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788361235.687406:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.687425:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.687437:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361235.687860:0:23213:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x16:0x0].3, 88 off8432 00000004:00080000:3.0:1788361235.687870:0:23213:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 625702783973ns, next at 626702781791ns, rc = 0 00000004:00010000:3.0:1788361235.687955:0:23213:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007211d315 reply state 0000000067301cb0 transno 17179869255 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.687965:0:23213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361235.688068:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+43:21850:x1875232130556672:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 745us (1132us total) trans 17179869255 rc 0/0 00000100:00100000:3.0:1788361235.688111:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00010000:00010000:1.0:1788361235.690072:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.690117:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.690125:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.690133:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361235.690137:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.690145:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.690163:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:1.0:1788361235.690166:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788361235.690351:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.690358:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6612fc1 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.692523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.692645:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130556800 00000100:00100000:2.0:1788361235.692654:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130556800 00000100:00100000:2.0:1788361235.692701:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:2.0:1788361235.692711:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+42:21850:x1875232130556800:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361235.692813:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361235.692835:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612fc8 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eca9 expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.692915:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612fc8 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca9 expref: 43 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.692930:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612fc8 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca9 expref: 43 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.692949:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:2.0:1788361235.692952:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361235.692955:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9e00, rc 0) 00000100:00100000:2.0:1788361235.693073:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+43:21850:x1875232130556800:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 364us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.693081:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:0.0:1788361235.695696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.695795:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130556928 00000100:00100000:2.0:1788361235.695804:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130556928 00000100:00100000:2.0:1788361235.695902:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788361235.695911:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a86199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2349:x1875232130556928:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788361235.696224:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a86199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2349:x1875232130556928:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 313us (535us total) trans 17179869191 rc 0/0 00000100:00100000:2.0:1788361235.696232:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00080000:3.0:1788361235.697712:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361235.698699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.698886:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130557184 00000100:00100000:2.0:1788361235.698895:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130557184 00000100:00100000:2.0:1788361235.698939:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788361235.698949:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90beec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+43:21850:x1875232130557184:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361235.699217:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90beec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+44:21850:x1875232130557184:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 269us (522us total) trans 17179869256 rc 0/0 00000100:00100000:2.0:1788361235.699237:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361235.707065:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.707190:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130557440 00000100:00100000:3.0:1788361235.707200:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130557440 00000100:00100000:2.0:1788361235.707522:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:2.0:1788361235.707535:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+44:21850:x1875232130557440:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788361235.707650:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+44:21850:x1875232130557440:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 118us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.707657:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:0.0:1788361235.709356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361235.709435:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130557568 00000100:00100000:1.0:1788361235.709445:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130557568 00000100:00100000:1.0:1788361235.709500:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:1.0:1788361235.709509:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+44:21850:x1875232130557568:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361235.709527:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361235.709547:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612fcf lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ecb0 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.709612:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612fd6 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.709627:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612fd6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.709639:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612fd6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361235.709677:0:23215:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361235.709695:0:23215:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612fd6 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.709719:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9a00/0xf6a94c97d6612fcf lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb0 expref: 46 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.709768:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612fd6 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb0 expref: 45 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.709777:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:1.0:1788361235.709780:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788361235.709784:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8600, rc 0) 00000100:00100000:1.0:1788361235.709840:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+45:21850:x1875232130557568:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 332us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361235.709847:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:0.0:1788361235.713236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.713333:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130557696 00000100:00100000:2.0:1788361235.713344:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130557696 00000100:00100000:2.0:1788361235.713399:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788361235.713408:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2349:x1875232130557696:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361235.713427:0:23849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361235.713447:0:23849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6612fdd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ecb7 expref: -99 pid: 23849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361235.713474:0:23849:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983a14, blocks: 0x1 00010000:00010000:2.0:1788361235.713493:0:23849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=625s v=(0 0) 00010000:00010000:2.0:1788361235.713498:0:23849:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361235.713508:0:23849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6612fdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb7 expref: 7 pid: 23849 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.713528:0:23849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6612fdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb7 expref: 7 pid: 23849 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.713542:0:23849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361235.713610:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2349:x1875232130557696:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 203us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.713617:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361235.716370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361235.716450:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130557952 00000100:00100000:1.0:1788361235.716460:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130557952 00000100:00100000:1.0:1788361235.716514:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:1.0:1788361235.716522:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+45:21850:x1875232130557952:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788361235.716615:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+45:21850:x1875232130557952:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 94us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361235.716621:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:0.0:1788361235.720135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.720441:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130558080 00000100:00100000:2.0:1788361235.720452:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130558080 00000100:00100000:2.0:1788361235.720550:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:2.0:1788361235.720561:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:21850:x1875232130558080:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361235.720579:0:23848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361235.720597:0:23848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ecbe expref: -99 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.720628:0:23848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6612fdd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb7 expref: 8 pid: 23849 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.720636:0:23848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361235.720641:0:23848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361235.720645:0:23848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 8 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.720678:0:23848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6612fdd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb7 expref: 8 pid: 23849 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.720692:0:23848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6612fdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb7 expref: 8 pid: 23849 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361235.720706:0:23848:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:23848:1875232144125696:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361235.720809:0:23848:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361235.723509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361235.723572:0:23198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130558208 00000100:00100000:1.0:1788361235.723581:0:23198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130558208 00010000:00010000:1.0:1788361235.723611:0:23198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6612fdd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb7 expref: 9 pid: 23849 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.723648:0:23198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1788361235.723656:0:23198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:2349:x1875232130558208:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361235.723668:0:23198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361235.723698:0:23198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6612fdd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb7 expref: 9 pid: 23849 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.723711:0:23198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6612fdd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb7 expref: 9 pid: 23849 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.723735:0:23198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361235.723739:0:23198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361235.723747:0:23198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 9 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.723766:0:23198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 9 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.723797:0:23198:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 9 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.723810:0:23198:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859cb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:23198:1875232144125824:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361235.723872:0:23198:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86477b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361235.725631:0:23198:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859cb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:23198:1875232144125824:192.168.203.60@tcp:105: 00010000:00010000:3.0:1788361235.725651:0:23198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361235.725701:0:23198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:2349:x1875232130558208:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 2044us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.725709:0:23198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00010000:00010000:2.0:1788361235.726913:0:23848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6612fdd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb7 expref: 8 pid: 23849 timeout: 725 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361235.726935:0:23848:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:23848:1875232144125696:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361235.726960:0:23848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 7 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.726975:0:23848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361235.727076:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:21850:x1875232130558080:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 6516us (6988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.727117:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361235.731538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.731637:0:23854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130558336 00000100:00100000:3.0:1788361235.731647:0:23854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130558336 00002000:00100000:3.0:1788361235.731697:0:23854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x63:0x0] (0->1023) req@ffff9a89859cb480 x1875232130558336/t0(0) o4->a3b5bfdf-7a4d-457e-bbc9-180c7e54f761@192.168.203.60@tcp:296/0 lens 1512/0 e 0 to 0 dl 1788361246 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361235.731709:0:23854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859cb480 with x1875232130558336 ext(0->1023) 00002000:00010000:3.0:1788361235.731715:0:23854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859cb480 00000100:00100000:3.0:1788361235.731790:0:23854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361235.731800:0:23854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2350:x1875232130558336:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361235.732494:0:23854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:2350:x1875232130558336:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 691us (963us total) trans 17179869192 rc 0/0 00000100:00100000:3.0:1788361235.732504:0:23854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00002000:00100000:3.0:1788361235.732511:0:23854:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x63:0x0] (0->1023) req@ffff9a89859cb480 x1875232130558336/t17179869192(0) o4->a3b5bfdf-7a4d-457e-bbc9-180c7e54f761@192.168.203.60@tcp:296/0 lens 1512/448 e 0 to 0 dl 1788361246 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361235.732520:0:23854:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859cb480 with x1875232130558336 ext(0->1023) 00002000:00010000:3.0:1788361235.732524:0:23854:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859cb480 00000100:00100000:0.0:1788361235.735178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361235.735311:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130558464 00000100:00100000:1.0:1788361235.735320:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130558464 00000100:00100000:1.0:1788361235.735374:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:1.0:1788361235.735384:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+45:21850:x1875232130558464:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788361235.769215:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+45:21850:x1875232130558464:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 33823us (34035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361235.769243:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000001:00080000:3.0:1788361235.769381:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869253 is committed 00000001:00080000:3.0:1788361235.769404:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869256 is committed 00000004:00080000:3.0:1788361235.769421:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788361235.769446:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a8562cb40 refcount 2 committed 0 result 0 batchid 12884902007 00000020:00080000:3.0:1788361235.769450:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a86b60800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a8562ca80 00000020:00080000:3.0:1788361235.769453:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a86b60e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8abeab3c00 00000004:00080000:3.0:1788361235.769472:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788361235.769493:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869244 is committed 00000020:00080000:3.0:1788361235.769515:0:23250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12884902007 committed batchid 12884902006 00000020:00080000:3.0:1788361235.769688:0:23250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902006 00000100:00100000:3.0:1788361235.769805:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144125952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361235.769858:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361235.769910:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144125952 00000100:00100000:3.0:1788361235.769917:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144125952 00000100:00100000:3.0:1788361235.769964:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788361235.769973:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144125952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788361235.770123:0:23849:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:3.0:1788361235.770127:0:23849:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb mtime from disk: 0 -> 1788361236 00002000:00010000:3.0:1788361235.770130:0:23849:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788361235.770132:0:23849:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb ctime from disk: 1788361236 -> 1788361236 00002000:00010000:3.0:1788361235.770134:0:23849:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788361235.770166:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144125952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (308us total) trans 17179869193 rc 0/0 00000100:00100000:3.0:1788361235.770173:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788361235.770190:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788361235.770217:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a898514c700/2, rc 0, transno 17179869193 00000100:00100000:3.0:1788361235.770222:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144125952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361235.772977:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144126080:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788361235.773128:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361235.773456:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144126080 00000100:00100000:0.0:1788361235.773466:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144126080 00000100:00100000:0.0:1788361235.773539:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361235.773548:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144126080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788361235.773574:0:23847:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:98 count 1 00002000:00010000:0.0:1788361235.773605:0:23847:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x62:0x0] initial LVB size: 1024, mtime: 0x6a983a13, atime: 0x6a983a13, ctime: 0x6a983a13, blocks: 0x1 00010000:00010000:0.0:1788361235.773613:0:23847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36c3c82/0xf6a94c97d6612feb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.773646:0:23847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=625s v=(0 0) 00010000:00010000:0.0:1788361235.773651:0:23847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x62:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361235.773657:0:23847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f36c3c82/0xf6a94c97d6612feb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.773673:0:23847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f36c3c82/0xf6a94c97d6612feb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.773683:0:23847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f36c3c82/0xf6a94c97d6612feb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.773692:0:23847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f36c3c82/0xf6a94c97d6612feb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.773707:0:23847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1788361235.773826:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788361235.773837:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361235.773843:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f36c3c82/0xf6a94c97d6612feb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.773852:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361235.773856:0:23201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36c3c82/0xf6a94c97d6612feb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.773866:0:23201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f36c3c82/0xf6a94c97d6612feb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.773882:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f36c3c82/0xf6a94c97d6612feb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.773890:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f36c3c82/0xf6a94c97d6612feb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x62:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.773909:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361235.773911:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361235.773913:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361235.774416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361235.775004:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144126080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1455us (1874us total) trans 17179869189 rc 0/0 00000100:00100000:0.0:1788361235.775013:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1788361235.775119:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a89859ca300/2, rc 0, transno 17179869189 00000100:00100000:1.0:1788361235.775127:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144126080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788361235.775455:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130558592 00000100:00100000:0.0:1788361235.775462:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130558592 00000100:00100000:0.0:1788361235.775504:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361235.775512:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:2349:x1875232130558592:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788361235.798703:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+9:2349:x1875232130558592:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 23180us (24279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361235.798716:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000001:00080000:0.0:1788361235.798778:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869191 is committed 00000001:00080000:0.0:1788361235.798788:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869193 is committed 00000001:00080000:0.0:1788361235.798793:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869192 is committed 00000100:00100000:2.0:1788361235.800851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361235.800930:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130558848 00000100:00100000:1.0:1788361235.800940:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130558848 00000100:00100000:1.0:1788361235.801036:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788361235.801048:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21850:x1875232130558848:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361235.801136:0:23214:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361235.801162:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8600/0xf6a94c97d6612fd6 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecb0 expref: 17 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.801179:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:1.0:1788361235.801183:0:23214:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361235.801211:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.801223:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.801231:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361235.801729:0:23214:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006f846f1e reply state 00000000cf74cd32 transno 17179869257 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.801740:0:23214:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361235.801883:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+18:21850:x1875232130558848:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 836us (1038us total) trans 17179869257 rc 0/0 00000100:00100000:0.0:1788361235.801892:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788361235.804847:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.804923:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130558976 00000100:00100000:2.0:1788361235.804932:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130558976 00000100:00100000:2.0:1788361235.805037:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:2.0:1788361235.805047:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2349:x1875232130558976:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788361235.805331:0:23848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:2.0:1788361235.805336:0:23848:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb mtime from disk: 1788361236 -> 1788361235 00002000:00010000:2.0:1788361235.805338:0:23848:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb atime from disk: 0 -> 1788361235 00002000:00010000:2.0:1788361235.805340:0:23848:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb ctime from disk: 1788361236 -> 1788361236 00002000:00010000:2.0:1788361235.805342:0:23848:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x63:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788361235.805394:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2349:x1875232130558976:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 349us (557us total) trans 17179869194 rc 0/0 00000100:00100000:2.0:1788361235.805415:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00010000:00010000:3.0:1788361235.806917:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.806933:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.807067:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.807073:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.807078:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.807199:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.807216:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:3.0:1788361235.807219:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361235.807224:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.807230:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6612ff2 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.807298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.807334:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130559232 00000100:00100000:3.0:1788361235.807341:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130559232 00000100:00100000:3.0:1788361235.807390:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:3.0:1788361235.807399:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:21850:x1875232130559232:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788361235.807454:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.807468:0:24990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca2 expref: 17 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.807477:0:24990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 4/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.807517:0:24990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca2 expref: 17 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.807531:0:24990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca2 expref: 17 pid: 23215 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.807545:0:24990:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24990:1875232144126208:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361235.807628:0:24990:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a565840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361235.809193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.809296:0:24990:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24990:1875232144126208:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361235.809319:0:24990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.809379:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130559360 00000100:00100000:0.0:1788361235.809385:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130559360 00010000:00010000:0.0:1788361235.809416:0:23199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca2 expref: 18 pid: 23215 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.809451:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361235.809459:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+18:2350:x1875232130559360:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361235.809472:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361235.809490:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca2 expref: 18 pid: 23215 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.809502:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca2 expref: 18 pid: 23215 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.809521:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6612fba lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca2 expref: 18 pid: 23215 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.809550:0:23199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:0.0:1788361235.809554:0:23199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.809563:0:23199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.809570:0:23199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.809594:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361235.809645:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:2350:x1875232130559360:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 186us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361235.809652:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00010000:00010000:3.0:1788361235.809896:0:24990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.809904:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.809933:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.809940:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.810200:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.810206:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361235.810210:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.810226:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.810237:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:3.0:1788361235.810240:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788361235.810244:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.810250:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6612ff9 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.810365:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21850:x1875232130559232:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 2966us (3067us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788361235.810374:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:1.0:1788361235.811963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.812047:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130559488 00000100:00100000:2.0:1788361235.812055:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130559488 00000100:00100000:0.0:1788361235.812443:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:0.0:1788361235.812455:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2351:x1875232130559488:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788361235.812495:0:23847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.812514:0:23847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 7 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.812522:0:23847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361235.812526:0:23847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361235.812530:0:23847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.812580:0:23847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 7 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.812593:0:23847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 7 pid: 23848 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.812607:0:23847:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:23847:1875232144126336:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361235.812718:0:23847:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361235.814447:0:23847:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:23847:1875232144126336:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361235.814470:0:23847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.815126:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.815226:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130559616 00000100:00100000:3.0:1788361235.815233:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130559616 00010000:00010000:3.0:1788361235.815282:0:23200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 8 pid: 23848 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.815322:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361235.815331:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+8:2350:x1875232130559616:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361235.815346:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361235.815367:0:23200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 8 pid: 23848 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.815380:0:23200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 8 pid: 23848 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.815424:0:23200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d6612fe4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x63:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecbe expref: 8 pid: 23848 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.815439:0:23200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361235.815443:0:23200:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361235.815449:0:23200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.815458:0:23200:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.815489:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361235.815542:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2350:x1875232130559616:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 212us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.815550:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00010000:00010000:0.0:1788361235.815604:0:23847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.815613:0:23847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.815637:0:23847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.815646:0:23847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.815666:0:23847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.815673:0:23847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361235.815678:0:23847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.815687:0:23847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.815700:0:23847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.815707:0:23847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613000 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 23847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.815754:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2351:x1875232130559488:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 3302us (3798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361235.815773:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361235.818298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.818389:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130559872 00000100:00100000:2.0:1788361235.818398:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130559872 00000100:00100000:2.0:1788361235.818488:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:2.0:1788361235.818501:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21850:x1875232130559872:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788361235.818581:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.818599:0:23213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 2/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec71 expref: 16 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.818608:0:23213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 4/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.818641:0:23213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec71 expref: 16 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.818668:0:23213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec71 expref: 16 pid: 23213 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361235.818683:0:23213:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23213:1875232144126464:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361235.818768:0:23213:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85014780 going to sleep for 11 seconds 00000100:00100000:2.0:1788361235.821346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.821460:0:25227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130560000 00000100:00100000:3.0:1788361235.821469:0:25227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130560000 00010000:00010000:3.0:1788361235.821547:0:25227:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec71 expref: 17 pid: 23213 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.821585:0:25227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:3.0:1788361235.821596:0:25227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:2349:x1875232130560000:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361235.821612:0:25227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361235.821619:0:25227:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 5/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec71 expref: 17 pid: 23213 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.821650:0:25227:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 4/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec71 expref: 17 pid: 23213 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.821673:0:25227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361235.821678:0:25227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612f51 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec86 expref: 17 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.821688:0:25227:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.821695:0:25227:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.821702:0:25227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.821718:0:25227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361235.821777:0:25227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:2349:x1875232130560000:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 182us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.821784:0:25227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00010000:00010000:0.0:1788361235.822236:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6612f0b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec71 expref: 16 pid: 23213 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.822253:0:23213:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23213:1875232144126464:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361235.822359:0:23213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.822377:0:23213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.822383:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.822589:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.822601:0:23213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612fc8 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca9 expref: 16 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.822609:0:23213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 4/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.822637:0:23213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612fc8 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca9 expref: 16 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.822649:0:23213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612fc8 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca9 expref: 16 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.822661:0:23213:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23213:1875232144126592:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361235.822709:0:23213:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361235.825823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361235.826484:0:23213:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23213:1875232144126592:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361235.826510:0:23213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.826556:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130560128 00000100:00100000:3.0:1788361235.826565:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130560128 00010000:00010000:3.0:1788361235.826600:0:23200:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612fc8 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca9 expref: 17 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.826639:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788361235.826649:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7476c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:2350:x1875232130560128:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361235.826677:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361235.826684:0:23200:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612fc8 lrc: 4/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca9 expref: 17 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.826694:0:23200:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612fc8 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca9 expref: 17 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.826715:0:23200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6612fc8 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eca9 expref: 17 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.826731:0:23200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:3.0:1788361235.826736:0:23200:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.826745:0:23200:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.826753:0:23200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 4/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.826794:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361235.826853:0:23213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.826869:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.826896:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7476c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:2350:x1875232130560128:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 247us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361235.826904:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000001:00080000:0.0:1788361235.827167:0:23213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869258 00000001:00080000:0.0:1788361235.827695:0:23213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869259 00000001:00080000:0.0:1788361235.827741:0:23213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869260 00000100:00100000:0.0:1788361235.827838:0:23213:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:23213:1875232144126720:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788361235.827890:0:23213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361235.828121:0:23213:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361235.828565:0:23219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144126720 00000100:00100000:1.0:1788361235.828571:0:23219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144126720 00000100:00100000:1.0:1788361235.828615:0:23219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361235.828624:0:23219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:23213:x1875232144126720:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788361235.828722:0:23219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:23213:x1875232144126720:12345-0@lo:1000:mdt00_000.0 Request processed in 99us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361235.828729:0:23219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361235.828816:0:23213:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869193 gen 2 00000004:00080000:0.0:1788361235.828822:0:23213:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a898514c700, transno 17179869193 00000100:00100000:0.0:1788361235.828847:0:23213:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:23213:1875232144126720:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788361235.829748:0:23213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869261 00000100:00100000:0.0:1788361235.829826:0:23213:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:23213:1875232144126848:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788361235.829869:0:23213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361235.829899:0:23213:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361235.829964:0:23219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144126848 00000100:00100000:1.0:1788361235.829970:0:23219:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144126848 00000100:00100000:1.0:1788361235.830010:0:23219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361235.830019:0:23219:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:23213:x1875232144126848:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788361235.830621:0:23219:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:23213:x1875232144126848:12345-0@lo:1000:mdt00_000.0 Request processed in 602us (750us total) trans 17179869195 rc 0/0 00000100:00100000:1.0:1788361235.830630:0:23219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361235.830737:0:23213:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:23213:1875232144126848:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788361235.830785:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830801:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830809:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830815:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361235.830819:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830837:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830853:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:0.0:1788361235.830856:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361235.830860:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830866:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661300e lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830893:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830900:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830906:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830911:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361235.830914:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830920:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830928:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361235.830931:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361235.830937:0:23213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612f51 lrc: 2/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec86 expref: 19 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830962:0:23213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612f51 lrc: 2/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec86 expref: 19 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.830971:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612f51 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec86 expref: 19 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.831001:0:23213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612f51 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec86 expref: 19 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.831014:0:23213:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23213:1875232144126976:192.168.203.60@tcp:105: 00000100:00100000:0.0:1788361235.831219:0:23213:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361235.835396:0:23213:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:23213:1875232144126976:192.168.203.60@tcp:105: 00010000:00010000:0.0:1788361235.835427:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835438:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6612f4a lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835469:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613015 lrc: 3/0,1 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835483:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613015 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835494:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613015 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835505:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613015 lrc: 3/0,1 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835525:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613015 lrc: 2/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835531:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613015 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835536:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361235.835540:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613015 lrc: 3/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835546:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613015 lrc: 4/0,0 mode: EX/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835558:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361235.835561:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361235.835565:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613015 lrc: 2/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835571:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613015 lrc: 0/0,0 mode: --/EX res: [0x200001b71:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835581:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835586:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835592:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835596:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361235.835605:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835612:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835630:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361235.835633:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361235.835636:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.835642:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613007 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361235.835896:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:21850:x1875232130559872:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 17396us (17605us total) trans 17179869262 rc 0/0 00000100:00100000:0.0:1788361235.835906:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000020:00080000:0.0:1788361235.835912:0:23213:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788361235.836077:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000040:00080000:2.0:1788361235.836375:0:23247:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1788361235.836380:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361235.836420:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 4 count 4 00000040:00080000:2.0:1788361235.836426:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:0.0:1788361235.836523:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130560256 00000100:00100000:0.0:1788361235.836530:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130560256 00000100:00100000:0.0:1788361235.836570:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361235.836579:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:21849:x1875232130560256:12345-192.168.203.60@tcp:49:lfs.0 00000100:00100000:0.0:1788361235.836688:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:21849:x1875232130560256:12345-192.168.203.60@tcp:49:lfs.0 Request processed in 110us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361235.836696:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788361235.838415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361235.840041:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130560512 00000100:00100000:3.0:1788361235.840055:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130560512 00000100:00100000:3.0:1788361235.840142:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788361235.840153:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+19:21850:x1875232130560512:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788361235.840942:0:23217:0:(mdd_object.c:4016:mdd_close()) Object [0x200001b71:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788361235.841049:0:23217:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 17179869263 00010000:00010000:2.0:1788361235.841178:0:23217:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.841195:0:23217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.841206:0:23217:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.841216:0:23217:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.841222:0:23217:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 4/0,1 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.841228:0:23217:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.841246:0:23217:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788361235.841346:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+21:21850:x1875232130560512:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1193us (2937us total) trans 17179869264 rc 0/0 00000100:00100000:2.0:1788361235.841355:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000020:00080000:2.0:1788361235.841360:0:23217:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361235.842136:0:24890:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361235.842145:0:24890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.842154:0:24890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361235.842158:0:24890:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.842167:0:24890:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.842181:0:24890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x7:0x0].0x0 (ffff9a8aa8ee1700) 00010000:00010000:3.0:1788361235.842185:0:24890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788361235.842189:0:24890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 1/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.842195:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661301c lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 23217 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361235.842215:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361235.842217:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361235.842219:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361235.848611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361235.848728:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130560768 00000100:00100000:0.0:1788361235.848738:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130560768 00000100:00100000:0.0:1788361235.848833:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:0.0:1788361235.848844:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+21:21849:x1875232130560768:12345-192.168.203.60@tcp:58:lfs.0 00000040:00080000:0.0:1788361235.849220:0:23215:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1a:0x0].4, 136 off8736 00000100:00100000:0.0:1788361235.849306:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+21:21849:x1875232130560768:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 464us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361235.849314:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:0.0:1788361235.851802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.851888:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130561024 00000100:00100000:2.0:1788361235.851898:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130561024 00000100:00100000:2.0:1788361235.851981:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788361235.851991:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+21:21849:x1875232130561024:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:2.0:1788361235.852300:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+22:21849:x1875232130561024:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 310us (506us total) trans 17179869265 rc 0/0 00000100:00100000:2.0:1788361235.852308:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:1.0:1788361235.879176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361235.879318:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130561152 00000100:00100000:0.0:1788361235.879328:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130561152 00000100:00100000:0.0:1788361235.879391:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:0.0:1788361235.879401:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+22:21852:x1875232130561152:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361235.879423:0:23214:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361235.879445:0:23214:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613023 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ecc5 expref: -99 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.879509:0:23214:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661302a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.879522:0:23214:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661302a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.879534:0:23214:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661302a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361235.879729:0:23214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361235.879733:0:23214:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 8 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361235.879823:0:23214:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661302a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23214 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.879848:0:23214:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613023 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecc5 expref: 24 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.879878:0:23214:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661302a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecc5 expref: 23 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361235.879886:0:23214:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361235.879889:0:23214:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361235.879891:0:23214:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965a00, rc 0) 00000100:00100000:0.0:1788361235.879952:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+23:21852:x1875232130561152:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 552us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361235.879959:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:3.0:1788361235.882315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361235.882544:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130561280 00000100:00100000:2.0:1788361235.882554:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130561280 00000100:00100000:2.0:1788361235.882608:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:2.0:1788361235.882618:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+23:21852:x1875232130561280:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361235.882635:0:24990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361235.882651:0:24990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613031 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eccc expref: -99 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.882712:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613038 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.882726:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.882741:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.882765:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661303f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.882772:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661303f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.882779:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661303f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.883322:0:24990:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.883342:0:24990:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 2/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec7f expref: 24 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.883350:0:24990:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 4/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.883382:0:24990:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec7f expref: 24 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.883396:0:24990:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec7f expref: 24 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361235.883410:0:24990:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24990:1875232144127104:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361235.883565:0:24990:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85014540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361235.886159:0:24990:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24990:1875232144127104:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361235.886188:0:24990:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361235.887404:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361235.888274:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130561408 00000100:00100000:1.0:1788361235.888374:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130561408 00010000:00010000:1.0:1788361235.888417:0:23199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec7f expref: 25 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361235.888461:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:1.0:1788361235.888470:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+25:2350:x1875232130561408:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361235.888485:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361235.888505:0:23199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 4/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec7f expref: 25 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.888518:0:23199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 3/0,0 mode: CW/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec7f expref: 25 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.888542:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6612f3c lrc: 0/0,0 mode: --/CW res: [0x200001b71:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec7f expref: 25 pid: 24990 timeout: 725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.888560:0:23199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:1.0:1788361235.888566:0:23199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.888576:0:23199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.888585:0:23199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 4/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361235.888616:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361235.888721:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+24:2350:x1875232130561408:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 252us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361235.888730:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00010000:00010000:2.0:1788361235.888849:0:24990:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.888858:0:24990:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361235.888900:0:24990:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00000004:00200000:2.0:1788361235.888904:0:24990:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361235.888922:0:24990:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.888945:0:24990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.888955:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613038 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.888961:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613038 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.888968:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613038 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.888974:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361235.888978:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613038 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.888986:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613038 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.888995:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:2.0:1788361235.888998:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361235.889002:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889008:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6613038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889018:0:24990:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661303f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889036:0:24990:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661303f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889048:0:24990:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661303f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889053:0:24990:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361235.889057:0:24990:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661303f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889062:0:24990:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661303f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889071:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5c2799fd (ffff9a8aa8ee1e00) 00010000:00010000:2.0:1788361235.889073:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361235.889076:0:24990:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661303f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889081:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661303f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5c2799fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24990 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889154:0:24990:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613031 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eccc expref: 24 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889168:0:24990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eccc expref: 23 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361235.889175:0:24990:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361235.889177:0:24990:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361235.889179:0:24990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361235.889208:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+23:21852:x1875232130561280:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 6592us (6903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361235.889226:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00010000:00010000:3.0:1788361235.936729:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361236.535857:0:25583:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1788361236.535869:0:25583:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361236.535923:0:25583:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:2.0:1788361236.535929:0:25583:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000040:00080000:2.0:1788361236.896366:0:23247:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1788361236.896388:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361236.896501:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:2.0:1788361236.896508:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1788361236.896633:0:23247:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23247:1875232144127232:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788361236.896807:0:23247:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361236.903896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361236.903965:0:23247:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:23247:1875232144127232:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361236.904297:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130561536 00000100:00100000:0.0:1788361236.904306:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130561536 00000100:00100000:0.0:1788361236.904395:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00080000:3.0:1788361236.904462:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361236.904521:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+23:21864:x1875232130561536:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788361236.904580:0:23213:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200001b71:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788361236.904679:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+23:21864:x1875232130561536:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 165us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361236.904686:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:3.0:1788361236.909407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361236.909574:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130561792 00000100:00100000:0.0:1788361236.909584:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130561792 00000100:00100000:0.0:1788361236.909646:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1788361236.909656:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+23:21864:x1875232130561792:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361236.909676:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361236.909696:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d661304d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ecd3 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.909836:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613054 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.909852:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613054 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.909865:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613054 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361236.909877:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:0.0:1788361236.910031:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d661304d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecd3 expref: 26 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.910048:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613054 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecd3 expref: 25 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.910057:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361236.910060:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361236.910063:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964400, rc 0) 00000100:00100000:0.0:1788361236.910495:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+25:21864:x1875232130561792:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 838us (1096us total) trans 17179869266 rc 0/0 00000100:00100000:0.0:1788361236.910503:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:2.0:1788361236.921159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361236.921220:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361236.921336:0:23198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130562176 00000100:00100000:1.0:1788361236.921347:0:23198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130562176 00000100:00100000:0.0:1788361236.921776:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130562048 00000100:00100000:0.0:1788361236.921782:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130562048 00000100:00100000:1.0:1788361236.921788:0:23198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361236.921804:0:23198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+26:2350:x1875232130562176:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361236.921828:0:23198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788361236.921829:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:0.0:1788361236.921840:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+26:21864:x1875232130562048:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788361236.921857:0:23198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613054 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecd3 expref: 26 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361236.921889:0:23198:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:1.0:1788361236.921894:0:23198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361236.921914:0:23213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613062 lrc: 3/0,1 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.921936:0:23213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613062 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.921953:0:23213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613062 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361236.921962:0:23198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+25:2350:x1875232130562176:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 162us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361236.921971:0:23198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:0.0:1788361236.922915:0:23213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613062 lrc: 3/0,1 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.922927:0:23213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613062 lrc: 2/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.922935:0:23213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613062 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.922941:0:23213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361236.922946:0:23213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613062 lrc: 3/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.922954:0:23213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613062 lrc: 4/0,0 mode: PW/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.922966:0:23213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361236.922970:0:23213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361236.922974:0:23213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613062 lrc: 2/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361236.922980:0:23213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613062 lrc: 0/0,0 mode: --/PW res: [0x200001b71:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361236.923171:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+25:21864:x1875232130562048:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 1330us (2019us total) trans 17179869267 rc 0/0 00000100:00100000:0.0:1788361236.923188:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000040:00080000:3.0:1788361236.923235:0:23247:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788361236.923241:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361236.923280:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:3.0:1788361236.923285:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:2.0:1788361236.925872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361236.925946:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130562432 00000100:00100000:0.0:1788361236.925955:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130562432 00000100:00100000:0.0:1788361236.926011:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:0.0:1788361236.926030:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+25:21864:x1875232130562432:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361236.926489:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+26:21864:x1875232130562432:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 469us (624us total) trans 17179869268 rc 0/0 00000100:00100000:0.0:1788361236.926497:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00010000:00010000:3.0:1788361236.961065:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361237.129990:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361237.130047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361237.130138:0:23933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130562688 00000100:00100000:3.0:1788361237.130159:0:23933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130562688 00000100:00100000:3.0:1788361237.130228:0:23933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:3.0:1788361237.130238:0:23933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2352:x1875232130562688:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361237.130321:0:23933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2352:x1875232130562688:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361237.130328:0:23933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00080000:1.0:1788361237.130382:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361237.131424:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130562560 00000100:00100000:0.0:1788361237.131433:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130562560 00000100:00100000:0.0:1788361237.131486:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:0.0:1788361237.131494:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2352:x1875232130562560:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361237.131564:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2352:x1875232130562560:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 71us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361237.131571:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:1.0:1788361237.145314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361237.145580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361237.145699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361237.146543:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130562944 00000100:00100000:2.0:1788361237.146553:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130562944 00000100:00100000:2.0:1788361237.146640:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1788361237.146937:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:2352:x1875232130562944:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361237.147018:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:2352:x1875232130562944:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 87us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361237.147025:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00080000:3.0:1788361237.147468:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361237.147859:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361237.148064:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130562816 00000100:00100000:0.0:1788361237.148072:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130562816 00000100:00100000:0.0:1788361237.148145:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130563072 00000100:00100000:0.0:1788361237.148150:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130563072 00000100:00100000:0.0:1788361237.148189:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361237.148197:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+8:2352:x1875232130562816:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361237.148246:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+8:2352:x1875232130562816:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 49us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361237.148253:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361237.148270:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361237.148291:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:2348:x1875232130563072:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1788361237.148309:0:23849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612985 00000100:00080000:0.0:1788361237.148328:0:23849:0:(import.c:65:import_set_state_nolock()) ffff9a8a85598800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361237.148365:0:23849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869195 00000100:00100000:0.0:1788361237.148554:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21603276-4ada-4ef3-bed6-677f5b3076da+2:2348:x1875232130563072:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 263us (2854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361237.148561:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00010000:00010000:0.0:1788361237.148579:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361237.149197:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361237.149202:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361237.149942:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130563200 00000100:00100000:0.0:1788361237.149952:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130563200 00000100:00100000:0.0:1788361237.150010:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788361237.150019:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:2348:x1875232130563200:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1788361237.150039:0:23849:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661298c 00000100:00080000:0.0:1788361237.150052:0:23849:0:(import.c:65:import_set_state_nolock()) ffff9a8a8559b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361237.150082:0:23849:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869189 00000100:00100000:0.0:1788361237.150289:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:21603276-4ada-4ef3-bed6-677f5b3076da+2:2348:x1875232130563200:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 270us (2430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361237.150297:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00010000:00010000:0.0:1788361237.150346:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361237.150519:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788361237.986857:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361238.177494:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361238.177517:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144127360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361238.177578:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361238.178164:0:23851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144127360 00000100:00100000:0.0:1788361238.178171:0:23851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144127360 00000100:00100000:0.0:1788361238.178219:0:23851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361238.178226:0:23851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144127360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361238.178254:0:23851:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361238.178294:0:23851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144127360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361238.178309:0:23851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361238.178330:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144127744:0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.178356:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361238.178441:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361238.178451:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144127616:0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.178472:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361238.178492:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361238.178507:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144127744 00000100:00100000:0.0:1788361238.178510:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144127744 00000100:00100000:0.0:1788361238.178533:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361238.178538:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144127744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.178568:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144127744:12345-0@lo:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361238.178574:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361238.178589:0:23933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144127616 00000100:00100000:0.0:1788361238.178592:0:23933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144127616 00000100:00100000:0.0:1788361238.178615:0:23933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361238.178621:0:23933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144127616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.178644:0:23933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144127616:12345-0@lo:400:kworker.0 Request processed in 24us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361238.178649:0:23933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361238.178667:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144127872:0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.178685:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361238.178700:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788361238.178704:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144127488:0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.178725:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361238.178765:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144128000:0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.178786:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361238.178806:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144127872 00000100:00100000:0.0:1788361238.178809:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144127872 00000100:00100000:0.0:1788361238.178827:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144128000 00000100:00100000:0.0:1788361238.178829:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144128000 00000100:00100000:0.0:1788361238.178843:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788361238.178848:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144127872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.178875:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144127872:12345-0@lo:400:kworker.0 Request processed in 27us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361238.178880:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788361238.178890:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361238.178895:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144128000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.178914:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144128000:12345-0@lo:400:kworker.0 Request processed in 20us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361238.178919:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361238.178933:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144127488 00000100:00100000:0.0:1788361238.178936:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144127488 00000100:00100000:0.0:1788361238.178954:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788361238.178960:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3311:x1875232144127488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.178982:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3311:x1875232144127488:12345-0@lo:400:kworker.0 Request processed in 23us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361238.178988:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788361238.179012:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361238.179015:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361238.179037:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144127616:0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.179046:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144127744:0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.179075:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144127488:0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.179082:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144128000:0@lo:400:kworker.0 00000100:00100000:0.0:1788361238.179111:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144127872:0@lo:400:kworker.0 00000100:00100000:1.0:1788361238.179715:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144127360:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788361238.228423:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 21603276-4ada-4ef3-bed6-677f5b3076da 00000020:00000080:3.0:1788361238.228434:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a8559d000/21603276-4ada-4ef3-bed6-677f5b3076da 00000001:00080000:3.0:1788361238.228467:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869189 is committed 00000001:00080000:3.0:1788361238.228478:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 17179869187 is committed 00000020:00000080:1.0:1788361238.228731:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8559d000/21603276-4ada-4ef3-bed6-677f5b3076da for lustre-OST0001 00000020:00000080:1.0:1788361238.228780:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8559b000 for lustre-OST0001 00000040:00080000:3.0:1788361238.271270:0:25636:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788361238.271279:0:25636:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361238.271326:0:25636:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:3.0:1788361238.271331:0:25636:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000100:00100000:3.0:1788361238.439173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361238.440131:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130563456 00000100:00100000:1.0:1788361238.440141:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130563456 00000100:00100000:1.0:1788361238.440206:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:1.0:1788361238.440215:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+26:21888:x1875232130563456:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:1.0:1788361238.440238:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361238.440258:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6613069 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ecda expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361238.440367:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8c00/0xf6a94c97d6613070 lrc: 3/1,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361238.440381:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8c00/0xf6a94c97d6613070 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361238.440393:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8c00/0xf6a94c97d6613070 lrc: 3/1,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361238.440405:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x5:0x0]: returning size 1024 00010000:00010000:1.0:1788361238.440516:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6613069 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecda expref: 29 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361238.440532:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8c00/0xf6a94c97d6613070 lrc: 3/0,0 mode: CR/CR res: [0x200001b71:0x5:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecda expref: 28 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361238.440541:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:1.0:1788361238.440543:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788361238.440546:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8c00, rc 0) 00000100:00100000:1.0:1788361238.440601:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+28:21888:x1875232130563456:12345-192.168.203.60@tcp:101:dd.500 Request processed in 387us (1436us total) trans 17179869269 rc 0/0 00000100:00100000:1.0:1788361238.440607:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00080000:1.0:1788361238.440629:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361238.446765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361238.447727:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130563584 00000100:00100000:3.0:1788361238.447737:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130563584 00000100:00100000:3.0:1788361238.447825:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:3.0:1788361238.447834:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:21888:x1875232130563584:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:3.0:1788361238.447851:0:23848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361238.447869:0:23848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d661307e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ece1 expref: -99 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361238.447906:0:23848:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x63:0x0] initial LVB size: 1024, mtime: 0x6a983a13, atime: 0x6a983a13, ctime: 0x6a983a14, blocks: 0xb 00010000:00010000:3.0:1788361238.447925:0:23848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=628s v=(0 0) 00010000:00010000:3.0:1788361238.447930:0:23848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361238.447939:0:23848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d661307e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ece1 expref: 7 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361238.447958:0:23848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d661307e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ece1 expref: 7 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361238.447971:0:23848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e600, rc 0) 00000100:00100000:3.0:1788361238.448037:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:21888:x1875232130563584:12345-192.168.203.60@tcp:101:dd.500 Request processed in 204us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361238.448044:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1788361238.451405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361238.451445:0:23852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130563712 00000100:00100000:1.0:1788361238.451454:0:23852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130563712 00002000:00100000:1.0:1788361238.451501:0:23852:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x63:0x0] (0->4095) req@ffff9a8ab6abb100 x1875232130563712/t0(0) o3->a3b5bfdf-7a4d-457e-bbc9-180c7e54f761@192.168.203.60@tcp:299/0 lens 488/0 e 0 to 0 dl 1788361249 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361238.451521:0:23852:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6abb100 with x1875232130563712 ext(0->4095) 00002000:00010000:1.0:1788361238.451527:0:23852:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab6abb100 00000100:00100000:1.0:1788361238.451554:0:23852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:1.0:1788361238.451563:0:23852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2349:x1875232130563712:12345-192.168.203.60@tcp:3:dd.500 00000100:00100000:1.0:1788361238.451769:0:23852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+7:2349:x1875232130563712:12345-192.168.203.60@tcp:3:dd.500 Request processed in 206us (372us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788361238.451776:0:23852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00002000:00100000:1.0:1788361238.451783:0:23852:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x63:0x0] (0->4095) req@ffff9a8ab6abb100 x1875232130563712/t0(0) o3->a3b5bfdf-7a4d-457e-bbc9-180c7e54f761@192.168.203.60@tcp:299/0 lens 488/4536 e 0 to 0 dl 1788361249 ref 1 fl Complete:/600/0 rc 4096/4096 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361238.451793:0:23852:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6abb100 with x1875232130563712 ext(0->4095) 00002000:00010000:1.0:1788361238.451796:0:23852:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab6abb100 00000100:00100000:1.0:1788361238.688933:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361238.688955:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144128128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361238.689014:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361238.689116:0:23851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144128128 00000100:00100000:2.0:1788361238.689129:0:23851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144128128 00000100:00100000:2.0:1788361238.689179:0:23851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361238.689187:0:23851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144128128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361238.689217:0:23851:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361238.689256:0:23851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144128128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361238.689262:0:23851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361238.689409:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144128128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361239.009272:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361239.009649:0:23247:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788361239.009655:0:23247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361239.009687:0:23247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:3.0:1788361239.009692:0:23247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:0.0:1788361240.032312:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788361240.782650:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869268 is committed 00000020:00080000:3.0:1788361240.782677:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8ac05fe840 refcount 2 committed 0 result 0 batchid 12884902008 00000020:00080000:3.0:1788361240.782683:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a883ac800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ac05fe780 00000020:00080000:3.0:1788361240.782686:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a883ac200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8abeba8000 00000020:00080000:1.0:1788361240.782719:0:23250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 12884902008 committed batchid 12884902006 00000020:00080000:1.0:1788361240.782930:0:23250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902006 00000001:00080000:3.0:1788361240.787062:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869269 is committed 00000020:00080000:3.0:1788361240.787112:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 12884902007 batchid updated 00010000:00010000:0.0:1788361241.056386:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788361241.296146:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 21603276-4ada-4ef3-bed6-677f5b3076da 00000020:00000080:0.0:1788361241.296159:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8a8559c800/21603276-4ada-4ef3-bed6-677f5b3076da 00000001:00080000:0.0:1788361241.296187:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869195 is committed 00000001:00080000:0.0:1788361241.296196:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 17179869194 is committed 00000020:00000080:2.0:1788361241.296205:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8559c800/21603276-4ada-4ef3-bed6-677f5b3076da for lustre-OST0000 00000020:00000080:2.0:1788361241.296262:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a85598800 for lustre-OST0000 00000100:00100000:1.0:1788361241.924493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361241.924594:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130563840 00000100:00100000:0.0:1788361241.924604:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130563840 00000100:00100000:0.0:1788361241.924683:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:0.0:1788361241.924697:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:21779:x1875232130563840:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788361241.924821:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:21779:x1875232130563840:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 125us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361241.924829:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00080000:1.0:1788361241.925753:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361241.926494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361241.926613:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130564096 00000100:00100000:0.0:1788361241.926621:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130564096 00000100:00100000:0.0:1788361241.926668:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788361241.926677:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:21779:x1875232130564096:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361241.927157:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:21779:x1875232130564096:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 480us (665us total) trans 17179869270 rc 0/0 00000100:00100000:0.0:1788361241.927165:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00010000:00010000:1.0:1788361242.081406:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361242.088319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361242.088435:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130564224 00000100:00100000:0.0:1788361242.088451:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130564224 00000100:00100000:0.0:1788361242.088542:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:0.0:1788361242.088552:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21603276-4ada-4ef3-bed6-677f5b3076da+5:22327:x1875232130564224:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:0.0:1788361242.088572:0:23215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361242.088592:0:23215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613085 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ece8 expref: -99 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361242.088666:0:23215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d661308c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361242.088681:0:23215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d661308c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361242.088693:0:23215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d661308c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361242.088885:0:23215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361242.088889:0:23215:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 8 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361242.088970:0:23215:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d661308c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361242.088995:0:23215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613085 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ece8 expref: 7 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361242.089011:0:23215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d661308c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ece8 expref: 6 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361242.089020:0:23215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361242.089023:0:23215:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361242.089026:0:23215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964400, rc 0) 00000100:00100000:0.0:1788361242.089129:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21603276-4ada-4ef3-bed6-677f5b3076da+6:22327:x1875232130564224:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 577us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361242.089137:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00080000:2.0:1788361242.089427:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361242.248355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361242.248404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361242.248461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361242.248600:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130564352 00000100:00100000:0.0:1788361242.248610:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130564352 00000100:00100000:0.0:1788361242.248658:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:0.0:1788361242.248668:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2352:x1875232130564352:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361242.248752:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2352:x1875232130564352:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 85us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361242.248759:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:3.0:1788361242.249566:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130564608 00000100:00100000:3.0:1788361242.249573:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130564608 00000100:00100000:3.0:1788361242.249673:0:23849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130564480 00000100:00100000:3.0:1788361242.249677:0:23849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130564480 00000100:00100000:0.0:1788361242.249736:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361242.249744:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2352:x1875232130564608:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361242.249792:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2352:x1875232130564608:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 49us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361242.249799:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00080000:1.0:1788361242.250100:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361242.250105:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361242.250838:0:23849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361242.250850:0:23849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2351:x1875232130564480:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361242.250912:0:23849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2351:x1875232130564480:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361242.250920:0:23849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00010000:00010000:0.0:1788361243.104334:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361243.296311:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144128512:0@lo:400:kworker.0 00000100:00100000:0.0:1788361243.296525:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361243.296580:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788361243.296586:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144128384:0@lo:400:kworker.0 00000100:00100000:0.0:1788361243.296606:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361243.296621:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144128896:0@lo:400:kworker.0 00000100:00100000:0.0:1788361243.296641:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361243.296666:0:23933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144128512 00000100:00100000:0.0:1788361243.296672:0:23933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144128512 00000100:00100000:0.0:1788361243.296742:0:23933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144128384 00000100:00100000:0.0:1788361243.296745:0:23933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144128384 00000100:00100000:0.0:1788361243.296764:0:23933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788361243.296772:0:23933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144128512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361243.296884:0:23933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144128512:12345-0@lo:400:kworker.0 Request processed in 54us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361243.296892:0:23933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788361243.296907:0:23933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361243.296913:0:23933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144128384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361243.296947:0:23933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144128384:12345-0@lo:400:kworker.0 Request processed in 35us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361243.296953:0:23933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788361243.296970:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361243.297355:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144128896 00000100:00100000:2.0:1788361243.297360:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144128896 00000100:00100000:2.0:1788361243.297402:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788361243.297410:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144128896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361243.297448:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144128896:12345-0@lo:400:kworker.0 Request processed in 39us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361243.297454:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788361243.297458:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144128256:0@lo:400:kworker.0 00000100:00100000:1.0:1788361243.297512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361243.297538:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144128768:0@lo:400:kworker.0 00000100:00100000:1.0:1788361243.297562:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361243.297581:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361243.297586:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144128640:0@lo:400:kworker.0 00000100:00100000:1.0:1788361243.297607:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361243.297649:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144128256 00000100:00100000:3.0:1788361243.297654:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144128256 00000100:00100000:1.0:1788361243.297686:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144128768 00000100:00100000:3.0:1788361243.297690:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788361243.297692:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144128768 00000100:00100000:3.0:1788361243.297699:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3314:x1875232144128256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361243.297743:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144128640 00000100:00100000:1.0:1788361243.297748:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144128640 00000100:00100000:3.0:1788361243.297758:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3314:x1875232144128256:12345-0@lo:400:kworker.0 Request processed in 60us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361243.297766:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788361243.297776:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361243.297804:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144128256:0@lo:400:kworker.0 00000100:00100000:1.0:1788361243.297957:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144128768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361243.298006:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144128768:12345-0@lo:400:kworker.0 Request processed in 51us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361243.298071:0:3312:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869195 gen 2 00000004:00080000:2.0:1788361243.298076:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869195 committed transno 17179869195 00000100:00100000:2.0:1788361243.298104:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144128384:0@lo:400:kworker.0 00000100:00100000:2.0:1788361243.298124:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144128896:0@lo:400:kworker.0 00000100:00100000:2.0:1788361243.298132:0:3312:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869189 gen 2 00000004:00080000:2.0:1788361243.298135:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 17179869188 committed transno 17179869189 00000004:00080000:2.0:1788361243.298150:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a89859ca300, transno 17179869189 00000100:00100000:2.0:1788361243.298158:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144128512:0@lo:400:kworker.0 00000100:00100000:2.0:1788361243.298176:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144129024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361243.298213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361243.298238:0:23851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144129024 00000100:00100000:2.0:1788361243.298241:0:23851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144129024 00000100:00100000:2.0:1788361243.298263:0:23851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788361243.298269:0:23851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144129024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361243.298293:0:23851:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361243.298323:0:23851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144129024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361243.298329:0:23851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788361243.298356:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144129024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361243.298466:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361243.298473:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361243.298476:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144128640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361243.298512:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144128640:12345-0@lo:400:kworker.0 Request processed in 39us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361243.298520:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788361243.298804:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361243.298807:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361243.298902:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144128640:0@lo:400:kworker.0 00000100:00100000:1.0:1788361243.298915:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144128768:0@lo:400:kworker.0 00000100:00100000:1.0:1788361243.808515:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361243.808547:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144129152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361243.808638:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361243.809376:0:23851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144129152 00000100:00100000:2.0:1788361243.809388:0:23851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144129152 00000100:00100000:2.0:1788361243.809464:0:23851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788361243.809475:0:23851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144129152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361243.809528:0:23851:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361243.809728:0:23851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144129152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 254us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361243.809737:0:23851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361243.809897:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144129152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361244.128307:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361244.148258:0:25838:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 2a: Test multi open when creating ===== 11:00:43 (1788361243) 00010000:00010000:1.0:1788361245.153182:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788361245.885187:0:25749:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869270 is committed 00000020:00080000:1.0:1788361245.885207:0:25749:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 12884902008 batchid updated 00000020:00080000:0.0:1788361245.885246:0:23250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902008 00000020:00080000:0.0:1788361245.885264:0:23250:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902008 00010000:00010000:3.0:1788361246.176301:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361246.703219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361246.703956:0:23216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130564864 00000100:00100000:0.0:1788361246.703965:0:23216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130564864 00000100:00100000:0.0:1788361246.704035:0:23216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:0.0:1788361246.704043:0:23216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90bec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+15:22550:x1875232130564864:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:0.0:1788361246.704517:0:23216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90bec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:22550:x1875232130564864:12345-192.168.203.60@tcp:35:umount.0 Request processed in 475us (1308us total) trans 17179869271 rc 0/0 00000100:00100000:0.0:1788361246.704523:0:23216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00080000:1.0:1788361246.704733:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361246.708839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361246.709062:0:23217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130565120 00000100:00100000:2.0:1788361246.709072:0:23217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130565120 00000100:00100000:2.0:1788361246.709165:0:23217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:2.0:1788361246.709175:0:23217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:22550:x1875232130565120:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:2.0:1788361246.709838:0:23217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:22550:x1875232130565120:12345-192.168.203.60@tcp:35:umount.0 Request processed in 662us (1008us total) trans 17179869272 rc 0/0 00000100:00100000:2.0:1788361246.709848:0:23217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:2.0:1788361246.716235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361246.716331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361246.716419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361246.716496:0:25227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130565504 00000100:00100000:3.0:1788361246.716520:0:25227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130565504 00000100:00100000:3.0:1788361246.716608:0:25227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130565248 00000100:00100000:3.0:1788361246.716612:0:25227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130565248 00000100:00100000:3.0:1788361246.716641:0:25227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361246.716651:0:25227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+14:2352:x1875232130565504:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361246.716665:0:25227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361246.716700:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8abeac8000/0xf6a94c97d6612a11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb13 expref: 14 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361246.716726:0:25227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361246.716778:0:25227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+13:2352:x1875232130565504:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 129us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361246.716786:0:25227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361246.716802:0:25227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361246.716812:0:25227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:2349:x1875232130565248:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361246.716820:0:25227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361246.716829:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573f400/0xf6a94c97d6612931 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea33 expref: 12 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361246.716839:0:25227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361246.716858:0:25227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:2349:x1875232130565248:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 47us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361246.716865:0:25227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361246.717391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361246.717466:0:23198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130565376 00000100:00100000:1.0:1788361246.717472:0:23198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130565376 00000100:00100000:1.0:1788361246.717503:0:23198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361246.717510:0:23198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+11:2349:x1875232130565376:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361246.717519:0:23198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361246.717529:0:23198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964e00/0xf6a94c97d6612938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea5d expref: 11 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361246.717538:0:23198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361246.717566:0:23198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+10:2349:x1875232130565376:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 56us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361246.717573:0:23198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361246.718532:0:23933:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130565632 00000100:00100000:3.0:1788361246.718637:0:23933:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130565632 00000100:00080000:0.0:1788361246.718914:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361246.718984:0:23933:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361246.718995:0:23933:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+5:2348:x1875232130565632:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:1.0:1788361246.719033:0:23933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612954 00000100:00080000:1.0:1788361246.719041:0:23933:0:(import.c:65:import_set_state_nolock()) ffff9a8a856eb800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361246.719111:0:23933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869189 00010000:00010000:0.0:1788361246.719115:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361246.719355:0:23933:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+2:2348:x1875232130565632:12345-192.168.203.60@tcp:9:umount.0 Request processed in 362us (1966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361246.719361:0:23933:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361246.722110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361246.722290:0:23847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130565888 00000100:00100000:2.0:1788361246.722300:0:23847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130565888 00000100:00080000:0.0:1788361246.722499:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361246.722672:0:23847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788361246.722695:0:23847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+6:2348:x1875232130565888:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:2.0:1788361246.722747:0:23847:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661294d 00000020:00010000:2.0:1788361246.722754:0:23847:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a89869800: total 0 00000100:00080000:2.0:1788361246.722759:0:23847:0:(import.c:65:import_set_state_nolock()) ffff9a8a89868800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788361246.722809:0:23847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869195 00000020:00010000:1.0:1788361246.722835:0:24890:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a89869800: total 0 00010000:00010000:1.0:1788361246.722880:0:24890:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a89869800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788361246.723021:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d661307e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ece1 expref: 6 pid: 23848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361246.723048:0:24890:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a89869800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788361246.723063:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361246.723066:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361246.723068:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361246.723117:0:23847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+2:2348:x1875232130565888:12345-192.168.203.60@tcp:9:umount.0 Request processed in 401us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361246.723127:0:23847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788361246.730545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361246.730704:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130566784 00000100:00100000:3.0:1788361246.730714:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130566784 00000100:00100000:3.0:1788361246.730775:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:3.0:1788361246.730785:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+17:2348:x1875232130566784:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:3.0:1788361246.730833:0:23215:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612946 00000020:00010000:3.0:1788361246.730850:0:23215:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a8559d800: total 0 00000100:00080000:3.0:1788361246.730855:0:23215:0:(import.c:65:import_set_state_nolock()) ffff9a8aae466800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361246.730887:0:23215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869272 00000100:00100000:3.0:1788361246.731459:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3b5bfdf-7a4d-457e-bbc9-180c7e54f761+16:2348:x1875232130566784:12345-192.168.203.60@tcp:39:umount.0 Request processed in 673us (924us total) trans 17179869273 rc 0/0 00000100:00100000:3.0:1788361246.731467:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000020:00010000:0.0:1788361246.731903:0:23202:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a8559d800: total 0 00010000:00010000:0.0:1788361246.731908:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361246.732134:0:23202:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a8559d800, canceled 0 locks, left on hash table 10. 00010000:00010000:0.0:1788361246.732170:0:23202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:0.0:1788361246.732174:0:23202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361246.732183:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6612bf4 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb91 expref: 15 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361246.732201:0:23202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361246.732203:0:23202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361246.732207:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6613046 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eccc expref: 14 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361246.732219:0:23202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361246.732221:0:23202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361246.732225:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66129d9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eafe expref: 13 pid: 24990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361246.732242:0:23202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:0.0:1788361246.732244:0:23202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361246.732247:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6612cc6 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebc9 expref: 12 pid: 23213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361246.732261:0:23202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361246.732264:0:23202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788361246.732267:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8c00/0xf6a94c97d6613070 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecda expref: 11 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361246.732293:0:23202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x5:0x0].0x0 (ffff9a8ac20d4500) 00010000:00010000:0.0:1788361246.732296:0:23202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361246.732300:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6612f51 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ec86 expref: 10 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361246.732316:0:23202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:0.0:1788361246.732319:0:23202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788361246.732323:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d6612b3e lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb59 expref: 9 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361246.732333:0:23202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361246.732335:0:23202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361246.732338:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661302a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecc5 expref: 8 pid: 23214 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361246.732348:0:23202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x1:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:0.0:1788361246.732350:0:23202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361246.732353:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6612cf0 lrc: 0/0,0 mode: --/CR res: [0x200001b71:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ebd7 expref: 7 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361246.732367:0:23202:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:0.0:1788361246.732369:0:23202:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361246.732373:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d66129bd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eaf7 expref: 6 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361246.732384:0:23202:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a8559d800, canceled 10 locks, left on hash table 0. 00010000:00010000:0.0:1788361246.732396:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361246.732403:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361246.732405:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361247.201508:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361247.368366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361247.368528:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130566912 00000100:00100000:1.0:1788361247.368538:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130566912 00000100:00100000:1.0:1788361247.368620:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361247.368631:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21603276-4ada-4ef3-bed6-677f5b3076da+6:2352:x1875232130566912:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361247.368722:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:21603276-4ada-4ef3-bed6-677f5b3076da+6:2352:x1875232130566912:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 93us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361247.368737:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00080000:0.0:1788361247.369232:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361247.719204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361247.719312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361247.719344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361247.719482:0:23198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130567168 00000100:00100000:0.0:1788361247.719482:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130567296 00000100:00100000:1.0:1788361247.719493:0:23198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130567168 00000100:00100000:0.0:1788361247.719494:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130567296 00000100:00100000:3.0:1788361247.719562:0:25227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130567040 00000100:00100000:3.0:1788361247.719568:0:25227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130567040 00000100:00100000:1.0:1788361247.719574:0:23198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361247.719583:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361247.719588:0:23198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:2351:x1875232130567168:12345-192.168.203.60@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788361247.719598:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7241450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+12:2351:x1875232130567296:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361247.719606:0:23198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361247.719609:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361247.719628:0:23198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d6612970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eabf expref: 12 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361247.719629:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964200/0xf6a94c97d6612a03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eb0c expref: 12 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361247.719660:0:23198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361247.719660:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361247.719730:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7241450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+10:2351:x1875232130567296:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 136us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361247.719739:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361247.719758:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1788361247.719765:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+9:2351:x1875232130567040:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361247.719773:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361247.719782:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573f600/0xf6a94c97d6612969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea95 expref: 9 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361247.719791:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361247.719931:0:23198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+8:2351:x1875232130567168:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 346us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361247.719937:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+8:2351:x1875232130567040:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 169us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361247.719945:0:23198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361247.719953:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361247.721722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361247.722542:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130567552 00000100:00100000:0.0:1788361247.722577:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130567552 00000100:00100000:0.0:1788361247.722651:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:0.0:1788361247.722659:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21603276-4ada-4ef3-bed6-677f5b3076da+6:2348:x1875232130567552:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:0.0:1788361247.722726:0:23215:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661297e 00000020:00010000:0.0:1788361247.722739:0:23215:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a856e9800: total 0 00000100:00080000:0.0:1788361247.722744:0:23215:0:(import.c:65:import_set_state_nolock()) ffff9a8a856ed800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361247.722800:0:23215:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869273 00000020:00010000:2.0:1788361247.722935:0:24890:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a856e9800: total 0 00010000:00010000:2.0:1788361247.722999:0:24890:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a856e9800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788361247.723059:0:24890:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:2.0:1788361247.723064:0:24890:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361247.723080:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d661308c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ece8 expref: 5 pid: 23215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361247.723140:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:21603276-4ada-4ef3-bed6-677f5b3076da+4:2348:x1875232130567552:12345-192.168.203.60@tcp:39:umount.0 Request processed in 480us (1424us total) trans 17179869274 rc 0/0 00010000:00010000:2.0:1788361247.723148:0:24890:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a856e9800, canceled 1 locks, left on hash table 0. 00000100:00100000:0.0:1788361247.723151:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00010000:00010000:2.0:1788361247.723170:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361247.723174:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361247.723176:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361247.737882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361247.738453:0:23208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130567808 00000100:00100000:0.0:1788361247.738464:0:23208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130567808 00000100:00100000:0.0:1788361247.738529:0:23208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:0.0:1788361247.738539:0:23208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+7:2348:x1875232130567808:12345-192.168.203.60@tcp:251:umount.0 00000020:00000080:0.0:1788361247.738593:0:23208:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612923 00000020:00010000:0.0:1788361247.738601:0:23208:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8aae462800: total 0 00000100:00080000:0.0:1788361247.738605:0:23208:0:(import.c:65:import_set_state_nolock()) ffff9a8a8986a800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788361247.738714:0:23208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56ed8cc8-bd19-4f78-a05c-8174b7c5e83c+3:2348:x1875232130567808:12345-192.168.203.60@tcp:251:umount.0 Request processed in 168us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361247.738723:0:23208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00000020:00010000:1.0:1788361247.739769:0:23202:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8aae462800: total 0 00010000:00010000:1.0:1788361247.739866:0:23202:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8aae462800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788361247.739913:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573fc00/0xf6a94c97d661292a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ea2c expref: 2 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361247.739934:0:23202:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8aae462800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788361247.739942:0:23202:0:(genops.c:906:class_export_put()) final put ffff9a8aae462800/56ed8cc8-bd19-4f78-a05c-8174b7c5e83c 00010000:00010000:1.0:1788361247.739974:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361247.739977:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361247.739978:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361247.740153:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae462800/56ed8cc8-bd19-4f78-a05c-8174b7c5e83c for MGS 00000020:00000080:2.0:1788361247.740208:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8986a800 for MGS 00010000:00010000:3.0:1788361248.224320:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361248.416259:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144129280:0@lo:400:kworker.0 00000100:00100000:0.0:1788361248.416301:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144129664:0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.416335:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361248.416362:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361248.416399:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144129792:0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.416426:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361248.416461:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144129536:0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.416486:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361248.416504:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788361248.416509:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144129408:0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.416527:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361248.416543:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144129920:0@lo:400:kworker.0 00000100:00100000:0.0:1788361248.416557:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144129664 00000100:00100000:2.0:1788361248.416564:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361248.416576:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144129664 00000100:00100000:2.0:1788361248.416589:0:23206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144129280 00000100:00100000:2.0:1788361248.416596:0:23206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144129280 00000100:00100000:0.0:1788361248.416625:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144129792 00000100:00100000:2.0:1788361248.416636:0:23206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788361248.416641:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144129792 00000100:00100000:2.0:1788361248.416647:0:23206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3314:x1875232144129280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361248.416694:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144129920 00000100:00100000:0.0:1788361248.416709:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144129920 00000100:00100000:2.0:1788361248.416711:0:23206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3314:x1875232144129280:12345-0@lo:400:kworker.0 Request processed in 66us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361248.416721:0:23206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788361248.416747:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361248.416757:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144129664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.416779:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144129536 00000100:00100000:2.0:1788361248.416785:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144129536 00000100:00100000:2.0:1788361248.416817:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144129408 00000100:00100000:2.0:1788361248.416820:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144129408 00000100:00100000:0.0:1788361248.416823:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144129664:12345-0@lo:400:kworker.0 Request processed in 67us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361248.416832:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788361248.416848:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361248.416854:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788361248.416859:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144129536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361248.416866:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144129792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361248.416916:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144129792:12345-0@lo:400:kworker.0 Request processed in 53us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361248.416924:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788361248.416933:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144129536:12345-0@lo:400:kworker.0 Request processed in 75us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361248.416945:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788361248.416946:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361248.416960:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144129920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.416970:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788361248.416980:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144129408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361248.416996:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144129920:12345-0@lo:400:kworker.0 Request processed in 40us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361248.417003:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788361248.417022:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144129408:12345-0@lo:400:kworker.0 Request processed in 43us (492us total) trans 0 rc 0/0 00000100:00080000:0.0:1788361248.417030:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361248.417036:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361248.417037:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788361248.417039:0:23209:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361248.417072:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144129664:0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.417471:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144129408:0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.417483:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144129920:0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.417494:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144129536:0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.417529:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144129792:0@lo:400:kworker.0 00000100:00100000:2.0:1788361248.417539:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144129280:0@lo:400:kworker.0 00000100:00100000:1.0:1788361248.417553:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361248.417566:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144130048:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361248.417611:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361248.418353:0:23850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144130048 00000100:00100000:1.0:1788361248.418360:0:23850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144130048 00000100:00100000:1.0:1788361248.418403:0:23850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361248.418412:0:23850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144130048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361248.418446:0:23850:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361248.418512:0:23850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144130048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361248.418519:0:23850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361248.419352:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144130048:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788361248.448802:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 00000020:00000080:3.0:1788361248.448810:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a856ee000/a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 00000020:00000080:0.0:1788361248.448872:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a856ee000/a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 for lustre-OST0001 00000020:00000080:0.0:1788361248.448917:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a856eb800 for lustre-OST0001 00000020:01000004:2.0:1788361248.872566:0:26036:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788361248.880305:0:26036:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788361248.880362:0:26036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.880378:0:26036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.880386:0:26036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.880394:0:26036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.880424:0:26036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788361248.880430:0:26036:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788361248.880458:0:24890:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361248.880464:0:24890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.880472:0:24890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfc00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361248.880476:0:24890:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.880485:0:24890:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361248.880493:0:24890:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361248.880499:0:24890:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361248.880502:0:24890:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788361248.880504:0:24890:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788361248.880539:0:24890:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.880545:0:24890:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361248.880573:0:24890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.880581:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfc00/0xf6a94c97d661262f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612636 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.880592:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361248.880600:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361248.880601:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361248.880610:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361248.880627:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144130176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361248.880704:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361248.880777:0:26036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361248.880781:0:26036:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788361248.880786:0:26036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788361248.880799:0:26036:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efdc000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788361248.881001:0:25227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144130176 00000100:00100000:1.0:1788361248.881009:0:25227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144130176 00000100:00100000:1.0:1788361248.881065:0:25227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361248.881075:0:25227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3314:x1875232144130176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361248.881122:0:25227:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361248.881138:0:25227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab65cf200/0xf6a94c97d6612636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661262f expref: 19 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361248.881163:0:25227:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361248.881203:0:25227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:3314:x1875232144130176:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361248.881211:0:25227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361248.881247:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3314:1875232144130176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361248.881841:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144130304:0@lo:39:umount.0 00000100:00100000:3.0:1788361248.881880:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361248.882165:0:23213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144130304 00000100:00100000:0.0:1788361248.882285:0:23213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144130304 00000100:00100000:0.0:1788361248.882369:0:23213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788361248.882378:0:23213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232144130304:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788361248.882402:0:23213:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612660 00000100:00080000:0.0:1788361248.882418:0:23213:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efd9000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361248.882450:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361248.882517:0:23213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1875232144130304:12345-0@lo:39:umount.0 Request processed in 141us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361248.882525:0:23213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000020:00000080:0.0:1788361248.882533:0:23213:0:(genops.c:906:class_export_put()) final put ffff9a8a9efdd800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788361248.882656:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efdd800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1788361248.882662:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efdc000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788361248.882690:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144130304:0@lo:39:umount.0 00000020:00000080:1.0:1788361248.882769:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a9efd9000 for lustre-MDT0000 00000100:00080000:2.0:1788361248.882791:0:26036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361248.882795:0:26036:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788361248.882799:0:26036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788361248.884031:0:26036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.884046:0:26036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.884054:0:26036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.884061:0:26036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.884147:0:26036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361248.884154:0:26036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.884160:0:26036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.884176:0:26036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.884182:0:26036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361248.884393:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361248.884400:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361248.884408:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361248.884411:0:23201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361248.884419:0:23201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361248.884434:0:23201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361248.884439:0:23201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361248.884442:0:23201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788361248.884469:0:23201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361248.884475:0:23201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361248.884504:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361248.884511:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9200/0xf6a94c97d6612595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661259c expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361248.884523:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361248.884526:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361248.884532:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8a00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361248.884535:0:23201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361248.884541:0:23201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361248.884546:0:23201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361248.884551:0:23201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361248.884560:0:23201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788361248.884572:0:23201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361248.884586:0:23201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361248.884600:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361248.884608:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361248.884610:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361248.884612:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361248.884650:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361248.884676:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3312:1875232144130560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361248.884732:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361248.884782:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361248.884791:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144130432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361248.884817:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361248.884843:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144130560 00000100:00100000:0.0:1788361248.884849:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144130560 00000100:00100000:0.0:1788361248.884884:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144130432 00000100:00100000:0.0:1788361248.884893:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144130432 00000100:00100000:0.0:1788361248.884913:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361248.884920:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+19:3312:x1875232144130560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361248.884932:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361248.884945:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8000/0xf6a94c97d6612843 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661283c expref: 19 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361248.884959:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361248.884991:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+18:3312:x1875232144130560:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361248.884998:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361248.885012:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361248.885018:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:3313:x1875232144130432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361248.885026:0:23199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361248.885044:0:23199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1f600/0xf6a94c97d661259c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6612595 expref: 17 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361248.885052:0:23199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361248.885078:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:3313:x1875232144130432:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361248.885112:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788361248.885128:0:26036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361248.885134:0:26036:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8a00/0xf6a94c97d661283c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612843 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361248.885149:0:26036:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:0.0:1788361248.885150:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1564e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144130432:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361248.885164:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361248.885178:0:26036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.885187:0:26036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361248.885193:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3312:1875232144130560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361248.885195:0:26036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.885206:0:26036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.885231:0:26036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361248.885237:0:26036:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.885244:0:26036:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.885256:0:26036:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.885262:0:26036:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.885276:0:26036:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788361248.885278:0:26036:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788361248.885281:0:26036:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788361248.885303:0:26036:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788361248.885307:0:26036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788361248.885310:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361248.885315:0:26036:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:2.0:1788361248.885320:0:26036:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a8a8a582000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361248.885325:0:26036:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a8a8a581800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361248.885332:0:26036:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9a8a856e9800 21603276-4ada-4ef3-bed6-677f5b3076da 192.168.203.60@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 17179869244 stale:0 00000020:00080000:2.0:1788361248.885337:0:26036:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9a8a8559d800 a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 192.168.203.60@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 17179869270 stale:0 00000020:00080000:2.0:1788361248.885342:0:26036:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9a8ab7248000) has exports, disconnecting them 00000020:00080000:2.0:1788361248.885347:0:26036:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a8a8a582000), last request at 1788361248 00010000:00010000:0.0:1788361248.885348:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:2.0:1788361248.885354:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661282e 00010000:00010000:0.0:1788361248.885356:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361248.885365:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361248.885368:0:23202:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361248.885370:0:26036:0:(import.c:65:import_set_state_nolock()) ffff9a8a856ef000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788361248.885381:0:23202:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361248.885389:0:23202:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361248.885394:0:23202:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788361248.885397:0:23202:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788361248.885400:0:23202:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788361248.885406:0:24890:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361248.885413:0:24890:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361248.885419:0:23202:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.885421:0:24890:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1ba5c20) 00010000:00010000:0.0:1788361248.885428:0:23202:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1788361248.885432:0:24890:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.885443:0:24890:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361248.885451:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361248.885453:0:24890:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361248.885470:0:24890:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361248.885470:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ea00/0xf6a94c97d6612b1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612b22 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361248.885474:0:24890:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788361248.885478:0:24890:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788361248.885491:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361248.885493:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361248.885495:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361248.885499:0:24890:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361248.885506:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3312:1875232144130688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361248.885508:0:24890:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361248.885523:0:24890:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361248.885538:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361248.885571:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144130816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361248.885590:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361248.885611:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144130688 00000100:00100000:0.0:1788361248.885616:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144130688 00010000:00010000:2.0:1788361248.885620:0:24890:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d6612587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661258e expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361248.885638:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361248.885640:0:23200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144130816 00010000:00010000:2.0:1788361248.885641:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361248.885644:0:23200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144130816 00010000:00010000:2.0:1788361248.885645:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361248.885661:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000020:00080000:2.0:1788361248.885665:0:26036:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a8a582000): rc 0 00000020:00000080:2.0:1788361248.885683:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8a8a582000/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:0.0:1788361248.885683:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+17:3312:x1875232144130688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361248.885695:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:2.0:1788361248.885697:0:26036:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a8a8a581800), last request at 1788361248 00000020:00000080:2.0:1788361248.885702:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66126e5 00010000:00010000:0.0:1788361248.885707:0:23200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965600/0xf6a94c97d6612b22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6612b1b expref: 17 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361248.885710:0:26036:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a587000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788361248.885721:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:2.0:1788361248.885729:0:26036:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a8a581800): rc 0 00000020:00000080:2.0:1788361248.885739:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8a8a581800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788361248.885747:0:26036:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa998c6b53ae0 00000100:00100000:0.0:1788361248.885754:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+16:3312:x1875232144130688:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361248.885761:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788361248.885765:0:26036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788361248.885770:0:26036:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869195 gen 3 00000100:00100000:0.0:1788361248.885777:0:23200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788361248.885785:0:26036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361248.885786:0:23200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+15:3313:x1875232144130816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361248.885804:0:23200:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361248.885814:0:23200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d661258e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6612587 expref: 15 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361248.885824:0:23200:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361248.885852:0:23200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+14:3313:x1875232144130816:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361248.885858:0:23200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361248.885886:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144130816:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788361248.885896:0:26036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788361248.885899:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1788361248.885910:0:26036:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788361248.885914:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:0:1875232144130944:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788361248.885925:0:26036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788361248.885929:0:26036:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869189 gen 3 00010000:00010000:0.0:1788361248.885933:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361248.885945:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3312:1875232144130688:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1788361248.886010:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a582000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788361248.886056:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a581800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000004:00080000:2.0:1788361248.886064:0:26036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1788361248.886121:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a856ef000 for lustre-MDT0000 00000020:00000080:1.0:1788361248.886127:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a587000 for lustre-MDT0000 00000100:00080000:2.0:1788361248.886169:0:26036:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788361248.886180:0:26036:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788361248.886209:0:26036:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a8ab7248000) has no exports 00000100:00100000:3.0:1788361248.886579:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144131072:0@lo:9:umount.0 00000100:00100000:3.0:1788361248.886617:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361248.886773:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144131200:0@lo:9:umount.0 00000100:00100000:3.0:1788361248.886795:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361248.886894:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361248.886922:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144131072 00000100:00100000:2.0:1788361248.886928:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144131072 00000100:00100000:2.0:1788361248.886965:0:23848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144131200 00000100:00100000:2.0:1788361248.886968:0:23848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144131200 00000100:00100000:2.0:1788361248.886986:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788361248.886992:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144131072:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788361248.887010:0:23848:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66126f3 00000100:00080000:2.0:1788361248.887017:0:23848:0:(import.c:65:import_set_state_nolock()) ffff9a8aae463800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788361248.887041:0:23848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 4, last_transno is 17179869195 00000100:00100000:2.0:1788361248.887288:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144131072:12345-0@lo:9:umount.0 Request processed in 294us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361248.887296:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788361248.887311:0:23848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788361248.887317:0:23848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144131200:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788361248.887328:0:23848:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661284a 00000100:00080000:2.0:1788361248.887343:0:23848:0:(import.c:65:import_set_state_nolock()) ffff9a8aae467800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788361248.887363:0:23848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179869189 00000100:00100000:2.0:1788361248.887601:0:23848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144131200:12345-0@lo:9:umount.0 Request processed in 284us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361248.887608:0:23848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788361248.887624:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361248.887772:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361248.887788:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361248.887790:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361248.887794:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144131072:0@lo:9:umount.0 00000100:00080000:3.0:1788361248.887804:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a84584000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361248.887811:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361248.887812:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361248.887814:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144131200:0@lo:9:umount.0 00010000:00010000:0.0:1788361248.888027:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788361248.894594:0:26036:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a8ab7248000) has no exports 00000020:00000080:2.0:1788361248.938626:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66125e2 00000020:00000080:2.0:1788361248.938643:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8ac05c2000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788361248.938715:0:26036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788361248.938801:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361248.938811:0:26036:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361248.938816:0:26036:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9a8984a599c0) has no exports 00000020:00000080:3.0:1788361248.939112:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66125db 00000020:00000080:3.0:1788361248.939118:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8ac1cf2800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361248.939176:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac05c2000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788361248.939414:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1cf2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361248.939474:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361248.939561:0:26036:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788361248.939565:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8ab76df000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788361248.939567:0:26036:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab76df000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788361248.939573:0:26036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1788361249.248322:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361250.272315:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788361251.023108:0:25751:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 21603276-4ada-4ef3-bed6-677f5b3076da 00000001:00080000:3.0:1788361251.023127:0:25751:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869274 is committed 00000020:00000080:3.0:1788361251.023134:0:25751:0:(genops.c:906:class_export_put()) final put ffff9a8a856e9800/21603276-4ada-4ef3-bed6-677f5b3076da 00000001:00080000:3.0:1788361251.023153:0:25751:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869271 is committed 00000001:00080000:3.0:1788361251.023161:0:25751:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869272 is committed 00000001:00100000:3.0:1788361251.023167:0:25751:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 00000001:00080000:3.0:1788361251.023172:0:25751:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 17179869273 is committed 00000020:00000080:3.0:1788361251.023174:0:25751:0:(genops.c:906:class_export_put()) final put ffff9a8a8559d800/a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 00000020:00000080:0.0:1788361251.023327:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a856e9800/21603276-4ada-4ef3-bed6-677f5b3076da for lustre-MDT0000 00000020:00000080:0.0:1788361251.023386:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8559d800/a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 for lustre-MDT0000 00000020:00000080:0.0:1788361251.023414:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a856ed800 for lustre-MDT0000 00000020:00000080:0.0:1788361251.023418:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8aae466800 for lustre-MDT0000 00010000:00010000:0.0:1788361251.296270:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788361251.529824:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361251.529834:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8aae461800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788361251.529865:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 00000020:00000080:3.0:1788361251.529868:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8a89869800/a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 00000020:00000080:0.0:1788361251.529922:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae461800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788361251.530215:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a89869800/a3b5bfdf-7a4d-457e-bbc9-180c7e54f761 for lustre-OST0000 00000020:00000080:1.0:1788361251.530459:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8aae463800 for lustre-OST0000 00000020:00000080:1.0:1788361251.530466:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a89868800 for lustre-OST0000 00010000:00010000:0.0:1788361252.320352:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361253.344298:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361253.536336:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361253.536372:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144131584:0@lo:400:kworker.0 00000100:00100000:1.0:1788361253.536444:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361253.536493:0:24990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144131584 00000100:00100000:2.0:1788361253.536502:0:24990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144131584 00000100:00100000:2.0:1788361253.536546:0:24990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788361253.536555:0:24990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3314:x1875232144131584:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788361253.536563:0:24990:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361253.536598:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144131328:0@lo:400:kworker.0 00000100:00100000:2.0:1788361253.536614:0:24990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3314:x1875232144131584:12345-0@lo:400:kworker.0 Request processed in 57us (169us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361253.536624:0:24990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788361253.536666:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361253.536681:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144131456:0@lo:400:kworker.0 00000100:00100000:2.0:1788361253.536714:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361253.536745:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144131456 00000100:00100000:0.0:1788361253.536750:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144131456 00000100:00100000:0.0:1788361253.536781:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788361253.536786:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875232144131456:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788361253.536793:0:23215:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:1.0:1788361253.536825:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:0.0:1788361253.536830:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3312:x1875232144131456:12345-0@lo:400:kworker.0 Request processed in 40us (114us total) trans 0 rc -107/-107 00000100:00080000:1.0:1788361253.536832:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788361253.536840:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1788361253.536845:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788361253.537972:0:23205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144131328 00000100:00100000:3.0:1788361253.537981:0:23205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144131328 00000100:00100000:3.0:1788361253.538018:0:23205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788361253.538025:0:23205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+14:3311:x1875232144131328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361253.538120:0:23205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee+14:3311:x1875232144131328:12345-0@lo:400:kworker.0 Request processed in 96us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361253.538128:0:23205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788361253.538172:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144131328:0@lo:400:kworker.0 00000100:00080000:3.0:1788361253.540628:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361253.540731:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a10f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788361253.540737:0:3312:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788361253.540755:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a10f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361253.540759:0:3312:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 586 00000100:00080000:3.0:1788361253.540766:0:3312:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8a8a10f000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361253.540796:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac1567b80 x1875232144131712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361253.540946:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144131456:0@lo:400:kworker.0 00000100:00100000:2.0:1788361253.541199:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144131712:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788361253.541260:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361253.545647:0:23214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144131712 00000100:00100000:0.0:1788361253.545661:0:23214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144131712 00000100:00100000:0.0:1788361253.545712:0:23214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788361253.545720:0:23214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144131712:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788361253.545739:0:23214:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1788361253.550161:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361253.550170:0:3314:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 597 00000100:00080000:1.0:1788361253.550179:0:3314:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8a89249800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361253.550217:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a89859c8e00 x1875232144131840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361253.550300:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144131584:0@lo:400:kworker.0 00000100:00100000:3.0:1788361253.550524:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144131840:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788361253.550744:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361253.550900:0:23215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144131840 00000100:00100000:2.0:1788361253.550918:0:23215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144131840 00000100:00100000:2.0:1788361253.550955:0:23215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788361253.550962:0:23215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144131840:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788361253.550980:0:23215:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788361253.551036:0:23215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144131840:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 73us (291us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361253.551045:0:23215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:2.0:1788361253.551115:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361253.551120:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361253.551125:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144131840:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788361253.571489:0:23214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144131712:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 25764us (30224us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361253.571500:0:23214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788361253.571557:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a10f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361253.571561:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788361253.571564:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144131712:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:3.0:1788361253.578100:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361253.578110:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8aae463000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361253.578237:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae463000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788361253.578446:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8aae467800 for lustre-OST0001 00010000:00010000:0.0:1788361254.369707:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788361255.009112:0:26036:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8abfe5c120 - data ffff9a8aa9a86360/ffff9a8984a78000 00000020:01000000:3.0:1788361255.009237:0:26036:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a8a57f8a0 - data ffff9a8aa9a9fe58/ffff9a8aa95f4000 00000001:00000004:3.0:1788361255.016309:0:26036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 4, last_transno is 17179869274 00000100:00080000:3.0:1788361255.077600:0:26036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788361255.077609:0:26036:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869195 gen 4 00000004:00080000:3.0:1788361255.077712:0:26036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361255.077715:0:26036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788361255.078207:0:23235:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788361255.078212:0:23235:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x16:0x0] index 3 count 1 00000040:00080000:1.0:1788361255.078221:0:23235:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 4 count 2 00000100:00080000:3.0:1788361255.079247:0:26036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788361255.079251:0:26036:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869189 gen 4 00000004:00080000:3.0:1788361255.079295:0:26036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361255.079298:0:26036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788361255.079542:0:23237:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788361255.079547:0:23237:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x18:0x0] index 2 count 1 00000040:00080000:1.0:1788361255.079553:0:23237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 4 count 2 00000020:00000080:0.0:1788361255.141073:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66125aa 00000020:00000080:0.0:1788361255.141113:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8985b8e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361255.141869:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66125bf 00000020:00000080:0.0:1788361255.141875:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8a85daa800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788361255.141880:0:26036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788361255.141886:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361255.141894:0:26036:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361255.141911:0:26036:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9a8ab72499c0) has no exports 00000004:01000000:0.0:1788361255.142063:0:26036:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788361255.142071:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661260c 00000020:00000080:0.0:1788361255.142075:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8ab77b0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788361255.142078:0:26036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788361255.142082:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361255.142104:0:26036:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788361255.142107:0:26036:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9a8ab7460000) has no exports 00000020:00000080:0.0:1788361255.142113:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612605 00000020:00000080:0.0:1788361255.142116:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8a84580800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788361255.142461:0:26036:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788361255.142465:0:26036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788361255.142469:0:26036:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179869189 gen 5 00000004:00080000:0.0:1788361255.142474:0:26036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361255.142476:0:26036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361255.142503:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361255.142508:0:26036:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361255.142514:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66125f7 00000020:00000080:0.0:1788361255.142519:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8ac05a1000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788361255.142522:0:26036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788361255.142525:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361255.142529:0:26036:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788361255.142531:0:26036:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9a8ab74619c0) has no exports 00000020:00000080:0.0:1788361255.142534:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66125f0 00000020:00000080:0.0:1788361255.142536:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8a84585800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788361255.142856:0:26036:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788361255.142860:0:26036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788361255.142862:0:26036:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 17179869195 gen 5 00000004:00080000:0.0:1788361255.142865:0:26036:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788361255.142866:0:26036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361255.142887:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361255.142892:0:26036:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361255.142919:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361255.142923:0:26036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361255.142947:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66125c6 00000020:00000080:0.0:1788361255.142951:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8a85dae800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788361255.142955:0:26036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788361255.142958:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361255.142961:0:26036:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361255.142963:0:26036:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9a8ab724cd40) has no exports 00000020:00000080:0.0:1788361255.142980:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361255.142983:0:26036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788361255.142987:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66125cd 00000020:00000080:0.0:1788361255.142990:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8a85daa000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788361255.142996:0:26036:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a84154800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788361255.143000:0:26036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a84154800 3 00000020:01000004:0.0:1788361255.143003:0:26036:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8a84154800 from lustre-MDT0000 00000020:00000080:0.0:1788361255.143018:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361255.143021:0:26036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788361255.143023:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8985b8d000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788361255.143026:0:26036:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8985b8d000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788361255.143033:0:26036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788361255.143111:0:26036:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788361255.143114:0:26036:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788361255.143117:0:26036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788361255.143120:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361255.143123:0:26036:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788361255.143130:0:26036:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9a89864ba000 d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361255.143135:0:26036:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9a8ab724b380) has exports, disconnecting them 00000020:00080000:0.0:1788361255.143138:0:26036:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a89864ba000), last request at 1788361185 00000020:00000080:0.0:1788361255.143151:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612572 00000020:00010000:0.0:1788361255.143154:0:26036:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a89864ba000: total 8 00000100:00080000:0.0:1788361255.143158:0:26036:0:(import.c:65:import_set_state_nolock()) ffff9a89864b8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788361255.143174:0:26036:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a89864ba000): rc 0 00000020:00080000:0.0:1788361255.143186:0:26036:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9a8ab724b380) has no exports 00000020:00000080:1.0:1788361255.143286:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8985b8e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361255.143297:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85daa800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788361255.143302:0:36:0:(genops.c:906:class_export_put()) final put ffff9a8abc485800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361255.143304:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abc485800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788361255.143307:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361255.143413:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab77b0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788361255.143418:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84580800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361255.143422:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a84584000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788361255.143426:0:36:0:(genops.c:906:class_export_put()) final put ffff9a8a84587800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361255.143428:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84587800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788361255.143431:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361255.143459:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac05a1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788361255.143464:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84585800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361255.143468:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a84584800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788361255.143471:0:36:0:(genops.c:906:class_export_put()) final put ffff9a8a84581000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788361255.143473:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84581000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788361255.143477:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361255.143531:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85dae800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788361255.143535:0:36:0:(genops.c:906:class_export_put()) final put ffff9a8a85dac000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788361255.143537:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85dac000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788361255.143541:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788361255.143677:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85daa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788361255.143772:0:23208:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a8a9837e600:23208] 2 exiting: rc = 0 00000100:00100000:2.0:1788361255.143850:0:23206:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a8ab6ca2800:23206] 1 exiting: rc = 0 00000020:00010000:3.0:1788361255.144128:0:23201:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a89864ba000: total 0 00010000:00010000:3.0:1788361255.144132:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361255.144159:0:23201:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a89864ba000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788361255.144184:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab65cf400/0xf6a94c97d66126d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66126c9 expref: 9 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361255.144212:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8abeac9800/0xf6a94c97d66127ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66127e8 expref: 8 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361255.144221:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab65ce800/0xf6a94c97d6612580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6612579 expref: 7 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361255.144230:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d6612819 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6612812 expref: 6 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361255.144239:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8e00/0xf6a94c97d6612b06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6612aff expref: 5 pid: 23206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361255.144248:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8abeac8400/0xf6a94c97d6612b14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6612b0d expref: 4 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361255.144259:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d6612698 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6612691 expref: 3 pid: 23208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361255.144269:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964000/0xf6a94c97d66126a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661269f expref: 2 pid: 23205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361255.144278:0:23201:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a89864ba000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788361255.144288:0:23201:0:(genops.c:906:class_export_put()) final put ffff9a89864ba000/d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee 00010000:00010000:3.0:1788361255.144299:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361255.144300:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361255.144302:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361255.144320:0:23205:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a8ab6ca3e00:23205] 0 exiting: rc = 1 00000020:00000080:3.0:1788361255.144350:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89864ba000/d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee for MGS 00000020:00000080:3.0:1788361255.144372:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89864b8800 for MGS 00000100:00100000:1.0:1788361255.146569:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146617:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146633:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146639:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146644:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146649:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146655:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146660:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146665:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146670:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146676:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146681:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146686:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146691:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146695:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146700:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146705:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146709:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146714:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146719:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146724:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146728:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146734:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146738:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146743:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146747:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146752:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146757:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146762:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146783:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146788:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146792:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146797:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146802:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146806:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146811:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146817:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146822:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146827:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146831:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146837:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146841:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146847:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146852:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146857:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146862:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146866:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146872:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146877:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146882:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146887:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146892:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146897:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146902:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146907:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146912:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146917:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146922:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146928:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146933:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146938:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146944:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146949:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.146955:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788361255.147530:0:26036:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788361255.147534:0:26036:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1788361255.148345:0:26036:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a90bc00c0 - data ffff9a8ab06626c0/ffff9a8987b18800 00000020:01000000:1.0:1788361255.148449:0:26036:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8ac1ce7780 - data ffff9a8ab0746360/ffff9a89852e0000 00000020:00000080:1.0:1788361255.148963:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612556 00000020:00000080:1.0:1788361255.148971:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8986fe1800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788361255.149016:0:26036:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a84154800 from MGS, refs=2 00000020:01000004:1.0:1788361255.149019:0:26036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a84154800 2 00000020:01000004:1.0:1788361255.149022:0:26036:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8a84154800 from MGS 00000020:00000080:1.0:1788361255.149041:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361255.149047:0:26036:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788361255.149050:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8986fe0800/MGS 00000020:00000080:1.0:1788361255.149053:0:26036:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8986fe0800/MGS for MGS 00000020:01000000:1.0:1788361255.149060:0:26036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788361255.149144:0:26036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788361255.149148:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361255.149154:0:26036:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788361255.149159:0:26036:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a8a9efdb800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361255.149164:0:26036:0:(genops.c:1574:class_disconnect_exports()) OBD device 10 (ffff9a8a84f10000) has exports, disconnecting them 00000020:00080000:1.0:1788361255.149168:0:26036:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a8a9efdb800), last request at 1788361186 00000020:00000080:1.0:1788361255.149172:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612644 00000020:00080000:1.0:1788361255.149180:0:26036:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a9efdb800): rc 0 00000020:00000080:1.0:1788361255.149184:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8a9efdb800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788361255.149262:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8986fe1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361255.149953:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efdb800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788361255.152134:0:26036:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788361255.152142:0:26036:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361255.152147:0:26036:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788361255.152154:0:26036:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361255.152291:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361255.152300:0:26036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788361255.152305:0:26036:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a84154800 1 00000020:00000080:0.0:1788361255.152311:0:26036:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612548 00000020:00000080:0.0:1788361255.152319:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8986fe2000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788361255.152323:0:26036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788361255.152327:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361255.152330:0:26036:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361255.152333:0:26036:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9a8a90bf4d40) has no exports 00000020:00000080:3.0:1788361255.153159:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a9efdc000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788361255.153169:0:8:0:(genops.c:906:class_export_put()) final put ffff9a8ab74b2000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788361255.153173:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab74b2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788361255.153178:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788361255.153235:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8986fe2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361255.164766:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361255.164779:0:26036:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788361255.164783:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8a84152800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361255.164788:0:26036:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84152800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788361255.164795:0:26036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788361255.164973:0:26036:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8a84156800 00000020:01000000:3.0:1788361255.164992:0:26036:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788361255.164996:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361255.164999:0:26036:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788361255.165002:0:26036:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9a8ab7464d40) has no exports 00000100:00100000:3.0:1788361255.165071:0:24990:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a8a883be600:24990] 3 exiting: rc = 0 00000100:00100000:2.0:1788361255.165223:0:23215:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a8ac06ee800:23215] 2 exiting: rc = 0 00000100:00100000:1.0:1788361255.165270:0:23213:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a8ac06efa00:23213] 0 exiting: rc = 1 00000100:00100000:0.0:1788361255.167351:0:23214:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a8ac06efc00:23214] 1 exiting: rc = 0 00000100:00100000:3.0:1788361255.167523:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167531:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167536:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167541:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167550:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167557:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167564:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167570:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167574:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167579:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167587:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167594:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167599:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167618:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167623:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167637:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167643:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167647:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167652:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167657:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167662:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167666:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167671:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167675:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167680:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167684:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167689:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167695:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167700:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167704:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167709:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167713:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167717:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167722:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167726:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167732:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167736:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167741:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167746:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167751:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167756:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167760:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167765:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167770:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167774:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167779:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167783:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167787:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167797:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167802:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167807:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167813:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167818:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167823:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167829:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167834:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167839:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167844:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167850:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167855:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167860:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167865:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167871:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.167877:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.172223:0:23217:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a8a856b2400:23217] 1 exiting: rc = 0 00000100:00100000:1.0:1788361255.172251:0:23216:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a8ac06ef600:23216] 0 exiting: rc = 1 00000100:00100000:0.0:1788361255.172802:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172815:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172825:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172832:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172838:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172844:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172848:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172853:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172859:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172864:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172869:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172874:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172878:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172883:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172888:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172954:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172961:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172965:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172980:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172985:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172989:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172994:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.172999:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173003:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173007:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173012:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173016:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173021:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173031:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173038:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173043:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173048:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173079:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173139:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173146:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173151:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173155:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173159:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173164:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173169:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173173:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173177:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173182:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173187:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173192:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173197:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173202:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173206:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173212:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173217:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173222:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173227:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173233:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173246:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173251:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173255:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173260:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173264:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173269:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173273:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173278:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173282:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173286:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.173291:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361255.173788:0:23219:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a8ac06ef800:23219] 1 exiting: rc = 0 00000100:00100000:3.0:1788361255.173960:0:23218:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a8a837b3200:23218] 0 exiting: rc = 1 00000100:00100000:0.0:1788361255.174051:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174058:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174149:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174157:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174164:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174170:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174176:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174183:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174200:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174207:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174212:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174218:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174224:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174229:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174234:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174239:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174244:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174249:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174254:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174259:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174276:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174288:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174293:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174298:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174351:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174357:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174363:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174368:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174373:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174379:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174384:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174390:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174408:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174415:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174420:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174426:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174431:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174437:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174442:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174448:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174454:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174459:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174464:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174470:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174486:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174492:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174498:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174504:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174509:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174514:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174520:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174530:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174538:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174579:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174586:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174591:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174611:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174617:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174623:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174644:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174649:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174654:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174659:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.174665:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.182743:0:23221:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a8a856a1800:23221] 1 exiting: rc = 0 00000100:00100000:3.0:1788361255.182867:0:23220:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a8a99441000:23220] 0 exiting: rc = 1 00000100:00100000:0.0:1788361255.182914:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182922:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182928:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182932:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182938:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182945:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182950:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182955:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182961:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182966:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182971:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182976:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182980:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182985:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182990:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182994:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.182999:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183004:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183008:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183012:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183017:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183022:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183027:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183032:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183037:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183042:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183047:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183052:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183058:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183063:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183079:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183103:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183112:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183118:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183124:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183132:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183140:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183151:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183160:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183168:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183175:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183181:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183188:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183199:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183208:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183219:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183234:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183241:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183246:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183253:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183259:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183263:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183268:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183274:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183279:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183284:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183289:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183294:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183299:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183303:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183307:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183312:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183317:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183322:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361255.183621:0:23222:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a8a856a0a00:23222] 0 exiting: rc = 1 00000100:00100000:1.0:1788361255.183714:0:23223:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a8a856a0000:23223] 1 exiting: rc = 0 00000100:00100000:0.0:1788361255.183862:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183874:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183880:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183885:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183891:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183896:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183901:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183906:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183911:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183916:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183921:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183926:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183931:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183936:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183940:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183945:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183950:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183967:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183973:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183978:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183982:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183987:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183992:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.183997:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184002:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184007:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184012:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184017:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184021:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184026:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184031:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184036:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184041:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184045:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184050:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184054:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184064:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184069:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184074:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184079:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184197:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184203:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184209:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184214:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184219:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184223:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184228:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184233:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184238:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184243:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184248:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184253:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184258:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184262:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184267:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184272:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184277:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184281:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184286:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184291:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184296:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184300:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184305:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184310:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184840:0:23224:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a8a856a0200:23224] 0 exiting: rc = 1 00000100:00100000:2.0:1788361255.184888:0:23225:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a8a856a1400:23225] 1 exiting: rc = 0 00000100:00100000:0.0:1788361255.184913:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184922:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184929:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184937:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184944:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184950:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184963:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184968:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184972:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184976:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184980:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184984:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184989:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184994:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.184999:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185003:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185008:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185012:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185017:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185021:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185025:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185030:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185035:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185039:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185043:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185048:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185053:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185057:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185062:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185066:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185070:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185075:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185079:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185105:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185112:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185116:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185120:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185125:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185129:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185133:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185138:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185150:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185155:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185159:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185164:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185169:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185174:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185179:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185183:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185188:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185192:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185197:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185201:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185206:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185211:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185215:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185220:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185224:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185229:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185234:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185239:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185244:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185248:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185253:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361255.185719:0:23227:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a8a89298a00:23227] 1 exiting: rc = 0 00000100:00100000:2.0:1788361255.185746:0:23226:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a89858a9000:23226] 0 exiting: rc = 1 00000100:00100000:0.0:1788361255.186324:0:23228:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a89858a9c00:23228] 2 exiting: rc = 0 00000100:00100000:2.0:1788361255.186383:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186390:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186396:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186402:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186407:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186424:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186431:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186437:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186444:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186451:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186456:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186462:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186467:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186473:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186479:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186484:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186489:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186495:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186500:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186517:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186523:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186528:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186534:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186539:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186545:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186551:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186557:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186563:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186568:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186589:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186597:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186603:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186608:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186614:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186620:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186637:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186643:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186649:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186655:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186660:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186666:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186672:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186678:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186684:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186689:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186694:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186700:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186706:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186711:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186717:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186723:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186729:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186735:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186741:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186755:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186761:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186766:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186770:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186775:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186780:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186785:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186790:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186795:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361255.186801:0:26036:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788361255.193055:0:26036:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361255.193065:0:26036:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788361255.193069:0:26036:0:(genops.c:906:class_export_put()) final put ffff9a8985b8f800/MDS_uuid 00000020:00000080:2.0:1788361255.193073:0:26036:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8985b8f800/MDS_uuid for MDS 00000020:01000000:2.0:1788361255.193077:0:26036:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788361255.193268:0:26036:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788361255.392345:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361256.417388:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361256.966581:0:26193:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788361256.979912:0:26193:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788361256.980021:0:26193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361256.980339:0:26193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361256.980347:0:26193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361256.980354:0:26193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.980417:0:26193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788361256.980425:0:26193:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788361256.980456:0:26193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361256.980461:0:26193:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788361256.980466:0:26193:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788361256.980473:0:26193:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a10f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788361256.980478:0:26193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361256.980485:0:26193:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788361256.980488:0:26193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788361256.981232:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361256.981241:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361256.981251:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361256.981255:0:23201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361256.981264:0:23201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361256.981271:0:23201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361256.981286:0:23201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361256.981288:0:23201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788361256.981291:0:23201:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788361256.981331:0:23201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361256.981339:0:23201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361256.981353:0:26193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981364:0:26193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981371:0:26193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981379:0:26193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361256.981380:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361256.981395:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66126c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66126d0 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981403:0:26193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361256.981409:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361256.981413:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981415:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361256.981421:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfa00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361256.981424:0:23201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981428:0:26193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361256.981433:0:23201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981438:0:26193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361256.981444:0:23201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981450:0:26193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361256.981455:0:23201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361256.981461:0:23201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788361256.981461:0:26193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981477:0:26193:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788361256.981482:0:26193:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788361256.981487:0:23201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361256.981494:0:26193:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1788361256.981495:0:23201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361256.981516:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788361256.981516:0:26193:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788361256.981522:0:26193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:3.0:1788361256.981525:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cfa00/0xf6a94c97d661269f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66126a6 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981533:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361256.981539:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361256.981540:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361256.981543:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361256.981547:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361256.981552:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361256.981556:0:23202:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981564:0:23202:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361256.981568:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:00010000:0.0:1788361256.981572:0:23202:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361256.981578:0:23202:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788361256.981581:0:23202:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788361256.981583:0:23202:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1788361256.981585:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144131968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361256.981605:0:23202:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981625:0:23202:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361256.981634:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981640:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e200/0xf6a94c97d6612b0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6612b14 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361256.981651:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361256.981653:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361256.981662:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788361256.981671:0:26193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000100:00100000:2.0:1788361256.981676:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1788361256.981680:0:26193:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788361256.981685:0:26193:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a8984a58000) has no exports 00000020:00080000:0.0:1788361256.981709:0:26193:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a8984a58000) has no exports 00000100:00100000:2.0:1788361256.981759:0:23199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144131968 00000100:00100000:2.0:1788361256.981766:0:23199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144131968 00000100:00100000:2.0:1788361256.981801:0:23199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788361256.981807:0:23199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1875232144131968:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788361256.981814:0:23199:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361256 with bad export cookie 17773821619414836594 00000100:00100000:3.0:1788361256.982976:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144132096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361256.983024:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361256.983065:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361256.983073:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144132224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361256.983099:0:23198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144132096 00000100:00100000:1.0:1788361256.983106:0:23198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144132096 00000100:00100000:3.0:1788361256.983111:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361256.983127:0:23198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144132224 00000100:00100000:1.0:1788361256.983130:0:23198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144132224 00000100:00100000:1.0:1788361256.983141:0:23198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788361256.983146:0:23198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1875232144132096:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788361256.983152:0:23198:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361256 with bad export cookie 17773821619414836594 00000100:00100000:1.0:1788361256.983324:0:23198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1875232144132096:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (236us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361256.983331:0:23198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788361256.983332:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361256.983337:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9a89864bc000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788361256.983340:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1788361256.983348:0:23198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788361256.983352:0:23198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1875232144132224:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788361256.983356:0:23198:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361256 with bad export cookie 17773821619414836594 00000100:00100000:1.0:1788361256.983380:0:23198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3311:x1875232144132224:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (269us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788361256.983386:0:23198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000020:01000000:0.0:1788361256.983450:0:26193:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a90bc0720 - data ffff9a8ab5342438/ffff9a8987b1b400 00000020:01000000:0.0:1788361256.983584:0:26193:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a90bfa3c0 - data ffff9a8984c62360/ffff9a8985edd000 00000100:00100000:2.0:1788361256.992256:0:23199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3313:x1875232144131968:12345-0@lo:103:ldlm_bl.0 Request processed in 10441us (10576us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361256.992270:0:23199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788361256.992433:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788361257.002552:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.160@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788361257.002557:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788361257.002567:0:3311:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ac1567800 x1875232144131968/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361272 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361257.002580:0:3311:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ac1566680 x1875232144132096/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361272 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361257.002589:0:3311:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a843e9f80 x1875232144132224/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361272 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788361257.002640:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788361257.002643:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788361257.002644:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788361257.002649:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9a89864bc000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361257.002654:0:3311:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 575 00000100:00080000:3.0:1788361257.002662:0:3311:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a89864bc000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361257.002691:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac1564700 x1875232144132352/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361257.002760:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3310:1875232144132352:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1788361257.002813:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875232144132352 offset 0 length 520: 4 00000100:00100000:3.0:1788361257.002892:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144132224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361257.002898:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3311:1875232144132096:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788361257.003301:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a89864bc000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:0.0:1788361257.003311:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3313:1875232144131968:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1788361257.006000:0:26193:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788361257.025051:0:26193:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66126b4 00000020:00000080:2.0:1788361257.025061:0:26193:0:(genops.c:906:class_export_put()) final put ffff9a8a8559a800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788361257.025111:0:26193:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a83778000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788361257.025115:0:26193:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a83778000 2 00000020:01000004:2.0:1788361257.025118:0:26193:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8a83778000 from lustre-OST0000 00000020:00000080:2.0:1788361257.025143:0:26193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361257.025152:0:26193:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788361257.025155:0:26193:0:(genops.c:906:class_export_put()) final put ffff9a8a85599000/lustre-OST0000_UUID 00000020:00000080:2.0:1788361257.025158:0:26193:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85599000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788361257.025164:0:26193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788361257.025200:0:26193:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788361257.025204:0:26193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788361257.025207:0:26193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361257.025212:0:26193:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788361257.025219:0:26193:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a8a8a10b000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361257.025225:0:26193:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9a8a90bf3380) has exports, disconnecting them 00000020:00080000:2.0:1788361257.025231:0:26193:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a8a8a10b000), last request at 1788361196 00000020:00000080:2.0:1788361257.025237:0:26193:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66126de 00000020:00080000:2.0:1788361257.025260:0:26193:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a8a10b000): rc 0 00000020:00000080:1.0:1788361257.025265:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8559a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788361257.025266:0:26193:0:(genops.c:906:class_export_put()) final put ffff9a8a8a10b000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788361257.025282:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a10b000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788361257.026144:0:26193:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788361257.026150:0:26193:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361257.026154:0:26193:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788361257.026159:0:26193:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361257.026270:0:26193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361257.026272:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a10f000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788361257.026276:0:26193:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788361257.026281:0:26193:0:(genops.c:906:class_export_put()) final put ffff9a8aae464800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788361257.026284:0:26193:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae464800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788361257.026292:0:26193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788361257.026334:0:26193:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a83778000 1 00000020:00000080:3.0:1788361257.026338:0:26193:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612683 00000020:00000080:3.0:1788361257.026342:0:26193:0:(genops.c:906:class_export_put()) final put ffff9a8ab745e800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788361257.026356:0:26193:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788361257.026359:0:26193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361257.026362:0:26193:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361257.026365:0:26193:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a8a90bf19c0) has no exports 00000020:00000080:1.0:1788361257.026405:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab745e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788361257.042729:0:26193:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361257.042741:0:26193:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788361257.042746:0:26193:0:(genops.c:906:class_export_put()) final put ffff9a8a8377d000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788361257.042751:0:26193:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8377d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788361257.042761:0:26193:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788361257.042995:0:26193:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8a8377b800 00000020:02000400:1.0:1788361257.043041:0:26193:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788361257.441275:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361258.464276:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361258.657783:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361258.657810:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788361258.657813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361258.657817:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361258.657822:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361258.657830:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 643 00000100:00080000:3.0:1788361258.657836:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361258.657842:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8a89249800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361258.657884:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac1566680 x1875232144132480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361258.658139:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144132480:0@lo:38:kworker.0 00000400:00000100:2.0:1788361258.658193:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144132480 offset 0 length 520: 4 00000020:01000004:1.0:1788361258.831457:0:26343:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788361258.843063:0:26343:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788361258.843224:0:26343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.843239:0:26343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.843246:0:26343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.843269:0:26343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.843286:0:26343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788361258.843292:0:26343:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1788361258.843314:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361258.843321:0:23202:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.843328:0:23202:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361258.843332:0:23202:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.843339:0:23202:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361258.843347:0:23202:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361258.843353:0:23202:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361258.843355:0:23202:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788361258.843357:0:23202:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788361258.843369:0:23202:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a89864bc000 00010000:00010000:2.0:1788361258.843373:0:23202:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.843380:0:23202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6612812 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6612819 expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.843400:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361258.843402:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361258.843404:0:23202:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361258.843417:0:26343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361258.843428:0:26343:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ac1566680 x1875232144132480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788361273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361258.843444:0:26343:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788361258.843472:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361258.843477:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788361258.843481:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144132480:0@lo:38:kworker.0 00000100:00080000:2.0:1788361258.843506:0:26343:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788361258.843510:0:26343:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788361258.843514:0:26343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361258.843515:0:26343:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788361258.843519:0:26343:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788361258.845082:0:26343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.845117:0:26343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.846591:0:26343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.846608:0:26343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.846644:0:26343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361258.846652:0:26343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.846659:0:26343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.846666:0:26343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.846672:0:26343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361258.846692:0:26343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788361258.846696:0:26343:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788361258.846722:0:26343:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788361258.846726:0:26343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788361258.846731:0:26343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361258.846737:0:26343:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788361258.846741:0:26343:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a8a90bf0000) has no exports 00000020:00080000:2.0:1788361258.846767:0:26343:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a8a90bf0000) has no exports 00010000:00010000:3.0:1788361258.847223:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361258.847232:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361258.847240:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361258.847244:0:23201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361258.847253:0:23201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361258.847261:0:23201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361258.847266:0:23201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361258.847269:0:23201:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788361258.847272:0:23201:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788361258.847285:0:23201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a89864bc000 00010000:00010000:3.0:1788361258.847288:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361258.847303:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1e000/0xf6a94c97d66127e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d66127ef expref: -99 pid: 24515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361258.847316:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361258.847319:0:23201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361258.847325:0:23201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361258.847327:0:23201:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361258.847334:0:23201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361258.847340:0:23201:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361258.847345:0:23201:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788361258.847347:0:23201:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788361258.847348:0:23201:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788361258.847354:0:23201:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a89864bc000 00010000:00010000:3.0:1788361258.847356:0:23201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361258.847363:0:23201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985965200/0xf6a94c97d6612aff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6612b06 expref: -99 pid: 23210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361258.847374:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361258.847376:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361258.847383:0:23201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788361258.849410:0:26343:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8abc490c60 - data ffff9a8ab53f46c0/ffff9a8987b1e400 00000020:01000000:2.0:1788361258.849557:0:26343:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a8341b2a0 - data ffff9a8984f7dbd0/ffff9a8984a7b800 00010000:00010000:0.0:1788361258.849679:0:24890:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788361258.856410:0:26343:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788361258.893808:0:26343:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66127fd 00000020:00000080:1.0:1788361258.893818:0:26343:0:(genops.c:906:class_export_put()) final put ffff9a8ab74b7000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788361258.893838:0:26343:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8986fe2800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788361258.893842:0:26343:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8986fe2800 2 00000020:01000004:1.0:1788361258.893845:0:26343:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8986fe2800 from lustre-OST0001 00000020:00000080:1.0:1788361258.893873:0:26343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361258.893882:0:26343:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788361258.893885:0:26343:0:(genops.c:906:class_export_put()) final put ffff9a8aae462000/lustre-OST0001_UUID 00000020:00000080:1.0:1788361258.893888:0:26343:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae462000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788361258.893894:0:26343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788361258.893987:0:26343:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee->MGS 00010000:00010000:1.0:1788361258.894000:0:26343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6612691 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6612698 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361258.894011:0:26343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6612691 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6612698 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361258.894018:0:26343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788361258.894021:0:26343:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788361258.894024:0:26343:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788361258.894036:0:26343:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a89864bc000 00010000:00010000:1.0:1788361258.894048:0:26343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6612691 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6612698 expref: -99 pid: 23845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361258.894061:0:26343:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6612579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6612580 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361258.894068:0:26343:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6612579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6612580 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361258.894073:0:26343:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361258.894075:0:26343:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788361258.894077:0:26343:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788361258.894107:0:26343:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a89864bc000 00010000:00010000:1.0:1788361258.894110:0:26343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6612579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6612580 expref: -99 pid: 23195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361258.894136:0:26343:0:(import.c:65:import_set_state_nolock()) ffff9a89864bc000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788361258.894140:0:26343:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788361258.894142:0:26343:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788361258.894143:0:26343:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788361258.894147:0:26343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788361258.894156:0:26343:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ac1564700 x1875232144132352/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788361267 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788361258.894167:0:26343:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788361258.894170:0:26343:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00000020:00000080:0.0:1788361258.894322:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab74b7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788361258.894404:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1564700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee:3310:1875232144132352:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:1.0:1788361258.894498:0:26343:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788361258.894506:0:26343:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612564 00000020:00000080:1.0:1788361258.894510:0:26343:0:(genops.c:906:class_export_put()) final put ffff9a8985b8b000/d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee 00000020:01000000:1.0:1788361258.894524:0:26343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.160@tcp (flags='') 00000020:00000080:1.0:1788361258.894529:0:26343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361258.894534:0:26343:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.160@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361258.894537:0:26343:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9a8984a5b380) has no exports 00000020:00000080:0.0:1788361258.894588:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8985b8b000/d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee for MGC192.168.203.160@tcp 10000000:01000000:2.0:1788361258.894634:0:23210:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788361258.894697:0:26343:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.160@tcp: client import never connected 00000100:00080000:1.0:1788361258.894742:0:26343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788361258.894744:0:26343:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788361258.894746:0:26343:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788361258.894747:0:26343:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788361258.894815:0:26343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361258.894819:0:26343:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.160@tcp (uuid d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee) 00000020:01000000:1.0:1788361258.894824:0:26343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788361258.894827:0:26343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361258.894830:0:26343:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788361258.894834:0:26343:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a8a84580000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361258.894839:0:26343:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9a8985c63380) has exports, disconnecting them 00000020:00080000:1.0:1788361258.894847:0:26343:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a8a84580000), last request at 1788361207 00000020:00000080:1.0:1788361258.894852:0:26343:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6612827 00000020:00080000:1.0:1788361258.894890:0:26343:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a84580000): rc 0 00000020:00000080:1.0:1788361258.894894:0:26343:0:(genops.c:906:class_export_put()) final put ffff9a8a84580000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788361258.896646:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89864bc000 for MGC192.168.203.160@tcp 00000020:00000080:0.0:1788361258.896661:0:8:0:(genops.c:906:class_export_put()) final put ffff9a89864be000/d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee 00000020:00000080:0.0:1788361258.896665:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89864be000/d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee for MGC192.168.203.160@tcp 00000020:01000000:0.0:1788361258.896672:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.160@tcp (d4ae25bd-0ded-4f63-afa8-a6e6c1d0f7ee) 00000020:00000080:0.0:1788361258.898062:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84580000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788361258.933135:0:26343:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788361258.933144:0:26343:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361258.933149:0:26343:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788361258.933157:0:26343:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788361258.933224:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a89249800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788361258.933270:0:23202:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788361258.933427:0:23201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788361258.933513:0:24890:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788361258.933685:0:23196:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a8a85e99200:23196] 0 exiting: rc = 1 00000100:00100000:2.0:1788361258.933763:0:23197:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a8a85e98a00:23197] 1 exiting: rc = 0 00000100:00100000:1.0:1788361258.933809:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361258.934227:0:25227:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a8ab76a1600:25227] 3 exiting: rc = 0 00000100:00100000:2.0:1788361258.934333:0:23198:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a8a878ca000:23198] 0 exiting: rc = 1 00000100:00100000:2.0:1788361258.934392:0:23199:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a8ac09cea00:23199] 1 exiting: rc = 0 00000100:00100000:3.0:1788361258.934540:0:23200:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a8ac09ce800:23200] 2 exiting: rc = 0 00000100:00100000:1.0:1788361258.934614:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934622:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934628:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934634:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934639:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934644:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934650:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934656:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934660:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934665:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934680:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934685:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934692:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934699:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934707:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934713:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934719:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934723:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934729:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934734:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934739:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934744:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934749:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934755:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934761:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934766:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934771:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934775:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934779:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934785:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934789:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934794:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934798:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934803:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934808:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934813:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934818:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934823:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934828:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934834:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934839:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934845:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934850:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934855:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934859:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934873:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934877:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934883:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934888:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934894:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934899:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934904:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934909:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934914:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934919:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934924:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934929:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934934:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934939:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934945:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934950:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934957:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934963:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.934969:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788361258.941350:0:26343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361258.941362:0:26343:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788361258.941367:0:26343:0:(genops.c:906:class_export_put()) final put ffff9a8a83cfc800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788361258.941383:0:26343:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83cfc800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788361258.941389:0:26343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1788361258.941429:0:26343:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8986fe2800 1 00000020:00000080:0.0:1788361258.941435:0:26343:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66127e1 00000020:00000080:0.0:1788361258.941442:0:26343:0:(genops.c:906:class_export_put()) final put ffff9a8a8559f000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788361258.941494:0:26343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788361258.941500:0:26343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361258.941505:0:26343:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361258.941509:0:26343:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a8ab7463380) has no exports 00000020:00000080:3.0:1788361258.941934:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8559f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788361258.958824:0:26343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361258.958844:0:26343:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788361258.958851:0:26343:0:(genops.c:906:class_export_put()) final put ffff9a8a84583000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788361258.958855:0:26343:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84583000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788361258.958862:0:26343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788361258.959050:0:26343:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8a84582000 00000020:01000000:1.0:1788361258.959073:0:26343:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788361258.959078:0:26343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361258.959082:0:26343:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788361258.959109:0:26343:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9a8984a5cd40) has no exports 00000020:00000080:1.0:1788361258.959134:0:26343:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361258.959140:0:26343:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788361258.959142:0:26343:0:(genops.c:906:class_export_put()) final put ffff9a8ab7459000/OSS_uuid 00000020:00000080:1.0:1788361258.959145:0:26343:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab7459000/OSS_uuid for OSS 00000020:01000000:1.0:1788361258.959149:0:26343:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788361258.959225:0:23849:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a8a909e9000:23849] 2 exiting: rc = 0 00000100:00100000:1.0:1788361258.959328:0:23933:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a8a909e8e00:23933] 3 exiting: rc = 0 00000100:00080000:0.0:1788361258.959988:0:23209:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788361258.960144:0:23848:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a8a909e9400:23848] 1 exiting: rc = 0 00000100:00100000:2.0:1788361258.960267:0:23847:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a8a82b00800:23847] 0 exiting: rc = 1 00000100:00100000:1.0:1788361258.960427:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960436:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960441:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960446:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960452:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960457:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960462:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960467:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960473:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960480:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960485:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960490:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960496:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960501:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960507:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960513:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960519:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960524:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960530:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960534:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960542:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960557:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960565:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960571:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960577:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960583:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960588:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960593:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960610:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960616:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960621:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960627:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960632:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960647:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960652:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960659:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960665:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960671:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960677:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960682:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960687:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960693:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960698:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960703:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960709:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960715:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960721:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960731:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960737:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960742:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960748:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960753:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960761:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960766:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960771:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960776:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960782:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960787:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960793:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960799:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960804:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960810:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960815:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.960820:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.961783:0:23851:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a8a90bd0200:23851] 1 exiting: rc = 0 00000100:00100000:0.0:1788361258.961924:0:23850:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a8a90bd1000:23850] 0 exiting: rc = 1 00000100:00100000:1.0:1788361258.962058:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962065:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962070:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962075:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962155:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962160:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962165:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962170:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962175:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962180:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962185:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962190:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962196:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962205:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962211:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962217:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962222:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962228:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962233:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962238:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962242:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962247:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962253:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962259:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962265:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962270:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962275:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962396:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962402:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962407:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962412:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962417:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962422:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962427:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962433:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962438:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962443:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962449:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962454:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962467:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962472:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962477:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962483:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962488:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962493:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962498:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962503:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962508:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962514:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962519:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962525:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962531:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962536:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962541:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962546:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962551:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962556:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962561:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962567:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962572:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962577:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962582:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962587:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.962929:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964232:0:23853:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a8a83d4ae00:23853] 1 exiting: rc = 0 00000100:00100000:3.0:1788361258.964427:0:23854:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a8a83d4ba00:23854] 2 exiting: rc = 0 00000100:00100000:2.0:1788361258.964690:0:23852:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a8a83d4b400:23852] 0 exiting: rc = 1 00000100:00100000:3.0:1788361258.964798:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964806:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964813:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964819:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964825:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964831:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964838:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964844:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964850:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964856:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964862:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964881:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964888:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964893:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964899:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964904:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964910:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964915:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964921:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964926:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964932:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964937:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964943:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964958:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964967:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964973:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964978:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964984:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.964991:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965009:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965014:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965020:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965026:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965032:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965038:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965043:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965049:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965054:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965060:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965066:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965072:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965077:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965114:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965122:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965128:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965134:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965139:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965158:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965166:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965171:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965177:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965182:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965187:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965193:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965199:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965204:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965211:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965217:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965222:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965227:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965232:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965237:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965242:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361258.965247:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.971804:0:23855:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a8a83d4a800:23855] 0 exiting: rc = 1 00000100:00100000:3.0:1788361258.971979:0:23856:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a8a84968200:23856] 1 exiting: rc = 0 00000100:00100000:2.0:1788361258.972061:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972068:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972073:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972077:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972082:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972111:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972115:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972120:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972127:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972132:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972137:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972142:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972147:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972155:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972161:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972166:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972171:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972176:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972181:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972188:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972193:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972198:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972205:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972209:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972214:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972219:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972224:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972229:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972246:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972251:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972256:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972261:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972266:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972271:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972275:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972341:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972346:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972353:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972372:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972377:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972383:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972388:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972392:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972397:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972402:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972407:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972412:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972416:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972421:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972426:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972431:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972436:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972441:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972446:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972450:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972455:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972460:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972464:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972469:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972473:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972478:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972483:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972488:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.972497:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361258.975483:0:23857:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a8a84ee7200:23857] 0 exiting: rc = 1 00000100:00100000:3.0:1788361258.975598:0:23858:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a8a84ee7e00:23858] 1 exiting: rc = 0 00000100:00100000:2.0:1788361258.975723:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975741:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975760:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975768:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975774:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975781:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975788:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975794:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975800:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975806:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975812:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975821:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975828:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975834:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975858:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975932:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975942:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975949:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975955:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975960:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975966:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975972:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975978:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975984:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975990:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.975996:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976018:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976024:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976031:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976037:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976043:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976050:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976058:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976064:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976260:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976269:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976275:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976289:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976310:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976316:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976322:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976329:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976334:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976340:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976345:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976351:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976356:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976362:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976367:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976373:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976391:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976397:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976403:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976409:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976420:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976426:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976431:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976437:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976442:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976447:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976452:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976457:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976474:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361258.976493:0:26343:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788361258.987661:0:26343:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788361271.023950:0:26972:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788361275.859954:0:27385:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788361275.859958:0:27385:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788361275.860061:0:27385:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8987bd6000 00000020:01000004:2.0:1788361275.860076:0:27385:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788361275.860337:0:27385:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788361275.860360:0:27385:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a8a84f14d40) 00000020:00000080:2.0:1788361275.860374:0:27385:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788361275.873591:0:27385:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788361275.875873:0:27385:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x38:0x0] (8/32) 00100000:10000000:3.0:1788361275.876449:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1788361275.876559:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:3.0:1788361275.876653:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:3.0:1788361275.876756:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1788361275.876859:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1788361275.877035:0:27385:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788361275.877314:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:3.0:1788361275.877581:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:3.0:1788361275.878712:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 660: rc = 0 00100000:10000000:3.0:1788361275.878810:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 660: rc = 0 00100000:10000000:3.0:1788361275.879409:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 790: rc = 0 00100000:10000000:3.0:1788361275.879728:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 790: rc = 0 00100000:10000000:3.0:1788361275.879965:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 790: rc = 0 00100000:10000000:3.0:1788361275.880434:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 790: rc = 0 00100000:10000000:3.0:1788361275.880685:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 790: rc = 0 00100000:10000000:3.0:1788361275.880932:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 790: rc = 0 00100000:10000000:3.0:1788361275.881329:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 790: rc = 0 00100000:10000000:3.0:1788361275.881580:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 790: rc = 0 00100000:10000000:3.0:1788361275.881813:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 790: rc = 0 00100000:10000000:3.0:1788361275.882056:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 790: rc = 0 00100000:10000000:3.0:1788361275.882451:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 790: rc = 0 00100000:10000000:3.0:1788361275.882689:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 790: rc = 0 00100000:10000000:3.0:1788361275.883278:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 311: rc = 0 00100000:10000000:3.0:1788361275.883515:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 311: rc = 0 00100000:10000000:3.0:1788361275.883739:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 311: rc = 0 00100000:10000000:3.0:1788361275.883985:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 311: rc = 0 00100000:10000000:3.0:1788361275.884366:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 311: rc = 0 00100000:10000000:3.0:1788361275.884612:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 311: rc = 0 00100000:10000000:3.0:1788361275.884853:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 311: rc = 0 00100000:10000000:3.0:1788361275.885312:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 311: rc = 0 00100000:10000000:3.0:1788361275.885568:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 311: rc = 0 00100000:10000000:3.0:1788361275.885797:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 311: rc = 0 00100000:10000000:3.0:1788361275.886039:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 311: rc = 0 00100000:10000000:3.0:1788361275.886559:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 311: rc = 0 00100000:10000000:3.0:1788361275.886819:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 311: rc = 0 00100000:10000000:3.0:1788361275.887377:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 311: rc = 0 00100000:10000000:3.0:1788361275.887723:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 311: rc = 0 00100000:10000000:3.0:1788361275.887960:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 311: rc = 0 00100000:10000000:3.0:1788361275.888577:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 311: rc = 0 00100000:10000000:3.0:1788361275.888772:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 311: rc = 0 00100000:10000000:3.0:1788361275.889028:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 311: rc = 0 00100000:10000000:3.0:1788361275.889596:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 311: rc = 0 00100000:10000000:3.0:1788361275.889837:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 311: rc = 0 00100000:10000000:3.0:1788361275.890073:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 311: rc = 0 00100000:10000000:3.0:1788361275.890682:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 311: rc = 0 00100000:10000000:3.0:1788361275.890885:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 311: rc = 0 00100000:10000000:3.0:1788361275.891206:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 311: rc = 0 00100000:10000000:3.0:1788361275.891394:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 311: rc = 0 00100000:10000000:3.0:1788361275.891656:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 311: rc = 0 00100000:10000000:3.0:1788361275.891890:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 311: rc = 0 00100000:10000000:3.0:1788361275.892294:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 311: rc = 0 00100000:10000000:3.0:1788361275.892548:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 311: rc = 0 00100000:10000000:3.0:1788361275.892772:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 311: rc = 0 00100000:10000000:3.0:1788361275.892997:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 311: rc = 0 00100000:10000000:3.0:1788361275.893364:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 392: rc = 0 00100000:10000000:3.0:1788361275.893869:0:27385:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788361275.894034:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 664: rc = 0 00100000:10000000:3.0:1788361275.894249:0:27385:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788361275.894323:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 664: rc = 0 00100000:10000000:3.0:1788361275.894518:0:27385:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788361275.894586:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 664: rc = 0 00100000:10000000:3.0:1788361275.894904:0:27385:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788361275.894975:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 661: rc = 0 00100000:10000000:3.0:1788361275.895270:0:27385:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788361275.895340:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 661: rc = 0 00100000:10000000:3.0:1788361275.895586:0:27385:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788361275.895653:0:27385:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 661: rc = 0 00000020:00000080:3.0:1788361275.895891:0:27385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788361275.895899:0:27385:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788361275.895909:0:27385:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d661309a 00000020:01000004:3.0:1788361275.895916:0:27385:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788361275.895920:0:27385:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788361275.895925:0:27385:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8987bd6000 from MGS 00000020:01000004:3.0:1788361275.895928:0:27385:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788361275.895937:0:27385:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a8985c64d40) 00000020:00000080:3.0:1788361275.895946:0:27385:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788361275.895994:0:27385:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8987bd6000 from MGS, refs=2 00080000:01000000:3.0:1788361275.896004:0:27385:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788361275.896010:0:27385:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66130a8 00000100:00100000:3.0:1788361275.896161:0:27385:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788361275.896279:0:27385:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788361275.896286:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788361275.896750:0:27385:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788361275.896756:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788361275.897388:0:27385:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361275.897539:0:27385:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788361275.897545:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788361275.897942:0:27385:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788361275.897948:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788361275.898284:0:27385:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788361275.898290:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788361275.898895:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361275.898899:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361275.898901:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361275.899300:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361275.899303:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361275.899305:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361275.899752:0:27385:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788361275.906280:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788361275.907966:0:27385:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788361275.907982:0:27385:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788361275.907985:0:27385:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788361275.909353:0:27394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788361275.909492:0:27385:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788361275.909590:0:27385:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788361275.910020:0:27385:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788361275.910402:0:27385:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361275.910548:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788361275.910554:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788361275.918464:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788361275.918562:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788361275.919070:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788361275.919078:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788361275.919755:0:27385:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788361275.919776:0:27385:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.160@tcp' 00000020:01000004:2.0:1788361275.919778:0:27385:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788361275.919809:0:27385:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.160@tcp (typ=mgc) 00000020:00000080:2.0:1788361275.919820:0:27385:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.160@tcp (ffff9a8a84f13380) 00000020:00000080:2.0:1788361275.919834:0:27385:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788361275.919905:0:27385:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8987bd6800@MGC192.168.203.160@tcp: add connection 192.168.203.160@tcp at head 00000100:00080000:3.0:1788361275.920017:0:27399:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:2.0:1788361275.920220:0:27385:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.160@tcp-0 is initialized 00000040:01000000:2.0:1788361275.920227:0:27385:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788361275.922466:0:27400:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788361275.922570:0:27385:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.160@tcp (uuid e46014fe-639d-4b32-8855-95bba88887b0) 00000020:00000080:0.0:1788361275.922593:0:27385:0:(genops.c:1406:class_connect()) connect: client e46014fe-639d-4b32-8855-95bba88887b0, cookie 0xf6a94c97d66130b6 00000100:00080000:0.0:1788361275.922607:0:27385:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361275.922613:0:27385:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a8987bd6800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361275.922645:0:27385:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a843e8a80 x1875232144132608/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361275.922705:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e46014fe-639d-4b32-8855-95bba88887b0:3310:1875232144132608:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788361275.922772:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361275.922855:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144132608 00000100:00100000:1.0:1788361275.922862:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144132608 00000100:00100000:1.0:1788361275.922892:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361275.922899:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1875232144132608:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788361275.922932:0:27395:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e46014fe-639d-4b32-8855-95bba88887b0@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:1.0:1788361275.922957:0:27395:0:(genops.c:1406:class_connect()) connect: client e46014fe-639d-4b32-8855-95bba88887b0, cookie 0xf6a94c97d66130bd 00000100:00080000:1.0:1788361275.923067:0:27395:0:(import.c:65:import_set_state_nolock()) ffff9a8986fe0800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788361275.923187:0:27385:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e46014fe-639d-4b32-8855-95bba88887b0->MGS 00000020:01000004:0.0:1788361275.923205:0:27385:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788361275.923210:0:27385:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788361275.923221:0:27385:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a8a90bf0000) 00000020:00000080:0.0:1788361275.923230:0:27385:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788361275.929097:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+5:3310:x1875232144132608:12345-0@lo:250:mount.lustre.0 Request processed in 6172us (6300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361275.929113:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361275.929352:0:3310:0:(client.c:3115:ptlrpc_free_committed()) MGC192.168.203.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788361275.929364:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.160@tcp: connect to target with instance 0 00000100:00080000:2.0:1788361275.929373:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788361275.929379:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788361275.929384:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8987bd6800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788361275.929386:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788361275.929405:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788361275.929412:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e46014fe-639d-4b32-8855-95bba88887b0:3310:1875232144132608:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788361275.930798:0:27385:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361275.934354:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788361275.934367:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788361275.934924:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788361275.934931:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788361275.935308:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788361275.935313:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788361275.935885:0:27385:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361275.936173:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788361275.936180:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788361275.945142:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788361275.945157:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788361275.972466:0:27385:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361275.972669:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788361275.972675:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788361275.973681:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788361275.973692:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788361275.974269:0:27385:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361275.974413:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788361275.974418:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788361275.975034:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788361275.975040:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788361275.975867:0:27385:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361275.976327:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788361275.976332:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788361275.977805:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788361275.977816:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788361275.978477:0:27385:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361275.978707:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788361275.978713:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788361275.979251:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788361275.979258:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788361275.997508:0:27385:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361275.997710:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788361275.997716:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788361275.999739:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788361275.999752:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788361276.000750:0:27385:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788361276.000760:0:27385:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788361276.001700:0:27385:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788361276.001723:0:27385:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788361276.001730:0:27385:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788361276.001870:0:27385:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788361276.001910:0:27385:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788361276.001915:0:27385:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788361276.001917:0:27385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361276.001919:0:27385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361276.001920:0:27385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361276.001921:0:27385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361276.001923:0:27385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361276.001924:0:27385:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361276.001926:0:27385:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361276.001927:0:27385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361276.001928:0:27385:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361276.001931:0:27385:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788361276.001933:0:27385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361276.001934:0:27385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361276.001935:0:27385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361276.001941:0:27385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361276.001942:0:27385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361276.001943:0:27385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361276.001944:0:27385:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361276.001945:0:27385:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361276.001946:0:27385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361276.001947:0:27385:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361276.001972:0:27385:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788361276.001990:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144132736:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361276.002056:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.002126:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361276.002290:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144132736 00000100:00100000:0.0:1788361276.002297:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144132736 00000100:00100000:0.0:1788361276.002339:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361276.002349:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+5:27385:x1875232144132736:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361276.002393:0:27398:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361276.002396:0:27398:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788361276.002403:0:27398:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788361276.003035:0:27419:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788361276.003554:0:27398:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 14 20000000:01000000:2.0:1788361276.004543:0:27420:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788361276.004548:0:27420:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788361276.004551:0:27420:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788361276.004584:0:27420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788361276.004895:0:27398:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361276.004905:0:27398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788361276.021464:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+5:27385:x1875232144132736:12345-0@lo:253:mount.lustre.0 Request processed in 19104us (19395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.021479:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361276.021587:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144132736:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361276.021604:0:27385:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788361276.021607:0:27385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361276.021608:0:27385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361276.021610:0:27385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361276.021611:0:27385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361276.021612:0:27385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361276.021613:0:27385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361276.021615:0:27385:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361276.021616:0:27385:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361276.021618:0:27385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361276.021620:0:27385:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788361276.021640:0:27385:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8987bd6000 from lustre-MDT0000 10000000:01000000:3.0:1788361276.021665:0:27385:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788361276.021667:0:27385:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788361276.021672:0:27385:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a8a84f13380 10000000:01000000:3.0:1788361276.021676:0:27385:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361276.021683:0:27385:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a8a84f13380 from 1 10000000:01000000:3.0:1788361276.021686:0:27385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788361276.021723:0:27385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.021734:0:27385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.021759:0:27385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361276.021777:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144132864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361276.021888:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.021926:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361276.021981:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144132864 00000100:00100000:0.0:1788361276.021988:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144132864 00000100:00100000:0.0:1788361276.022027:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361276.022036:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab778e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+5:27385:x1875232144132864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361276.022049:0:27397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361276.022063:0:27397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964800/0xf6a94c97d66130d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66130cb expref: -99 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361276.022113:0:27397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964800/0xf6a94c97d66130d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66130cb expref: 6 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361276.022125:0:27397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964800/0xf6a94c97d66130d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66130cb expref: 6 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361276.022134:0:27397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964800, rc 0) 00000100:00100000:0.0:1788361276.022163:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab778e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+6:27385:x1875232144132864:12345-0@lo:101:mount.lustre.0 Request processed in 128us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361276.022169:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361276.022247:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144132864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361276.022260:0:27385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.022340:0:27385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361276.022387:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144132992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361276.022413:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.022431:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.022496:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144132992 00000100:00100000:1.0:1788361276.022500:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144132992 00000100:00100000:1.0:1788361276.022561:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361276.022568:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab778d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+6:27385:x1875232144132992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361276.022821:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab778d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+6:27385:x1875232144132992:12345-0@lo:501:mount.lustre.0 Request processed in 253us (405us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361276.022828:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361276.022969:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144132992:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788361276.022993:0:27385:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788361276.023040:0:27385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.023048:0:27385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361276.023055:0:27385:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8987bd6000 10000000:01000000:3.0:1788361276.023059:0:27385:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788361276.023068:0:27385:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a8987bd6000 10000000:01000000:3.0:1788361276.023071:0:27385:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788361276.023073:0:27385:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a8987bd6000 from 1 10000000:01000000:3.0:1788361276.023075:0:27385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788361276.023132:0:27385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.023139:0:27385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.023146:0:27385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361276.023158:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144133120:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361276.023183:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.023202:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.023251:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144133120 00000100:00100000:1.0:1788361276.023255:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144133120 00000100:00100000:1.0:1788361276.023347:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361276.023354:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab778f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+6:27385:x1875232144133120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361276.023364:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361276.023375:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8abeac8200/0xf6a94c97d66130e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66130d9 expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.023391:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8abeac8200/0xf6a94c97d66130e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66130d9 expref: 7 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.023399:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8abeac8200/0xf6a94c97d66130e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66130d9 expref: 7 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.023406:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8200, rc 0) 00000100:00100000:1.0:1788361276.023439:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab778f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+7:27385:x1875232144133120:12345-0@lo:101:mount.lustre.0 Request processed in 85us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.023444:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361276.023516:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144133120:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361276.023526:0:27385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.023533:0:27385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361276.023544:0:27385:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788361276.023633:0:27385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.023640:0:27385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361276.023656:0:27385:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788361276.023660:0:27385:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361276.023664:0:27385:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a8987bd6000 10000000:01000000:3.0:1788361276.023666:0:27385:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788361276.023669:0:27385:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788361276.023671:0:27385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788361276.023686:0:27385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.023692:0:27385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.023699:0:27385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361276.023711:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144133248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361276.023736:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.023809:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.023905:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144133248 00000100:00100000:1.0:1788361276.023909:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144133248 00000100:00100000:1.0:1788361276.023957:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361276.023963:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab778e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+7:27385:x1875232144133248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361276.023970:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361276.023976:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66130ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66130e7 expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.023988:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66130ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66130e7 expref: 8 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.023996:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66130ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66130e7 expref: 8 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.024007:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8e00, rc 0) 00000100:00100000:1.0:1788361276.024066:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab778e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+8:27385:x1875232144133248:12345-0@lo:101:mount.lustre.0 Request processed in 103us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.024072:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361276.024244:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144133248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361276.024254:0:27385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.024261:0:27385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361276.024384:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144133376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361276.024406:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.024468:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.024503:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144133376 00000100:00100000:1.0:1788361276.024507:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144133376 00000100:00100000:1.0:1788361276.024560:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361276.024567:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+8:27385:x1875232144133376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361276.025216:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+9:27385:x1875232144133376:12345-0@lo:501:mount.lustre.0 Request processed in 647us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.025223:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361276.025369:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144133376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361276.025397:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144133504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361276.025433:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.025452:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.025507:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144133504 00000100:00100000:1.0:1788361276.025512:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144133504 00000100:00100000:1.0:1788361276.025532:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361276.025538:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+9:27385:x1875232144133504:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361276.025800:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+9:27385:x1875232144133504:12345-0@lo:503:mount.lustre.0 Request processed in 261us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.025807:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361276.025877:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144133504:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361276.026209:0:27421:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27421:1875232144133632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361276.026244:0:27421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.026265:0:27421:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.026377:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144133632 00000100:00100000:1.0:1788361276.026382:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144133632 00000100:00100000:1.0:1788361276.026402:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361276.026408:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+9:27421:x1875232144133632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361276.026672:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+9:27421:x1875232144133632:12345-0@lo:502:llog_process_th.0 Request processed in 264us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.026680:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361276.026812:0:27421:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27421:1875232144133632:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361276.026835:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361276.026846:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361276.026848:0:27421:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788361276.026854:0:27421:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788361276.026857:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361276.026870:0:27421:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a8985c619c0) 00000020:00000080:3.0:1788361276.026886:0:27421:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788361276.026892:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788361276.026964:0:27421:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788361276.026971:0:27421:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66130fc 00000020:00000080:3.0:1788361276.027511:0:27421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788361276.027516:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361276.027520:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361276.027521:0:27421:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788361276.027524:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361276.027528:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361276.027529:0:27421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788361276.027532:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361276.027544:0:27421:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a8985c60000) 00000020:00000080:3.0:1788361276.027553:0:27421:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788361276.027557:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788361276.027559:0:27421:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788361276.027561:0:27421:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788361276.027566:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788361276.027603:0:27421:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8987bd6000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788361276.027614:0:27421:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a8985c63380) 00000020:00000080:3.0:1788361276.027620:0:27421:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788361276.027661:0:27421:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788361276.027666:0:27421:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6613111 00000020:00000080:3.0:1788361276.027745:0:27421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788361276.027750:0:27421:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788361276.027754:0:27421:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf6a94c97d6613118 00080000:01000000:3.0:1788361276.027758:0:27421:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788361276.027761:0:27421:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d661311f 00010000:00010000:0.0:1788361276.098327:0:27421:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788361276.099293:0:27421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 17179869274 00000001:00080000:0.0:1788361276.099903:0:27421:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788361276.100551:0:27421:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a8a90bf19c0) 00000020:00000080:0.0:1788361276.100569:0:27421:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788361276.100629:0:27421:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788361276.100634:0:27421:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d661312d 00000020:00000080:1.0:1788361276.101569:0:27421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788361276.108610:0:27421:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf6a94c97d6613134 00000020:00000080:0.0:1788361276.109577:0:27421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788361276.109589:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361276.109596:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361276.109599:0:27421:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788361276.109677:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361276.109683:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361276.109685:0:27421:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788361276.109689:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788361276.109738:0:27421:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788361276.109753:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361276.109757:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361276.109758:0:27421:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788361276.109760:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788361276.109762:0:27421:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788361276.109763:0:27421:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361276.109765:0:27421:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361276.109767:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788361276.109769:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361276.109771:0:27421:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788361276.109774:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788361276.109777:0:27421:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788361276.109780:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361276.109781:0:27421:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788361276.109784:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788361276.109789:0:27421:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:0.0:1788361276.109814:0:27421:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788361276.109817:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361276.109832:0:27421:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a8a90bf3380) 00000020:00000080:0.0:1788361276.109846:0:27421:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788361276.109851:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788361276.110078:0:27421:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788361276.110082:0:27421:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788361276.110112:0:27421:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d6613142 00010000:00080000:0.0:1788361276.110152:0:27421:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a89852f3000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:0.0:1788361276.110412:0:27421:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788361276.111703:0:27421:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788361276.111766:0:27421:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788361276.113473:0:27421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361276.113642:0:27421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].5, 64 off8512 00000040:00080000:2.0:1788361276.113733:0:27421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].1, 64 off8256 00000040:00080000:0.0:1788361276.122236:0:27425:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:0.0:1788361276.122254:0:27425:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1c:0x0] at index 5 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788361276.129383:0:27421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361276.129398:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788361276.129432:0:27421:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788361276.129448:0:27421:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6613149 00000100:00080000:1.0:1788361276.129456:0:27421:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361276.129460:0:27421:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a89852f3000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361276.129500:0:27421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a89859c8000 x1875232144133760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361276.129524:0:27421:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788361276.129583:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361276.129587:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361276.129589:0:27421:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788361276.129592:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788361276.129594:0:27421:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788361276.129596:0:27421:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361276.129597:0:27421:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361276.129599:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788361276.129601:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361276.129602:0:27421:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788361276.129604:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788361276.129608:0:27421:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788361276.129611:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361276.129612:0:27421:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788361276.129614:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788361276.129618:0:27421:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:1.0:1788361276.129642:0:27421:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788361276.129644:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361276.129655:0:27421:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a8ab7463380) 00000020:00000080:1.0:1788361276.129666:0:27421:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788361276.129683:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788361276.129738:0:27421:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788361276.129743:0:27421:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788361276.129908:0:27421:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d6613157 00010000:00080000:1.0:1788361276.129941:0:27421:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a8a129000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1788361276.130543:0:27421:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788361276.130734:0:27421:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788361276.130824:0:27421:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788361276.130904:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144133760:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788361276.130959:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144133760 offset 0 length 520: 4 00000040:00080000:1.0:1788361276.131480:0:27421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361276.131552:0:27421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].5, 64 off8512 00000040:00080000:1.0:1788361276.131619:0:27421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1e:0x0].1, 64 off8256 00000040:00080000:2.0:1788361276.131983:0:27427:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1788361276.131988:0:27427:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1e:0x0] at index 5 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788361276.132507:0:27421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788361276.132517:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788361276.132544:0:27421:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788361276.132562:0:27421:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d661315e 00000100:00080000:1.0:1788361276.132572:0:27421:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361276.132577:0:27421:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8a8a129000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361276.132607:0:27421:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a89859c9180 x1875232144133888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361276.132657:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144133888:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788361276.132707:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144133888 offset 0 length 520: 4 00000100:00080000:1.0:1788361276.132757:0:27421:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788361276.132812:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361276.132817:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361276.132819:0:27421:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788361276.132822:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361276.132825:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361276.132827:0:27421:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788361276.132830:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788361276.132832:0:27421:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788361276.132834:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361276.132836:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361276.132838:0:27421:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788361276.132847:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361276.132850:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361276.132851:0:27421:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788361276.132854:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788361276.132881:0:27421:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27421:1875232144134016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361276.132924:0:27421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361276.132951:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144134016 00000100:00100000:1.0:1788361276.132956:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144134016 00000100:00100000:1.0:1788361276.132987:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788361276.132995:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+9:27421:x1875232144134016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361276.133213:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+9:27421:x1875232144134016:12345-0@lo:502:llog_process_th.0 Request processed in 218us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.133220:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788361276.133259:0:27421:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.133277:0:27421:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27421:1875232144134016:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788361276.133301:0:27421:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361276.133305:0:27421:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361276.133306:0:27421:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788361276.133310:0:27421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788361276.133354:0:27385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788361276.133370:0:27385:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788361276.133386:0:27385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.133396:0:27385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361276.133404:0:27385:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8987bd6000 from 1 10000000:01000000:1.0:1788361276.133406:0:27385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788361276.133435:0:27385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.133442:0:27385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.133451:0:27385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361276.133464:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144134144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361276.133497:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361276.133514:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361276.133820:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144134144 00000100:00100000:3.0:1788361276.133826:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144134144 00000100:00100000:3.0:1788361276.133856:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361276.133864:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+9:27385:x1875232144134144:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361276.133874:0:27398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361276.133888:0:27398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661316c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613165 expref: -99 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.133908:0:27398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661316c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613165 expref: 10 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.133918:0:27398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661316c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613165 expref: 10 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.133928:0:27398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:3.0:1788361276.133961:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+10:27385:x1875232144134144:12345-0@lo:101:mount.lustre.0 Request processed in 98us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361276.133973:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361276.134142:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144134144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361276.134155:0:27385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.134163:0:27385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361276.134729:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144134272:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788361276.134793:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361276.134824:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.134843:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144134272 00000100:00100000:1.0:1788361276.134848:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144134272 00000100:00100000:1.0:1788361276.134885:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788361276.134893:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+10:27385:x1875232144134272:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788361276.134908:0:27395:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788361276.134913:0:27395:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788361276.135000:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+10:27385:x1875232144134272:12345-0@lo:256:mount.lustre.0 Request processed in 108us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.135007:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788361276.135047:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144134272:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788361276.135696:0:27385:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361276.135712:0:27385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.135722:0:27385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361276.135730:0:27385:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8987bd6000 from 1 10000000:01000000:1.0:1788361276.135733:0:27385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361276.135758:0:27385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.135773:0:27385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.135782:0:27385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361276.135804:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144134400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361276.135832:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361276.135852:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.135873:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144134400 00000100:00100000:1.0:1788361276.135877:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144134400 00000100:00100000:1.0:1788361276.135897:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361276.135902:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+10:27385:x1875232144134400:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361276.135917:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361276.135929:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8abeac8a00/0xf6a94c97d661317a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613173 expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.135945:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8abeac8a00/0xf6a94c97d661317a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613173 expref: 11 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.135954:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8abeac8a00/0xf6a94c97d661317a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613173 expref: 11 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.135961:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8a00, rc 0) 00000100:00100000:1.0:1788361276.135989:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+11:27385:x1875232144134400:12345-0@lo:101:mount.lustre.0 Request processed in 86us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.135995:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361276.136028:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144134400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361276.136040:0:27385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.136048:0:27385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361276.136120:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144134528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361276.136144:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361276.136161:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.136173:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144134528 00000100:00100000:1.0:1788361276.136176:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144134528 00000100:00100000:1.0:1788361276.136192:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361276.136197:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+11:27385:x1875232144134528:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361276.136615:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+11:27385:x1875232144134528:12345-0@lo:501:mount.lustre.0 Request processed in 416us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.136622:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361276.137790:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144134528:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361276.137835:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144134656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361276.137890:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361276.137924:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.138945:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144134656 00000100:00100000:1.0:1788361276.138953:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144134656 00000100:00100000:1.0:1788361276.138991:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361276.138999:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+11:27385:x1875232144134656:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361276.139242:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+11:27385:x1875232144134656:12345-0@lo:503:mount.lustre.0 Request processed in 242us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.139250:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788361276.139296:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144134656:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361276.139722:0:27429:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27429:1875232144134784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361276.139833:0:27429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361276.139892:0:27429:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361276.139920:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144134784 00000100:00100000:3.0:1788361276.139925:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144134784 00000100:00100000:3.0:1788361276.139987:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788361276.139994:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+11:27429:x1875232144134784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361276.140200:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+11:27429:x1875232144134784:12345-0@lo:502:llog_process_th.0 Request processed in 206us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361276.140207:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361276.140283:0:27429:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27429:1875232144134784:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361276.140305:0:27429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361276.140313:0:27429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361276.140316:0:27429:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788361276.140323:0:27429:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8987bd6000 00000020:00000080:2.0:1788361276.140325:0:27429:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788361276.140333:0:27429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361276.140336:0:27429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361276.140338:0:27429:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788361276.140340:0:27429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361276.140342:0:27429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361276.140344:0:27429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788361276.140347:0:27429:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8987bd6000 00000020:00000080:2.0:1788361276.140349:0:27429:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788361276.140399:0:27429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361276.140402:0:27429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361276.140404:0:27429:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788361276.140406:0:27429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361276.140409:0:27429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361276.140410:0:27429:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788361276.140414:0:27429:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8987bd6000 00000020:00000080:2.0:1788361276.140425:0:27429:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788361276.140463:0:27429:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27429:1875232144134912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361276.140517:0:27429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361276.142275:0:27429:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361276.142549:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144134912 00000100:00100000:0.0:1788361276.142558:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144134912 00000100:00100000:0.0:1788361276.142596:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361276.142604:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+11:27429:x1875232144134912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361276.142933:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+11:27429:x1875232144134912:12345-0@lo:502:llog_process_th.0 Request processed in 329us (2415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361276.142941:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361276.143808:0:27429:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27429:1875232144134912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361276.143842:0:27429:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361276.143855:0:27429:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361276.143858:0:27429:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788361276.143863:0:27429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788361276.147411:0:27385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788361276.147441:0:27385:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361276.147458:0:27385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.147470:0:27385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361276.147525:0:27385:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361276.147528:0:27385:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8987bd6000 10000000:01000000:1.0:1788361276.147531:0:27385:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8987bd6000 10000000:01000000:1.0:1788361276.147536:0:27385:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361276.147541:0:27385:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8987bd6000 from 1 10000000:01000000:1.0:1788361276.147543:0:27385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361276.147576:0:27385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.147583:0:27385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.147600:0:27385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361276.147622:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144135040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361276.147679:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361276.147712:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361276.149621:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144135040 00000100:00100000:0.0:1788361276.149632:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144135040 00000100:00100000:0.0:1788361276.149678:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361276.149688:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+11:27385:x1875232144135040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361276.149701:0:27397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361276.149717:0:27397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965200/0xf6a94c97d6613188 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613181 expref: -99 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361276.149742:0:27397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965200/0xf6a94c97d6613188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613181 expref: 12 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361276.149812:0:27397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965200/0xf6a94c97d6613188 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613181 expref: 12 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361276.149822:0:27397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965200, rc 0) 00000100:00100000:0.0:1788361276.149892:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+12:27385:x1875232144135040:12345-0@lo:101:mount.lustre.0 Request processed in 207us (2212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361276.149899:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361276.149987:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144135040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361276.150003:0:27385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.150012:0:27385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361276.150075:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144135168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361276.150130:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.150158:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361276.150213:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144135168 00000100:00100000:0.0:1788361276.150217:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144135168 00000100:00100000:0.0:1788361276.150251:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361276.150257:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+12:27385:x1875232144135168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361276.150503:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+12:27385:x1875232144135168:12345-0@lo:501:mount.lustre.0 Request processed in 245us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361276.150510:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361276.150574:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144135168:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361276.150601:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144135296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361276.150638:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.150659:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361276.150701:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144135296 00000100:00100000:0.0:1788361276.150705:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144135296 00000100:00100000:0.0:1788361276.150725:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788361276.150731:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+12:27385:x1875232144135296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361276.150942:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+12:27385:x1875232144135296:12345-0@lo:503:mount.lustre.0 Request processed in 210us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361276.150950:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361276.151018:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144135296:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361276.154626:0:27434:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27434:1875232144135424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361276.154706:0:27434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361276.154839:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144135424 00000100:00100000:2.0:1788361276.154847:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144135424 00000100:00100000:2.0:1788361276.154887:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361276.154896:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+12:27434:x1875232144135424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361276.155140:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+12:27434:x1875232144135424:12345-0@lo:502:llog_process_th.0 Request processed in 245us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361276.155148:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361276.155215:0:27434:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361276.155238:0:27434:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27434:1875232144135424:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788361276.155292:0:27434:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788361276.155306:0:27434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a8984a5cd40) 00000020:00000080:3.0:1788361276.155323:0:27434:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788361276.155767:0:27434:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8987bd6000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788361276.155771:0:27434:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8987bd6000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788361276.155774:0:27434:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8987bd6000 4 00010000:00080000:3.0:1788361276.155802:0:27434:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a898534c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361276.157311:0:27434:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788361276.157399:0:27434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788361276.157428:0:27434:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788361276.157441:0:27434:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf6a94c97d6613196 00000100:00080000:3.0:1788361276.157450:0:27434:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361276.157454:0:27434:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a898534c800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361276.157497:0:27434:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac1565f80 x1875232144135552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361276.157533:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144135552:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361276.157587:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361276.157655:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144135552 00000100:00100000:3.0:1788361276.157661:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144135552 00000100:00100000:3.0:1788361276.157687:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361276.157694:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144135552:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361276.157740:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144135552:12345-0@lo:38:llog_process_th.0 Request processed in 45us (151us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788361276.157746:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361276.157783:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361276.157790:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a898534c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361276.157816:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788361276.157819:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144135552:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788361276.157836:0:27434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788361276.158869:0:27434:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27434:1875232144135680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361276.158917:0:27434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361276.158951:0:27434:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361276.159072:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144135680 00000100:00100000:1.0:1788361276.159078:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144135680 00000100:00100000:1.0:1788361276.159864:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788361276.159873:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+12:27434:x1875232144135680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361276.160128:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+12:27434:x1875232144135680:12345-0@lo:502:llog_process_th.0 Request processed in 255us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361276.160135:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361276.160145:0:27434:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e46014fe-639d-4b32-8855-95bba88887b0:27434:1875232144135680:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788361276.160172:0:27434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788361276.160336:0:27385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788361276.160355:0:27385:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361276.160370:0:27385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361276.160380:0:27385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788361276.160423:0:27385:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788361276.160425:0:27385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361276.160426:0:27385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361276.160427:0:27385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361276.160428:0:27385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361276.160430:0:27385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361276.160431:0:27385:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361276.160432:0:27385:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361276.160434:0:27385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361276.160435:0:27385:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788361276.160439:0:27385:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788361276.160442:0:27385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788361276.160443:0:27385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361276.160445:0:27385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361276.160446:0:27385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361276.160451:0:27385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361276.160452:0:27385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361276.160453:0:27385:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361276.160454:0:27385:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361276.160455:0:27385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361276.160456:0:27385:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788361276.160472:0:27385:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788361276.160495:0:27385:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144135808:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788361276.160535:0:27385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361276.160595:0:27385:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361276.161553:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144135808 00000100:00100000:0.0:1788361276.161561:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144135808 00000100:00100000:1.0:1788361276.161662:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788361276.161670:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+12:27385:x1875232144135808:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788361276.161702:0:27397:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788361276.161716:0:27397:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361276.205851:0:27397:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361276.205939:0:27397:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788361276.206215:0:27419:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788361276.206220:0:27419:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788361276.206242:0:27419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.206260:0:27419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661316c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613165 expref: 12 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.206381:0:27419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.206600:0:27419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661316c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6613165 expref: 12 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361276.206615:0:27419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661316c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6613165 expref: 12 pid: 27398 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361276.206631:0:27419:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859ca300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27419:1875232144135936:0@lo:104: 00000100:00100000:1.0:1788361276.206701:0:27419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361276.206865:0:27419:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361276.206975:0:27386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144135936 00000100:00100000:2.0:1788361276.206983:0:27386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144135936 00000100:00100000:2.0:1788361276.207069:0:27386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361276.207080:0:27386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e46014fe-639d-4b32-8855-95bba88887b0+3:27419:x1875232144135936:12345-0@lo:104: 00010000:00010000:2.0:1788361276.207116:0:27386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361276.207172:0:27386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788361276.207178:0:27386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e46014fe-639d-4b32-8855-95bba88887b0+3:27419:x1875232144135936:12345-0@lo:104: Request processed in 101us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361276.207185:0:27386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361276.207259:0:27419:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859ca300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27419:1875232144135936:0@lo:104: 00010000:00010000:0.0:1788361276.207288:0:27419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361276.207954:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361276.207962:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361276.207970:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9c00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361276.207974:0:27392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361276.207982:0:27392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361276.208002:0:27392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361276.208008:0:27392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361276.208045:0:27392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361276.208051:0:27392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788361276.208121:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144136064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361276.208158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361276.208281:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361276.208290:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9c00/0xf6a94c97d6613165 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661316c expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361276.208307:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361276.208309:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361276.208311:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361276.208577:0:27388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144136064 00000100:00100000:3.0:1788361276.208584:0:27388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144136064 00010000:00010000:3.0:1788361276.208605:0:27388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661316c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613165 expref: 13 pid: 27398 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361276.208638:0:27388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361276.208645:0:27388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e46014fe-639d-4b32-8855-95bba88887b0+13:3313:x1875232144136064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361276.208656:0:27388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361276.208661:0:27388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661316c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613165 expref: 13 pid: 27398 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.208683:0:27388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661316c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6613165 expref: 13 pid: 27398 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.208698:0:27388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661316c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6613165 expref: 13 pid: 27398 timeout: 766 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.208712:0:27388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.208720:0:27388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788361276.208734:0:27388:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002514753s 00010000:00010000:3.0:1788361276.208739:0:27388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.208746:0:27388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.208818:0:27388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.208824:0:27388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.208830:0:27388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361276.208834:0:27388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.208841:0:27388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361276.210713:0:27419:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361276.210726:0:27419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.211408:0:27388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.211419:0:27388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d661319d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361276.211436:0:27388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361276.211531:0:27388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e46014fe-639d-4b32-8855-95bba88887b0+12:3313:x1875232144136064:12345-0@lo:103:ldlm_bl.0 Request processed in 2882us (3369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361276.211541:0:27388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361276.211654:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144136064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361276.215738:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+11:27385:x1875232144135808:12345-0@lo:253:mount.lustre.0 Request processed in 54055us (55189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361276.215763:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788361276.215894:0:27385:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:27385:1875232144135808:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361276.215912:0:27385:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788361276.215916:0:27385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361276.215918:0:27385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361276.215919:0:27385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361276.215920:0:27385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361276.215921:0:27385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361276.215922:0:27385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361276.215924:0:27385:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361276.215925:0:27385:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361276.215927:0:27385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361276.215928:0:27385:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788361276.215946:0:27385:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788361276.224809:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361276.224976:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361276.225438:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361276.225638:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361276.225985:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361276.226160:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788361276.227516:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788361276.227683:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788361276.228018:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788361276.229318:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788361276.229858:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788361276.230422:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788361276.251154:0:27385:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 12884902008 00000040:01000000:0.0:1788361276.252689:0:27385:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788361276.252961:0:27441:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 12884902008 00000020:00080000:3.0:1788361276.252965:0:27441:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902008 00000040:01000000:0.0:1788361276.253259:0:27442:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788361276.253349:0:27442:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361276.256465:0:27442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788361276.256533:0:27442:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788361276.256537:0:27442:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788361276.257911:0:27385:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788361276.258447:0:27385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788361276.258993:0:27385:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788361276.259002:0:27385:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788361276.261033:0:27385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361276.262851:0:27385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788361276.263686:0:27385:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788361276.263749:0:27385:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788361276.264638:0:27385:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 3, last_idx 4 00080000:10000000:2.0:1788361276.266498:0:27385:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x39:0x0] (8/8/4) registered 00000001:00000004:0.0:1788361276.274701:0:27385:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836480 00000001:00080000:2.0:1788361276.307339:0:27385:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788361276.307373:0:27385:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa998c1467988 00100000:10000000:2.0:1788361276.307382:0:27385:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788361276.309250:0:27385:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788361276.309266:0:27385:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788361276.309280:0:27385:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788361276.309305:0:27385:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788361276.963827:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361277.217462:0:27435:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:2.0:1788361277.217471:0:27435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361277.218025:0:27435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:2.0:1788361277.219408:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 10000000:01000000:2.0:1788361277.731782:0:27400:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788361277.731790:0:27400:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8987bd6000 from 15 10000000:01000000:2.0:1788361277.731794:0:27400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788361277.731839:0:27400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361277.731851:0:27400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361277.731862:0:27400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361277.731888:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144136192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361277.731958:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361277.732007:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361277.732174:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144136192 00000100:00100000:0.0:1788361277.732181:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144136192 00000100:00100000:0.0:1788361277.732226:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361277.732236:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+11:27400:x1875232144136192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361277.732250:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361277.732263:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965000/0xf6a94c97d66131ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66131a4 expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361277.732285:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965000/0xf6a94c97d66131ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66131a4 expref: 12 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361277.732296:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965000/0xf6a94c97d66131ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66131a4 expref: 12 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361277.732313:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965000, rc 0) 00000100:00100000:0.0:1788361277.732352:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+12:27400:x1875232144136192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361277.732359:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361277.732400:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144136192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361277.732412:0:27400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361277.732421:0:27400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361277.732485:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144136320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361277.732518:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361277.732534:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361277.732548:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144136320 00000100:00100000:0.0:1788361277.732552:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144136320 00000100:00100000:0.0:1788361277.732575:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788361277.732581:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+12:27400:x1875232144136320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788361277.732594:0:27397:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788361277.732610:0:27397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788361277.732613:0:27397:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 15 00000100:00100000:0.0:1788361277.732687:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+12:27400:x1875232144136320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361277.732694:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788361277.732725:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144136320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788361277.732773:0:27400:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788361277.732780:0:27400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361277.732789:0:27400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361277.985280:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361278.241951:0:27435:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:1.0:1788361278.241959:0:27435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361278.241996:0:27435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 5 00000040:00080000:1.0:1788361278.242002:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00010000:00010000:2.0:1788361279.010644:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361279.275229:0:27684:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788361280.033183:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361281.056466:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361281.184531:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361281.184538:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788361281.184580:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e46014fe-639d-4b32-8855-95bba88887b0:3314:1875232144136448:0@lo:400:kworker.0 00000100:00100000:0.0:1788361281.184694:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361281.184790:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361281.184795:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788361281.184797:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788361281.184801:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361281.184804:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a898534c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361281.184814:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a898534c800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361281.184848:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac1566300 x1875232144136576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361281.184888:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144136576:0@lo:38:kworker.0 00000100:00100000:3.0:1788361281.184937:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361281.185005:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144136576 00000100:00100000:3.0:1788361281.185012:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144136576 00000100:00100000:3.0:1788361281.185045:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361281.185051:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144136576:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788361281.185074:0:27405:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:3.0:1788361281.185137:0:27405:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf6a94c97d66131b2 00000004:00100000:3.0:1788361281.185169:0:27405:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788361281.185317:0:27405:0:(import.c:65:import_set_state_nolock()) ffff9a8a84a41000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361281.185376:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232144136576:12345-0@lo:38:kworker.0 Request processed in 323us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361281.185384:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788361281.185429:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8ac1566300 x1875232144136576/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361281.185442:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 5 00000100:00080000:3.0:1788361281.185461:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788361281.185465:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361281.185468:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a898534c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361281.185474:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144136576:0@lo:38:kworker.0 00000100:00100000:0.0:1788361281.185575:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144136448 00000100:00100000:0.0:1788361281.185580:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144136448 00000100:00100000:0.0:1788361281.185613:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361281.185622:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+12:3314:x1875232144136448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361281.185661:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+12:3314:x1875232144136448:12345-0@lo:400:kworker.0 Request processed in 41us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361281.185668:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361281.185919:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e46014fe-639d-4b32-8855-95bba88887b0:3314:1875232144136448:0@lo:400:kworker.0 00000020:00000080:1.0:1788361281.226659:0:27835:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd57f2d0c0 20000000:00000080:1.0:1788361281.226677:0:27835:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8a9eabb800 uarg=0000000000000000 20000000:01000000:1.0:1788361281.226714:0:27835:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788361281.226721:0:27835:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788361281.226725:0:27835:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788361281.228330:0:27836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788361281.228516:0:27835:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788361281.237356:0:27835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788361281.237387:0:27835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361281.237405:0:27835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8abeac8a00/0xf6a94c97d661317a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613173 expref: 11 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361281.237413:0:27835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361281.237469:0:27835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8abeac8a00/0xf6a94c97d661317a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6613173 expref: 11 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361281.237482:0:27835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8abeac8a00/0xf6a94c97d661317a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6613173 expref: 11 pid: 27395 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361281.237498:0:27835:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27835:1875232144136704:0@lo:104: 00000100:00100000:1.0:1788361281.237580:0:27835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361281.237629:0:27835:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788361281.237790:0:27387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144136704 00000100:00100000:3.0:1788361281.237798:0:27387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144136704 00000100:00100000:3.0:1788361281.237851:0:27387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361281.237861:0:27387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e46014fe-639d-4b32-8855-95bba88887b0+3:27835:x1875232144136704:12345-0@lo:104: 00010000:00010000:3.0:1788361281.237873:0:27387:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361281.237933:0:27387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788361281.237938:0:27387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e46014fe-639d-4b32-8855-95bba88887b0+3:27835:x1875232144136704:12345-0@lo:104: Request processed in 80us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361281.237943:0:27387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788361281.238065:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361281.238073:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238080:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361281.238222:0:27392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238232:0:27392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361281.238249:0:27392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361281.238255:0:27392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361281.238296:0:27392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238303:0:27392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361281.238331:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238339:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8600/0xf6a94c97d6613173 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661317a expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238356:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361281.238358:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361281.238360:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361281.238377:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144136832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361281.238410:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361281.238512:0:27390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144136832 00000100:00100000:0.0:1788361281.238518:0:27390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144136832 00010000:00010000:0.0:1788361281.238538:0:27390:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8abeac8a00/0xf6a94c97d661317a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613173 expref: 12 pid: 27395 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361281.238572:0:27390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361281.238579:0:27390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e46014fe-639d-4b32-8855-95bba88887b0+12:3311:x1875232144136832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361281.238590:0:27390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361281.238594:0:27390:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8abeac8a00/0xf6a94c97d661317a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613173 expref: 12 pid: 27395 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238604:0:27390:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8abeac8a00/0xf6a94c97d661317a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6613173 expref: 12 pid: 27395 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238627:0:27390:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238633:0:27390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238648:0:27390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238655:0:27390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238661:0:27390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238666:0:27390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238671:0:27390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361281.238675:0:27390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238682:0:27390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238690:0:27390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361281.238698:0:27390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361281.238732:0:27390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e46014fe-639d-4b32-8855-95bba88887b0+12:3311:x1875232144136832:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361281.238748:0:27390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361281.238784:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144136832:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361281.238903:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8abeac8a00/0xf6a94c97d661317a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6613173 expref: 11 pid: 27395 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361281.238914:0:27835:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27835:1875232144136704:0@lo:104: 00010000:00010000:1.0:1788361281.238929:0:27835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361281.238938:0:27835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361281.238943:0:27835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361281.238949:0:27835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8abeac9400/0xf6a94c97d66131b9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361282.080281:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788361282.592162:0:27400:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361282.592169:0:27400:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8987bd6000 from 10 10000000:01000000:0.0:1788361282.592175:0:27400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361282.592217:0:27400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361282.592229:0:27400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361282.592240:0:27400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361282.592265:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144136960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361282.592332:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361282.592375:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361282.592478:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144136960 00000100:00100000:3.0:1788361282.592486:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144136960 00000100:00100000:3.0:1788361282.592570:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788361282.592580:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+11:27400:x1875232144136960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361282.592600:0:27398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361282.592628:0:27398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66131c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66131c0 expref: -99 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361282.592652:0:27398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66131c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66131c0 expref: 12 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361282.592662:0:27398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66131c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66131c0 expref: 12 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361282.592670:0:27398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e000, rc 0) 00000100:00100000:3.0:1788361282.592708:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+12:27400:x1875232144136960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361282.592715:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788361282.592856:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144136960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361282.592870:0:27400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361282.592879:0:27400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361282.592925:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144137088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361282.592963:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361282.592980:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361282.592997:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144137088 00000100:00100000:0.0:1788361282.593000:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144137088 00000100:00100000:0.0:1788361282.593022:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361282.593029:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+12:27400:x1875232144137088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361282.593309:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+12:27400:x1875232144137088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361282.593315:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361282.593346:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144137088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361282.593372:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144137216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361282.593409:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361282.593423:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361282.593435:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144137216 00000100:00100000:0.0:1788361282.593448:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144137216 00000100:00100000:0.0:1788361282.593471:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361282.593476:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+12:27400:x1875232144137216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361282.593605:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+12:27400:x1875232144137216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361282.593612:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361282.593650:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144137216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361282.595679:0:27924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788361282.596902:0:27400:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788361282.596928:0:27400:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361282.596939:0:27400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361282.596950:0:27400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.104231:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788361283.800129:0:28037:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788361283.800134:0:28037:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788361283.800243:0:28037:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8ac05c4000 00000020:01000004:3.0:1788361283.800260:0:28037:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788361283.800271:0:28037:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788361283.800284:0:28037:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a8984a5b380) 00000020:00000080:3.0:1788361283.800298:0:28037:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788361283.813139:0:28037:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788361283.813391:0:28037:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788361283.814059:0:28037:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788361283.814354:0:28037:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788361283.814615:0:28037:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xd:0x0] (8/32) 00100000:10000000:3.0:1788361283.814931:0:28037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1788361283.815022:0:28037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1788361283.815339:0:28037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1788361283.815811:0:28037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 720: rc = 0 00100000:10000000:3.0:1788361283.816049:0:28037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 720: rc = 0 00100000:10000000:3.0:1788361283.816371:0:28037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 720: rc = 0 00100000:10000000:3.0:1788361283.817425:0:28037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 720: rc = 0 00100000:10000000:3.0:1788361283.817688:0:28037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 720: rc = 0 00100000:10000000:3.0:1788361283.817917:0:28037:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 720: rc = 0 00000020:00000080:3.0:1788361283.818510:0:28037:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788361283.818520:0:28037:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788361283.818529:0:28037:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d66131d5 00000020:01000004:3.0:1788361283.818537:0:28037:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788361283.818555:0:28037:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788361283.818559:0:28037:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788361283.818564:0:28037:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788361283.818568:0:28037:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788361283.818578:0:28037:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a8984a58000) 00000020:00000080:3.0:1788361283.818587:0:28037:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788361283.820321:0:28037:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361283.820610:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788361283.820616:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788361283.821458:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788361283.821467:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788361283.822070:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788361283.822077:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788361283.823895:0:28037:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361283.824513:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788361283.824520:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788361283.825606:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788361283.825616:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788361283.845297:0:28037:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361283.845530:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788361283.845537:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788361283.846962:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788361283.846972:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788361283.848399:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788361283.848410:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788361283.850919:0:28037:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361283.851195:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788361283.851202:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788361283.851935:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788361283.851943:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788361283.891790:0:28037:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361283.891958:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788361283.891964:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788361283.893456:0:28037:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788361283.893468:0:28037:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788361283.894277:0:28037:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788361283.894299:0:28037:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788361283.894305:0:28037:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788361283.904272:0:28037:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788361283.904309:0:28037:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788361283.904314:0:28037:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788361283.904316:0:28037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361283.904318:0:28037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361283.904319:0:28037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361283.904320:0:28037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361283.904322:0:28037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361283.904324:0:28037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361283.904325:0:28037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361283.904327:0:28037:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361283.904330:0:28037:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788361283.904332:0:28037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361283.904334:0:28037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361283.904335:0:28037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361283.904336:0:28037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361283.904337:0:28037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361283.904338:0:28037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361283.904340:0:28037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361283.904341:0:28037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361283.904342:0:28037:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361283.904452:0:28037:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788361283.904751:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137344:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361283.904820:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361283.904922:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85014f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361283.904971:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144137344 00000100:00100000:0.0:1788361283.904978:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144137344 00000100:00100000:0.0:1788361283.905079:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788361283.905118:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+12:28037:x1875232144137344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361283.905157:0:27398:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788361283.905161:0:27398:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788361283.905165:0:27398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788361283.917610:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+12:28037:x1875232144137344:12345-0@lo:253:mount.lustre.0 Request processed in 12479us (12774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361283.917630:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788361283.917648:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137344:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361283.917673:0:28037:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788361283.917678:0:28037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361283.917680:0:28037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361283.917681:0:28037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361283.917700:0:28037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361283.917702:0:28037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361283.917703:0:28037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361283.917705:0:28037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361283.917707:0:28037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361283.917709:0:28037:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788361283.917736:0:28037:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8ac05c4000 from lustre-OST0000 10000000:01000000:3.0:1788361283.917787:0:28037:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788361283.917790:0:28037:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788361283.917799:0:28037:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8a84f13380 local copy 00010000:00010000:3.0:1788361283.917811:0:28037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361283.918883:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361283.918953:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361283.919185:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85014a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361283.919410:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144137472 00000100:00100000:0.0:1788361283.919420:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144137472 00000100:00100000:0.0:1788361283.919534:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361283.919545:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+12:28037:x1875232144137472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361283.919800:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+12:28037:x1875232144137472:12345-0@lo:501:mount.lustre.0 Request processed in 257us (846us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361283.919809:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788361283.919967:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137472:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788361283.919990:0:28037:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788361283.920249:0:28037:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788361283.920259:0:28037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.920271:0:28037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361283.920299:0:28037:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8ac05c4000 10000000:01000000:1.0:1788361283.920312:0:28037:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788361283.920318:0:28037:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a8a84f13380 10000000:01000000:1.0:1788361283.920321:0:28037:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788361283.920325:0:28037:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a8a84f13380 from 1 10000000:01000000:1.0:1788361283.920329:0:28037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788361283.920366:0:28037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9000/0xf6a94c97d66131e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.920375:0:28037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9000/0xf6a94c97d66131e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.920384:0:28037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9000/0xf6a94c97d66131e3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361283.920404:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361283.920453:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361283.920490:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361283.920580:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144137600 00000100:00100000:0.0:1788361283.920586:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144137600 00000100:00100000:0.0:1788361283.920632:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788361283.920640:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+12:28037:x1875232144137600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361283.920653:0:27398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361283.920670:0:27398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965600/0xf6a94c97d66131ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66131e3 expref: -99 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361283.920707:0:27398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965600/0xf6a94c97d66131ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66131e3 expref: 13 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361283.920719:0:27398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965600/0xf6a94c97d66131ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66131e3 expref: 13 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361283.920729:0:27398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965600, rc 0) 00000100:00100000:0.0:1788361283.920879:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+13:28037:x1875232144137600:12345-0@lo:101:mount.lustre.0 Request processed in 240us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361283.920887:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788361283.920973:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361283.920990:0:28037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9000/0xf6a94c97d66131e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131ea expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.921000:0:28037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9000/0xf6a94c97d66131e3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66131ea expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361283.921018:0:28037:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788361283.921034:0:28037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9000/0xf6a94c97d66131e3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131ea expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.921042:0:28037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9000/0xf6a94c97d66131e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131ea expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361283.921060:0:28037:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788361283.921065:0:28037:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361283.921070:0:28037:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788361283.921073:0:28037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788361283.921179:0:28037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.921187:0:28037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.921195:0:28037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361283.921209:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361283.921238:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361283.921663:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361283.921990:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144137728 00000100:00100000:2.0:1788361283.921998:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144137728 00000100:00100000:2.0:1788361283.922111:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788361283.922121:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+13:28037:x1875232144137728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361283.922134:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361283.922149:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8400/0xf6a94c97d66131f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66131f1 expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361283.922171:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8400/0xf6a94c97d66131f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66131f1 expref: 14 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361283.922180:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b8400/0xf6a94c97d66131f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66131f1 expref: 14 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361283.922188:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8400, rc 0) 00000100:00100000:2.0:1788361283.922247:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+14:28037:x1875232144137728:12345-0@lo:101:mount.lustre.0 Request processed in 130us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361283.922254:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788361283.922334:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361283.922348:0:28037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.922357:0:28037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361283.923218:0:28037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 14 count 14 00000040:00080000:1.0:1788361283.924206:0:28037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361283.924505:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:1.0:1788361283.924552:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:1.0:1788361283.924586:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:1.0:1788361283.924649:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:1.0:1788361283.924685:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:1.0:1788361283.924721:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:1.0:1788361283.924773:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:1.0:1788361283.924811:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:1.0:1788361283.924842:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 80 off9712 00000040:00080000:1.0:1788361283.924887:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9936 00000040:00080000:1.0:1788361283.924924:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10160 00000040:00080000:1.0:1788361283.924975:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 120 off10280 00000040:00080000:1.0:1788361283.925036:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 224 off10504 00000040:00080000:1.0:1788361283.925044:0:28037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 14 00000100:00100000:1.0:1788361283.925189:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361283.925278:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361283.925328:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788361283.925570:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144137856 00000100:00100000:0.0:1788361283.925580:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144137856 00000100:00100000:0.0:1788361283.925641:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788361283.925651:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+14:28037:x1875232144137856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361283.926330:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+14:28037:x1875232144137856:12345-0@lo:501:mount.lustre.0 Request processed in 677us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361283.926340:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361283.928288:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361283.928389:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361283.928494:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361283.928549:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788361283.928671:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144137984 00000100:00100000:3.0:1788361283.928682:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144137984 00000100:00100000:3.0:1788361283.928804:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788361283.928816:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+14:28037:x1875232144137984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361283.932381:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+14:28037:x1875232144137984:12345-0@lo:503:mount.lustre.0 Request processed in 3554us (3874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361283.932398:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788361283.932553:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144137984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361283.933301:0:28037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361283.933407:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361283.933490:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361283.933542:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788361283.933857:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144138112 00000100:00100000:2.0:1788361283.933868:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144138112 00000100:00100000:2.0:1788361283.933926:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788361283.933949:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+14:28037:x1875232144138112:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361283.934333:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+14:28037:x1875232144138112:12345-0@lo:502:mount.lustre.0 Request processed in 387us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361283.934345:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788361283.934370:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361283.934805:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:1.0:1788361283.934880:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:1.0:1788361283.934916:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:1.0:1788361283.934979:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:1.0:1788361283.935020:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:1.0:1788361283.935058:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:1.0:1788361283.935178:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:1.0:1788361283.935226:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:1.0:1788361283.935258:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 80 off9712 00000040:00080000:1.0:1788361283.935303:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9936 00000040:00080000:1.0:1788361283.935339:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10160 00000040:00080000:1.0:1788361283.935401:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 120 off10280 00000100:00100000:1.0:1788361283.935461:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361283.935545:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361283.935592:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788361283.935867:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144138240 00000100:00100000:3.0:1788361283.935876:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144138240 00000100:00100000:3.0:1788361283.935931:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788361283.935943:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+14:28037:x1875232144138240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361283.936516:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+14:28037:x1875232144138240:12345-0@lo:502:mount.lustre.0 Request processed in 574us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361283.936526:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788361283.936941:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361283.937073:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 224 off10504 00000040:00080000:1.0:1788361283.937141:0:28037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788361283.941269:0:28051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788361283.941285:0:28051:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788361283.941293:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361283.941295:0:28051:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788361283.941302:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361283.941321:0:28051:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a8ab74619c0) 00000020:00000080:1.0:1788361283.941348:0:28051:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788361283.941354:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788361283.941441:0:28051:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8ac05c4000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788361283.941451:0:28051:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788361283.941458:0:28051:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d6613206 00010000:00010000:1.0:1788361283.951392:0:28051:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788361283.952378:0:28051:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 17179869195 00080000:10000000:1.0:1788361283.956284:0:28051:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00000020:00000080:2.0:1788361283.958297:0:28051:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788361283.958314:0:28051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361283.958323:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361283.958327:0:28051:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788361283.958331:0:28051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788361283.958334:0:28051:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788361283.958336:0:28051:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361283.958337:0:28051:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361283.958339:0:28051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788361283.958341:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361283.958343:0:28051:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788361283.958346:0:28051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361283.958349:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361283.958350:0:28051:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788361283.958353:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788361283.958356:0:28051:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788361283.958357:0:28051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361283.958360:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361283.958361:0:28051:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788361283.958363:0:28051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361283.958365:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361283.958367:0:28051:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788361283.958370:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788361283.958469:0:28051:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361283.958472:0:28051:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361283.958474:0:28051:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788361283.958478:0:28051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000020:01000000:1.0:1788361283.958575:0:28037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788361283.958625:0:28037:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788361283.958655:0:28037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.958665:0:28037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361283.958672:0:28037:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8ac05c4000 from 1 10000000:01000000:1.0:1788361283.958674:0:28037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361283.958956:0:28037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.958964:0:28037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.958974:0:28037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361283.959001:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138368:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361283.959120:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361283.959170:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144138368 00000100:00100000:2.0:1788361283.959181:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144138368 00000100:00100000:0.0:1788361283.959247:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788361283.959833:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788361283.959848:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+14:28037:x1875232144138368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361283.959868:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361283.959887:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6613214 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661320d expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361283.959920:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6613214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661320d expref: 15 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361283.959933:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6613214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661320d expref: 15 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361283.959943:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361283.960017:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144138368:12345-0@lo:101:mount.lustre.0 Request processed in 174us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361283.960025:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788361283.961612:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138368:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361283.961649:0:28037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.961664:0:28037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361283.962458:0:28037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000040:00080000:1.0:1788361283.962884:0:28037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361283.963274:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:1.0:1788361283.963346:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:1.0:1788361283.963409:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:1.0:1788361283.963470:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:1.0:1788361283.963507:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:1.0:1788361283.963558:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:1.0:1788361283.963596:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:1.0:1788361283.963629:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:1.0:1788361283.963700:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:1.0:1788361283.963708:0:28037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 9 count 10 00000100:00100000:1.0:1788361283.963804:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361283.963889:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361283.963952:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788361283.963960:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144138496 00000100:00100000:0.0:1788361283.963970:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144138496 00000100:00100000:0.0:1788361283.964029:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788361283.964039:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144138496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361283.964326:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144138496:12345-0@lo:501:mount.lustre.0 Request processed in 287us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361283.964336:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788361283.965021:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361283.965072:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138624:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361283.965310:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361283.965353:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788361283.965402:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144138624 00000100:00100000:3.0:1788361283.965410:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144138624 00000100:00100000:3.0:1788361283.965504:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788361283.965516:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144138624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361283.965817:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144138624:12345-0@lo:503:mount.lustre.0 Request processed in 305us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361283.965824:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788361283.965888:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138624:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361283.966653:0:28037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361283.966722:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361283.966775:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361283.966815:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361283.966925:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144138752 00000100:00100000:0.0:1788361283.966938:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144138752 00000100:00100000:0.0:1788361283.966982:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788361283.966990:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144138752:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361283.967390:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144138752:12345-0@lo:502:mount.lustre.0 Request processed in 401us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361283.967397:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788361283.967424:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361283.967959:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:1.0:1788361283.968020:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:1.0:1788361283.968075:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:0.0:1788361283.969081:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:0.0:1788361283.969198:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:0.0:1788361283.969264:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:0.0:1788361283.969297:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:0.0:1788361283.969326:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000100:00100000:0.0:1788361283.969379:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138880:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361283.969480:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361283.969528:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05feb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361283.970602:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144138880 00000100:00100000:3.0:1788361283.970616:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144138880 00000100:00100000:3.0:1788361283.970680:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788361283.970691:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144138880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361283.971168:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144138880:12345-0@lo:502:mount.lustre.0 Request processed in 477us (1687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361283.971179:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788361283.971359:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144138880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361283.971542:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:0.0:1788361283.971559:0:28037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788361283.976862:0:28055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361283.976881:0:28055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361283.976883:0:28055:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788361283.976892:0:28055:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8ac05c4000 00000020:00000080:0.0:1788361283.976894:0:28055:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361283.976903:0:28055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361283.976905:0:28055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361283.976907:0:28055:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788361283.976909:0:28055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361283.976912:0:28055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361283.976913:0:28055:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788361283.976917:0:28055:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8ac05c4000 00000020:00000080:0.0:1788361283.976919:0:28055:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361283.977044:0:28055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361283.977048:0:28055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361283.977049:0:28055:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788361283.977052:0:28055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361283.977055:0:28055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361283.977056:0:28055:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788361283.977060:0:28055:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8ac05c4000 00000020:00000080:0.0:1788361283.977062:0:28055:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361283.977653:0:28055:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361283.977659:0:28055:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361283.977661:0:28055:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788361283.977665:0:28055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000020:01000000:1.0:1788361283.978973:0:28037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788361283.979017:0:28037:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361283.979203:0:28037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.979220:0:28037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361283.979284:0:28037:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361283.979288:0:28037:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8ac05c4000 10000000:01000000:1.0:1788361283.979292:0:28037:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8ac05c4000 10000000:01000000:1.0:1788361283.979297:0:28037:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361283.979303:0:28037:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8ac05c4000 from 1 10000000:01000000:1.0:1788361283.979307:0:28037:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361283.979358:0:28037:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.979368:0:28037:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.979382:0:28037:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361283.979415:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361283.979519:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361283.979576:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788361283.979714:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144139008 00000100:00100000:2.0:1788361283.979724:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144139008 00000100:00100000:2.0:1788361283.979786:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788361283.979797:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144139008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361283.979814:0:27398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361283.979830:0:27398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b9c00/0xf6a94c97d6613222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661321b expref: -99 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361283.979860:0:27398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b9c00/0xf6a94c97d6613222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661321b expref: 16 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361283.979872:0:27398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b9c00/0xf6a94c97d6613222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661321b expref: 16 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361283.979897:0:27398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9c00, rc 0) 00000100:00100000:2.0:1788361283.979944:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+16:28037:x1875232144139008:12345-0@lo:101:mount.lustre.0 Request processed in 149us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361283.979951:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788361283.980189:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361283.980208:0:28037:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361283.980217:0:28037:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361283.984074:0:28037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000040:00080000:0.0:1788361283.985600:0:28037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361283.986143:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:0.0:1788361283.986201:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:0.0:1788361283.986263:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:0.0:1788361283.986317:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:0.0:1788361283.986356:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:0.0:1788361283.986408:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:0.0:1788361283.986461:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:0.0:1788361283.986499:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:0.0:1788361283.986550:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:0.0:1788361283.986586:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:0.0:1788361283.986624:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:0.0:1788361283.986677:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:0.0:1788361283.986716:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:0.0:1788361283.987900:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:0.0:1788361283.988034:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:0.0:1788361283.988081:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:0.0:1788361283.988159:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:0.0:1788361283.988233:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:0.0:1788361283.988309:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:0.0:1788361283.988362:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:0.0:1788361283.988443:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:0.0:1788361283.988495:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:0.0:1788361283.988534:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:0.0:1788361283.988589:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:0.0:1788361283.988646:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 128 off12440 00000040:00080000:0.0:1788361283.988704:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12664 00000040:00080000:0.0:1788361283.989001:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12888 00000040:00080000:0.0:1788361283.989067:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off12968 00000040:00080000:0.0:1788361283.989399:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13192 00000040:00080000:0.0:1788361283.989497:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13416 00000040:00080000:0.0:1788361283.989559:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13504 00000040:00080000:0.0:1788361283.989617:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13632 00000040:00080000:0.0:1788361283.989684:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13776 00000040:00080000:0.0:1788361283.989874:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13904 00000040:00080000:0.0:1788361283.989992:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14128 00000040:00080000:0.0:1788361283.990204:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14352 00000040:00080000:0.0:1788361283.990299:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14432 00000040:00080000:0.0:1788361283.990366:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14656 00000040:00080000:0.0:1788361283.990480:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14880 00000040:00080000:0.0:1788361283.990570:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 120 off15000 00000040:00080000:0.0:1788361283.991994:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 224 off15224 00000040:00080000:0.0:1788361283.992016:0:28037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 41 count 42 00000100:00100000:0.0:1788361283.992181:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361283.992280:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361283.992353:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144139136 00000100:00100000:0.0:1788361283.992356:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361283.992370:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144139136 00000100:00100000:2.0:1788361283.992451:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788361283.992463:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+16:28037:x1875232144139136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361283.992855:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+16:28037:x1875232144139136:12345-0@lo:501:mount.lustre.0 Request processed in 393us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361283.992862:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788361283.993707:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361283.993848:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361283.993920:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361283.997956:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361283.998290:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144139264 00000100:00100000:2.0:1788361283.998307:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144139264 00000100:00100000:2.0:1788361283.998513:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788361283.998524:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+16:28037:x1875232144139264:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361284.001002:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+16:28037:x1875232144139264:12345-0@lo:503:mount.lustre.0 Request processed in 2471us (7072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361284.001017:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788361284.001078:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139264:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361284.003287:0:28037:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361284.003416:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361284.003539:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361284.003589:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361284.003706:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144139392 00000100:00100000:2.0:1788361284.003717:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144139392 00000100:00100000:2.0:1788361284.003792:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788361284.003805:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+16:28037:x1875232144139392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361284.004138:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+16:28037:x1875232144139392:12345-0@lo:502:mount.lustre.0 Request processed in 334us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361284.004149:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361284.004866:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361284.005233:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:1.0:1788361284.005301:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:1.0:1788361284.005339:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:1.0:1788361284.005389:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:1.0:1788361284.005438:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:1.0:1788361284.005509:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:1.0:1788361284.005550:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:1.0:1788361284.005586:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:1.0:1788361284.005634:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:1.0:1788361284.005668:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:1.0:1788361284.005702:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:1.0:1788361284.008124:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:1.0:1788361284.008227:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:1.0:1788361284.008259:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:1.0:1788361284.008304:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:1.0:1788361284.008340:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:1.0:1788361284.008452:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:1.0:1788361284.008504:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:1.0:1788361284.008541:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:1.0:1788361284.008578:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:1.0:1788361284.008640:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:1.0:1788361284.008679:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:1.0:1788361284.008727:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:1.0:1788361284.008780:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:1.0:1788361284.008815:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 128 off12440 00000040:00080000:1.0:1788361284.008847:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12664 00000040:00080000:1.0:1788361284.009134:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12888 00000040:00080000:1.0:1788361284.009194:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off12968 00000040:00080000:1.0:1788361284.009229:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13192 00000040:00080000:1.0:1788361284.009281:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13416 00000040:00080000:1.0:1788361284.009319:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13504 00000040:00080000:1.0:1788361284.009354:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13632 00000040:00080000:1.0:1788361284.009402:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13776 00000040:00080000:1.0:1788361284.009466:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13904 00000040:00080000:1.0:1788361284.009502:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14128 00000040:00080000:1.0:1788361284.009549:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14352 00000040:00080000:1.0:1788361284.009586:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14432 00000040:00080000:1.0:1788361284.009619:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14656 00000040:00080000:1.0:1788361284.009669:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14880 00000040:00080000:1.0:1788361284.009716:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 120 off15000 00000100:00100000:1.0:1788361284.009782:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361284.010570:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361284.010634:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88156540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361284.010757:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144139520 00000100:00100000:2.0:1788361284.010769:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144139520 00000100:00100000:2.0:1788361284.010836:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788361284.010849:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+16:28037:x1875232144139520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361284.011222:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+16:28037:x1875232144139520:12345-0@lo:502:mount.lustre.0 Request processed in 374us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361284.011232:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788361284.013256:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361284.013471:0:28037:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 224 off15224 00000040:00080000:1.0:1788361284.013491:0:28037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788361284.017163:0:28060:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788361284.017185:0:28060:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a8984a599c0) 00000020:00000080:3.0:1788361284.017214:0:28060:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788361284.017404:0:28060:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8ac05c4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788361284.017409:0:28060:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8ac05c4000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788361284.017412:0:28060:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8ac05c4000 3 00010000:00080000:3.0:1788361284.018846:0:28060:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a8a108800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361284.021132:0:28060:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788361284.021276:0:28060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788361284.021333:0:28060:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788361284.021351:0:28060:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf6a94c97d6613230 00000100:00080000:3.0:1788361284.021365:0:28060:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361284.021372:0:28060:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8a8a108800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361284.021418:0:28060:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac1565880 x1875232144139648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361284.022066:0:28060:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788361284.022143:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361284.022153:0:15670:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788361284.022156:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361284.022159:0:15670:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788361284.022203:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144139648:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361284.022225:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361284.022237:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144139776:0@lo:400:kworker.0 00000100:00100000:2.0:1788361284.024115:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361284.024375:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144139776 00000100:00100000:0.0:1788361284.024386:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144139776 00000100:00100000:0.0:1788361284.024546:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361284.024558:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144139776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361284.024635:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144139776:12345-0@lo:400:kworker.0 Request processed in 79us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361284.024643:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788361284.024846:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8a834c9f80 x1875232144139776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361284.024864:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144139776:0@lo:400:kworker.0 00000100:00100000:1.0:1788361284.025114:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361284.025925:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144139648 00000100:00100000:3.0:1788361284.025935:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144139648 00000100:00100000:3.0:1788361284.025975:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361284.025993:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144139648:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788361284.026039:0:27403:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:3.0:1788361284.026082:0:27403:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf6a94c97d6613237 00000004:00100000:3.0:1788361284.026123:0:27403:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788361284.026164:0:27403:0:(import.c:65:import_set_state_nolock()) ffff9a8a89868000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361284.026237:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875232144139648:12345-0@lo:38:llog_process_th.0 Request processed in 254us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361284.026244:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788361284.026292:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8ac1565880 x1875232144139648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361284.026305:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361284.026314:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 5 00000100:00080000:3.0:1788361284.026323:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788361284.026329:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361284.026332:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a108800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361284.026339:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144139648:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788361284.026690:0:28060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000020:01000000:3.0:1788361284.026796:0:28037:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788361284.026836:0:28037:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788361284.026858:0:28037:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361284.026898:0:28037:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788361284.026955:0:28037:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788361284.026958:0:28037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361284.026960:0:28037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361284.026962:0:28037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361284.026964:0:28037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361284.026966:0:28037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361284.026968:0:28037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361284.026971:0:28037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361284.026973:0:28037:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361284.026979:0:28037:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788361284.027041:0:28037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361284.027043:0:28037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361284.027044:0:28037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361284.027045:0:28037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361284.027046:0:28037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361284.027048:0:28037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361284.027049:0:28037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361284.027051:0:28037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361284.027052:0:28037:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361284.027081:0:28037:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788361284.027147:0:28037:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361284.027208:0:28037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361284.027254:0:28037:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361284.027262:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144139904 00000100:00100000:2.0:1788361284.027270:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144139904 00000100:00100000:2.0:1788361284.027320:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361284.027330:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+16:28037:x1875232144139904:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361284.027361:0:27398:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788361284.027377:0:27398:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788361284.059039:0:27398:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788361284.059060:0:27398:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788361284.059136:0:27419:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361284.059147:0:27419:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361284.059170:0:27419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361284.059192:0:27419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985965000/0xf6a94c97d66131ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66131a4 expref: 16 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361284.059201:0:27419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361284.059242:0:27419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985965000/0xf6a94c97d66131ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66131a4 expref: 16 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361284.059264:0:27419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985965000/0xf6a94c97d66131ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66131a4 expref: 16 pid: 27395 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361284.059280:0:27419:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27419:1875232144140032:0@lo:104: 00000100:00100000:0.0:1788361284.059352:0:27419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361284.059412:0:27419:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05feb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361284.059508:0:27387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144140032 00000100:00100000:1.0:1788361284.059516:0:27387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144140032 00000100:00100000:1.0:1788361284.059578:0:27387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361284.059601:0:27387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e46014fe-639d-4b32-8855-95bba88887b0+3:27419:x1875232144140032:12345-0@lo:104: 00010000:00010000:1.0:1788361284.059966:0:27387:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361284.060040:0:27387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361284.060048:0:27387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e46014fe-639d-4b32-8855-95bba88887b0+3:27419:x1875232144140032:12345-0@lo:104: Request processed in 448us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361284.060056:0:27387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788361284.060220:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361284.060231:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060255:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361284.060261:0:27391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060272:0:27391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361284.060281:0:27391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361284.060288:0:27391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361284.060335:0:27391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060344:0:27391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361284.060384:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060393:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8600/0xf6a94c97d66131a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66131ab expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060415:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361284.060418:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361284.060420:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361284.060450:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361284.060508:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e46014fe-639d-4b32-8855-95bba88887b0:3314:1875232144140160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361284.060650:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361284.060731:0:27388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144140160 00000100:00100000:2.0:1788361284.060738:0:27388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144140160 00010000:00010000:2.0:1788361284.060771:0:27388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985965000/0xf6a94c97d66131ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66131a4 expref: 17 pid: 27395 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361284.060808:0:27388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361284.060819:0:27390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788361284.060820:0:27388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e46014fe-639d-4b32-8855-95bba88887b0+17:3314:x1875232144140160:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361284.060850:0:27390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788361284.060866:0:27388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361284.060877:0:27388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985965000/0xf6a94c97d66131ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66131a4 expref: 17 pid: 27395 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060891:0:27388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985965000/0xf6a94c97d66131ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66131a4 expref: 17 pid: 27395 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060914:0:27388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060923:0:27388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361284.060943:0:27388:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002514753s 00010000:00010000:2.0:1788361284.060949:0:27388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060957:0:27388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060965:0:27388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060972:0:27388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.060980:0:27388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361284.060993:0:27388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.061002:0:27388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.061012:0:27388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361284.061025:0:27388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361284.061078:0:27388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e46014fe-639d-4b32-8855-95bba88887b0+17:3314:x1875232144140160:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361284.061131:0:27388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361284.061191:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e46014fe-639d-4b32-8855-95bba88887b0:3314:1875232144140160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361284.061298:0:27419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965000/0xf6a94c97d66131ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66131a4 expref: 16 pid: 27395 timeout: 774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361284.061313:0:27419:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27419:1875232144140032:0@lo:104: 00010000:00010000:3.0:1788361284.061332:0:27419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361284.061350:0:27419:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361284.061357:0:27419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361284.061363:0:27419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964a00/0xf6a94c97d661323e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361284.069234:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+15:28037:x1875232144139904:12345-0@lo:253:mount.lustre.0 Request processed in 41753us (41872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361284.069254:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361284.069371:0:28037:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28037:1875232144139904:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788361284.069391:0:28037:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788361284.069395:0:28037:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788361284.069397:0:28037:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361284.069399:0:28037:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361284.069400:0:28037:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361284.069402:0:28037:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361284.069403:0:28037:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361284.069405:0:28037:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361284.069408:0:28037:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361284.069410:0:28037:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788361284.069437:0:28037:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788361284.070276:0:28037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788361284.070458:0:28037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788361284.070806:0:28037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788361284.070957:0:28037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788361284.071322:0:28037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788361284.071520:0:28037:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788361284.072929:0:28037:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836480 00002000:00080000:2.0:1788361284.125566:0:28037:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788361284.125579:0:28037:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788361284.125630:0:28037:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788361284.125716:0:28037:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788361284.125739:0:28037:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788361284.125782:0:28037:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788361284.128232:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788361285.155224:0:27400:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788361285.155231:0:27400:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8987bd6000 from 16 10000000:01000000:0.0:1788361285.155244:0:27400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361285.155282:0:27400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361285.155293:0:27400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361285.155304:0:27400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361285.155329:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144140288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361285.155390:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361285.155459:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8aff8c00 going to sleep for 11 seconds 00010000:00010000:2.0:1788361285.155483:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361285.155504:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144140288 00000100:00100000:3.0:1788361285.155511:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144140288 00000100:00100000:3.0:1788361285.155565:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788361285.155575:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+15:27400:x1875232144140288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361285.155588:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361285.155602:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d661324c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613245 expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361285.155623:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d661324c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613245 expref: 16 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361285.155632:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d661324c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613245 expref: 16 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361285.155641:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:3.0:1788361285.155704:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+16:27400:x1875232144140288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361285.155712:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788361285.155843:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144140288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361285.155857:0:27400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361285.155866:0:27400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361285.155911:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144140416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361285.155942:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361285.155961:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8aff8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361285.156003:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144140416 00000100:00100000:3.0:1788361285.156008:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144140416 00000100:00100000:3.0:1788361285.156040:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788361285.156046:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+16:27400:x1875232144140416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361285.156060:0:27398:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788361285.156076:0:27398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361285.156079:0:27398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 16 00000100:00100000:3.0:1788361285.156175:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+16:27400:x1875232144140416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361285.156181:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788361285.156209:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144140416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361285.156261:0:27400:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361285.156268:0:27400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361285.156276:0:27400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361286.112167:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361276/real 1788361276] req@ffff9a89859c9180 x1875232144133888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361286.112199:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a89859c9180 x1875232144133888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361286.112208:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361276/real 1788361276] req@ffff9a89859c8000 x1875232144133760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361286 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361286.112218:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a89859c8000 x1875232144133760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361286 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361286.112237:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361286.112291:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788361286.112297:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144133888:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788361286.112306:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89852f3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361286.112316:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788361286.112319:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144133760:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788361286.112462:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e46014fe-639d-4b32-8855-95bba88887b0:3314:1875232144140544:0@lo:400:kworker.0 00000100:00100000:1.0:1788361286.112562:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361286.114548:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361286.114558:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788361286.114562:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a89852f3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361286.114570:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:0.0:1788361286.114577:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361286.114595:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a89852f3000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361286.114630:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a843e9500 x1875232144140672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361286.114658:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361286.114661:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788361286.114663:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361286.114666:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 666 00000100:00080000:0.0:1788361286.114669:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361286.114672:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8a8a129000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361286.114685:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a843e9880 x1875232144140800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361286.114742:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144141056:0@lo:400:kworker.0 00000100:00100000:2.0:1788361286.114765:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144140928:0@lo:400:kworker.0 00000100:00100000:3.0:1788361286.114833:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361286.115181:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144140544 00000100:00100000:1.0:1788361286.115190:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144140544 00000100:00100000:1.0:1788361286.115356:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788361286.115366:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+16:3314:x1875232144140544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361286.115787:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+16:3314:x1875232144140544:12345-0@lo:400:kworker.0 Request processed in 421us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361286.115798:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361286.115828:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144141056 00000100:00100000:1.0:1788361286.115860:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e46014fe-639d-4b32-8855-95bba88887b0:3314:1875232144140544:0@lo:400:kworker.0 00000100:00100000:0.0:1788361286.115948:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144141056 00000100:00100000:0.0:1788361286.116002:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361286.116010:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144141056:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361286.116040:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361286.116056:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361286.116412:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144141056:12345-0@lo:400:kworker.0 Request processed in 402us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361286.116434:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361286.116565:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144140672:0@lo:8:kworker.0 00000100:00100000:1.0:1788361286.116609:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144140928 00000100:00100000:1.0:1788361286.116616:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144140928 00000100:00100000:2.0:1788361286.116626:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788361286.116660:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a843ebb80 x1875232144141056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361286.116673:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361286.116684:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144140928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361286.116688:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144140800:0@lo:8:kworker.0 00000100:00100000:2.0:1788361286.116739:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361286.116758:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144140928:12345-0@lo:400:kworker.0 Request processed in 75us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361286.116767:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788361286.116823:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a843ead80 x1875232144140928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361302 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361286.116834:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144140672 00000100:00100000:1.0:1788361286.116838:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144140928:0@lo:400:kworker.0 00000100:00100000:2.0:1788361286.116844:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144140672 00000100:00100000:2.0:1788361286.116882:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144140800 00000100:00100000:2.0:1788361286.116886:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144140800 00000100:00100000:2.0:1788361286.116908:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361286.116915:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144140672:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788361286.116950:0:28038:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:2.0:1788361286.116990:0:28038:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6613253 00002000:00100000:2.0:1788361286.117008:0:28038:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a8ac1c6e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788361286.117013:0:28038:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788361286.117017:0:28038:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788361286.117631:0:28038:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788361286.117665:0:28038:0:(import.c:65:import_set_state_nolock()) ffff9a8ac1c6d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361286.117764:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144140672:12345-0@lo:8:kworker.0 Request processed in 847us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361286.117774:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361286.117803:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361286.117810:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144140800:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788361286.117825:0:28038:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788361286.117996:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a843e9500 x1875232144140672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361286.118009:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361286.118019:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 5 00000100:00080000:1.0:1788361286.118031:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788361286.118039:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788361286.118042:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89852f3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788361286.118075:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788361286.118462:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144140672:0@lo:8:kworker.0 00000004:00080000:1.0:1788361286.118542:0:27426:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x63:0x0] 00000100:00100000:1.0:1788361286.118566:0:27426:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:27426:1875232144141312:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361286.118609:0:27426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361286.118630:0:27426:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a829ec540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361286.118643:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144141184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361286.118669:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361286.118703:0:28040:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788361286.118711:0:28040:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788361286.118875:0:28040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144141312 00000100:00100000:1.0:1788361286.118882:0:28040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144141312 00000100:00080000:1.0:1788361286.118953:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361286.119056:0:28204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361286.119069:0:28204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:27426:x1875232144141312:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788361286.120379:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144141056:0@lo:400:kworker.0 00000004:00080000:0.0:1788361286.120451:0:27425:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788361286.122282:0:27425:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 676137193850ns, next at 0ns, rc = 0 00002000:00080000:1.0:1788361286.125822:0:28204:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788361286.125839:0:28204:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -30 00002000:02000040:1.0:1788361286.125846:0:28204:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:100 to 0x240000400:129) 00000100:00100000:2.0:1788361286.130675:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144141184 00000100:00100000:2.0:1788361286.131291:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144141184 00000100:00100000:2.0:1788361286.131368:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361286.131391:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144141184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361286.131449:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361286.131569:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144141184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (12899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361286.131578:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788361286.131655:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a89859c8000 x1875232144141184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361286.131781:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144140800:12345-0@lo:8:kworker.0 Request processed in 13963us (15036us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361286.131799:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788361286.131853:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361286.131864:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361286.131869:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144140800:0@lo:8:kworker.0 00000100:00100000:2.0:1788361286.132278:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144141184:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1788361286.151718:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.151737:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661325a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.151759:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x81:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.151765:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.151773:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661325a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.151805:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661325a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.151817:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661325a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.151825:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661325a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.151849:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.151865:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.151872:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661325a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.151881:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.151886:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661325a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.151897:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661325a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.151917:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661325a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.151925:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661325a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.151951:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.151952:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.151954:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.152520:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.152526:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613261 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.152536:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x80:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.152540:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.152544:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613261 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.152555:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613261 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.152562:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613261 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.152569:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613261 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.152588:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.152599:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.152604:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613261 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.152624:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.152628:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613261 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.152636:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613261 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.152648:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613261 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.152655:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613261 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.152669:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.152671:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.152672:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.153120:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.153126:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613268 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.153136:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7f:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.153140:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.153144:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.153154:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.153170:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.153178:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.153195:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.153205:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.153210:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.153218:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.153221:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.153229:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.153241:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613268 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.153248:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613268 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.153262:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.153270:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.153272:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.161472:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.161488:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661326f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.161510:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7e:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.161516:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.161524:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661326f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.161543:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661326f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.161556:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661326f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.161565:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661326f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.161591:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.161611:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.161618:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661326f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.161627:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.161632:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661326f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.161654:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661326f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.161674:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661326f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.161976:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661326f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.161997:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.161999:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.162000:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.162622:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.162630:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d6613276 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.162641:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7d:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.162645:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.162651:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d6613276 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.162664:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d6613276 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.162674:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d6613276 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.162704:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d6613276 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.162724:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.162739:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.162745:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d6613276 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.162753:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.162758:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d6613276 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.162766:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d6613276 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.162781:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d6613276 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.162789:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d6613276 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.162804:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.162806:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.162808:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.163297:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.163313:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661327d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163323:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7c:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.163326:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.163331:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661327d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163342:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661327d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163350:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661327d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163358:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661327d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163376:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.163387:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.163391:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661327d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163399:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.163402:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661327d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163409:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661327d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163438:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661327d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163446:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d661327d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163460:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.163463:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.163465:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.163885:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.163892:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d6613284 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163901:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7b:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.163904:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.163908:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d6613284 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163919:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d6613284 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163928:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d6613284 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163936:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d6613284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163962:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.163971:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.163976:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d6613284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163984:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.163988:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d6613284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.163995:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d6613284 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.164007:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d6613284 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.164014:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d6613284 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.164030:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.164032:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.164033:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.171171:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.171192:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661328b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.171216:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7a:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.171231:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.171240:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661328b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.171259:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661328b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.171272:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661328b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.171281:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661328b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.171313:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361286.172040:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.172048:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613292 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172058:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x79:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.172061:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.172066:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172076:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172119:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172137:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172159:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361286.172181:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361286.172189:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661328b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172197:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.172202:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661328b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172213:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661328b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172234:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661328b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172242:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d661328b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172261:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.172265:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172282:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.172285:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172294:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613292 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172304:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613292 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172311:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d6613292 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172322:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.172324:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.172326:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.172855:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.172864:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613299 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172874:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x78:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.172878:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.172883:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172893:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172908:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172916:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172932:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.172944:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.172948:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172955:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.172959:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172967:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613299 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172978:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613299 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.172986:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d6613299 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.173004:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.173011:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.173014:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.174901:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.175435:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.175449:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d66132a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.175469:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x77:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.175474:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.175481:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d66132a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.175496:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d66132a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.175508:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d66132a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.175516:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d66132a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.175549:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361286.176279:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361286.176297:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d66132a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.176309:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.176313:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d66132a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.176324:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d66132a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.176348:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d66132a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.176355:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d66132a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.176379:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.176381:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.176382:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.179533:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.179553:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.179573:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x76:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.179579:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.179587:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.179613:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.179625:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.179634:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.179655:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361286.179978:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361286.179988:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.179998:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.180003:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.180027:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.180048:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.180056:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.180077:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.180080:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.180081:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.180118:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.180939:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.180947:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.180958:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x75:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.180962:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.180967:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.180978:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.180987:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.181007:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.181035:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361286.181558:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.181565:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.181574:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x74:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.181578:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.181582:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181587:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.181594:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181596:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.181614:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181616:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361286.181623:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.181629:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181638:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.181655:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361286.181665:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181675:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181693:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361286.181697:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181703:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361286.181707:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181715:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181726:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181732:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.181748:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361286.181749:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361286.181757:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.182110:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.182117:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.182132:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.182135:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.182139:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.182150:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.182158:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.182165:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.182180:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361286.182224:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361286.182230:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.182238:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361286.182242:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.182251:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.182315:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.182322:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.182340:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361286.182342:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361286.182343:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.182667:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.186219:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.186238:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.186270:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.186276:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.186284:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.186302:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.186325:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.186334:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.186360:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.186380:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.186387:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.186396:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.186402:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.186412:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.187547:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.187568:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.187597:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.187609:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.187611:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.190327:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.190342:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.190362:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x71:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.190367:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x71:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.190374:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.190391:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.190402:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.190410:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.190444:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.190463:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.190472:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.190480:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.190484:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.190509:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.190605:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.190614:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.190633:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.190634:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.190636:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.193951:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.193969:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.193991:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x70:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.193997:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.194004:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.194022:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.194034:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.194061:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.194082:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361286.194133:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361286.194143:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.194155:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.194170:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.194182:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.194202:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.194219:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d66132d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.194241:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.194244:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.194246:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.195432:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.195844:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053366688/0xf6a94c97d66132d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.195882:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6f:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.195888:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.195896:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053366688/0xf6a94c97d66132d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.195911:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053366688/0xf6a94c97d66132d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.195934:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053366688/0xf6a94c97d66132d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.195943:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053366688/0xf6a94c97d66132d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.195998:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361286.196491:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361286.196502:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053366688/0xf6a94c97d66132d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.196622:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.196629:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053366688/0xf6a94c97d66132d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.196640:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053366688/0xf6a94c97d66132d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.196660:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053366688/0xf6a94c97d66132d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.196669:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053366688/0xf6a94c97d66132d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.196693:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.196695:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.196697:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.197628:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.197640:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.197662:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6e:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.197668:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.197674:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.197765:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.197776:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.197784:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.197809:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.197826:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.197832:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.197840:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.197845:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.197852:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.197894:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.197902:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ce77a6e/0xf6a94c97d66132df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.197920:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.197922:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.197926:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788361286.198520:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788361286.198953:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.198961:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.198973:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6d:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.198977:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.198982:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.198995:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199002:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199009:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199040:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361286.199348:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361286.199362:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.199375:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361286.199380:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.199411:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.199448:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.199458:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d2a8912/0xf6a94c97d66132e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.199492:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361286.199496:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361286.199505:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.199844:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.199852:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199863:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6c:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.199866:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.199871:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199881:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199890:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199898:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199915:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361286.199927:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361286.199932:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199939:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361286.199949:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199960:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199976:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.199984:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027b2903/0xf6a94c97d66132ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.200002:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.200004:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361286.200006:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.200874:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.200882:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.200893:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6b:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.200896:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.200901:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.200911:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.200919:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.200934:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.200956:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361286.200993:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361286.201006:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.201020:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361286.201025:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.201277:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.201297:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.201323:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000747d799e/0xf6a94c97d66132f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361286.201350:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361286.201354:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361286.201356:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.202602:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.202617:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.202634:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6a:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.202639:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.202645:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.202660:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.202671:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.202992:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.203031:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361286.203377:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361286.203386:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.203396:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.203400:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.203410:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.203442:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.203449:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2193529/0xf6a94c97d66132fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.203470:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.203472:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.203474:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.203778:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.203784:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d6613302 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.203804:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x69:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.203808:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.203814:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d6613302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.203825:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d6613302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.203834:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d6613302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.203841:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d6613302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.203864:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361286.204000:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361286.204007:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d6613302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.204015:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.204019:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d6613302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.204040:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d6613302 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.204055:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d6613302 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.204062:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b11431dc/0xf6a94c97d6613302 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.204081:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.204101:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.204104:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.204733:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.204740:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d6613309 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.204750:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x68:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.204754:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.204759:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d6613309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.204769:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d6613309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.204791:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d6613309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.204798:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d6613309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.204822:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361286.204846:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361286.204854:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d6613309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.204862:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.204866:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d6613309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.204874:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d6613309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.204888:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d6613309 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.204907:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000632fcfa4/0xf6a94c97d6613309 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.204929:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.204932:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.204934:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.205340:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.206044:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d8b6a2/0xf6a94c97d6613310 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.206058:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x67:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.206062:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.206068:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015d8b6a2/0xf6a94c97d6613310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.206080:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015d8b6a2/0xf6a94c97d6613310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.206108:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015d8b6a2/0xf6a94c97d6613310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.206116:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015d8b6a2/0xf6a94c97d6613310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.206156:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361286.206240:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361286.206248:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015d8b6a2/0xf6a94c97d6613310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.206258:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.206262:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d8b6a2/0xf6a94c97d6613310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.206272:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015d8b6a2/0xf6a94c97d6613310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.206286:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015d8b6a2/0xf6a94c97d6613310 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.206294:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015d8b6a2/0xf6a94c97d6613310 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.206315:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.206316:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.206318:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788361286.207196:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.207203:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6613317 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.207215:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x66:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.207219:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.207224:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6613317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.207816:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6613317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.207826:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6613317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.207834:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6613317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.207862:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788361286.208652:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.208660:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822cc314/0xf6a94c97d661331e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.208672:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x65:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.208694:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.208699:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000822cc314/0xf6a94c97d661331e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.208710:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000822cc314/0xf6a94c97d661331e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.208719:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000822cc314/0xf6a94c97d661331e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.208726:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000822cc314/0xf6a94c97d661331e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.208740:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788361286.209199:0:28204:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361286.209205:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a7db8cb/0xf6a94c97d6613325 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.209212:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x64:0x0].0x0 since=676s v=(0 0) 00010000:00010000:1.0:1788361286.209215:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361286.209218:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a7db8cb/0xf6a94c97d6613325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.209308:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a7db8cb/0xf6a94c97d6613325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.209556:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a7db8cb/0xf6a94c97d6613325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.209571:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a7db8cb/0xf6a94c97d6613325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361286.209580:0:28204:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:1.0:1788361286.209823:0:28204:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:99 00000100:00100000:1.0:1788361286.209923:0:28204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:27426:x1875232144141312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 90855us (91310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361286.209932:0:28204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361286.210487:0:27426:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:27426:1875232144141312:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788361286.210506:0:27426:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x81:0x0] from OST, last_created [0x240000400:0x81:0x0]last_used is [0x240000400:0x63:0x0] 00000100:00100000:1.0:1788361286.210553:0:27426:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:27426:1875232144141440:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361286.210597:0:27426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361286.210656:0:27426:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361286.210784:0:28040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144141440 00000100:00100000:2.0:1788361286.210800:0:28040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144141440 00000100:00100000:2.0:1788361286.210879:0:28040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361286.210890:0:28040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:27426:x1875232144141440:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788361286.210959:0:28040:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 130 00010000:00010000:0.0:1788361286.211113:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788361286.211124:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6613317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211136:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.211140:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6613317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211151:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6613317 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211170:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6613317 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211179:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6613317 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211198:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361286.211201:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000822cc314/0xf6a94c97d661331e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211208:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.211210:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000822cc314/0xf6a94c97d661331e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211217:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000822cc314/0xf6a94c97d661331e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211240:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000822cc314/0xf6a94c97d661331e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211247:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000822cc314/0xf6a94c97d661331e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211260:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361286.211263:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a7db8cb/0xf6a94c97d6613325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211269:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361286.211271:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a7db8cb/0xf6a94c97d6613325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211278:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a7db8cb/0xf6a94c97d6613325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211287:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a7db8cb/0xf6a94c97d6613325 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211294:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a7db8cb/0xf6a94c97d6613325 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361286.211307:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.211309:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.211318:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361286.211325:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361286.227015:0:28040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:27426:x1875232144141440:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16114us (16405us total) trans 21474836481 rc 0/0 00000100:00100000:2.0:1788361286.227119:0:27426:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:27426:1875232144141440:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361286.227132:0:28040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:2.0:1788361286.227144:0:27426:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x81:0x0]-[0x240000400:0xa1:0x0] 00010000:00010000:0.0:1788361287.200309:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361288.224502:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361288.480304:0:27435:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788361288.480312:0:27435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361288.480702:0:27435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 5 count 3 00000040:00080000:3.0:1788361288.480709:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 2 00000001:02000400:3.0:1788361288.769261:0:28406:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788361289.248702:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788361289.436568:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836481 is committed 00000001:00100000:0.0:1788361289.436622:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788361290.272318:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361291.300647:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361291.425937:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144141568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361291.426009:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361291.426453:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144141568 00000100:00100000:2.0:1788361291.426462:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144141568 00000100:00080000:3.0:1788361291.426526:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361291.426545:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361291.426556:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144141568:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788361291.426581:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361291.426585:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788361291.426589:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00002000:00000024:2.0:1788361291.426593:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00080000:3.0:1788361291.426595:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 676 00000100:00080000:3.0:1788361291.426602:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788361291.426609:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8a8a129000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361291.426631:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac1566d80 x1875232144141824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361291.426651:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144141568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361291.426661:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361291.426682:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144141696:0@lo:400:kworker.0 00000100:00100000:2.0:1788361291.426716:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836481 gen 2 00000100:00100000:3.0:1788361291.426723:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361291.426742:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144141568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361291.426757:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361291.426759:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361291.426766:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144141952:0@lo:400:kworker.0 00000100:00100000:2.0:1788361291.426780:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144142080:0@lo:400:kworker.0 00000100:00100000:3.0:1788361291.426797:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361291.426821:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361291.426830:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144141824:0@lo:8:kworker.0 00000100:00100000:3.0:1788361291.426862:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361291.426864:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144141952 00000100:00100000:2.0:1788361291.426869:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144141952 00000100:00100000:2.0:1788361291.426913:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144142080 00000100:00100000:2.0:1788361291.426917:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144142080 00000100:00100000:2.0:1788361291.426943:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361291.426949:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144141952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361291.426978:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144141696 00000100:00100000:3.0:1788361291.426983:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144141696 00000100:00100000:2.0:1788361291.426996:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144141952:12345-0@lo:400:kworker.0 Request processed in 46us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361291.427004:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361291.427018:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788361291.427024:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361291.427033:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144142080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361291.427065:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144142080:12345-0@lo:400:kworker.0 Request processed in 35us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361291.427071:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788361291.427113:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788361291.427132:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac1564a80 x1875232144141952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361291.427143:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144141952:0@lo:400:kworker.0 00000100:00100000:3.0:1788361291.427161:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+16:3311:x1875232144141696:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788361291.427169:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac1564380 x1875232144142080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361307 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361291.427180:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1564380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144142080:0@lo:400:kworker.0 00000100:00100000:2.0:1788361291.427218:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144141824 00000100:00100000:2.0:1788361291.427222:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144141824 00000100:00100000:2.0:1788361291.427249:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361291.427263:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144141824:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788361291.427279:0:28038:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361291.427854:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+16:3311:x1875232144141696:12345-0@lo:400:kworker.0 Request processed in 825us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361291.427863:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788361291.428571:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144141696:0@lo:400:kworker.0 00000100:00100000:2.0:1788361291.447454:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144141824:12345-0@lo:8:kworker.0 Request processed in 20184us (20585us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361291.447467:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788361291.447517:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361291.447523:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361291.447527:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144141824:0@lo:8:kworker.0 00010000:00010000:2.0:1788361292.324237:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361293.013426:0:28709:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788361293.013431:0:28709:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788361293.013609:0:28709:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8a8a109000 00000020:01000004:1.0:1788361293.013624:0:28709:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788361293.013637:0:28709:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788361293.013649:0:28709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a8ab7460000) 00000020:00000080:1.0:1788361293.013665:0:28709:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788361293.027009:0:28709:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788361293.027286:0:28709:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788361293.028022:0:28709:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788361293.028298:0:28709:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788361293.029200:0:28709:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xd:0x0] (8/32) 00100000:10000000:0.0:1788361293.029623:0:28709:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 589: rc = 0 00100000:10000000:0.0:1788361293.030126:0:28709:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 589: rc = 0 00100000:10000000:0.0:1788361293.030225:0:28709:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 589: rc = 0 00100000:10000000:0.0:1788361293.030691:0:28709:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 776: rc = 0 00100000:10000000:0.0:1788361293.031222:0:28709:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 776: rc = 0 00100000:10000000:0.0:1788361293.031490:0:28709:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 776: rc = 0 00100000:10000000:0.0:1788361293.031682:0:28709:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 776: rc = 0 00100000:10000000:0.0:1788361293.032154:0:28709:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 776: rc = 0 00100000:10000000:0.0:1788361293.032385:0:28709:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 776: rc = 0 00000020:00000080:0.0:1788361293.032944:0:28709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788361293.032955:0:28709:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788361293.032966:0:28709:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d6613333 00000020:01000004:0.0:1788361293.032974:0:28709:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788361293.033144:0:28709:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788361293.033149:0:28709:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788361293.033161:0:28709:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788361293.033182:0:28709:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788361293.033187:0:28709:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788361293.041234:0:28709:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788361293.041271:0:28709:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.160@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788361293.041276:0:28709:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788361293.041278:0:28709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361293.041279:0:28709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361293.041280:0:28709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361293.041281:0:28709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361293.041283:0:28709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361293.041284:0:28709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361293.041286:0:28709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361293.041288:0:28709:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361293.041291:0:28709:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788361293.041294:0:28709:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361293.041295:0:28709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361293.041296:0:28709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361293.041297:0:28709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361293.041298:0:28709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361293.041299:0:28709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361293.041300:0:28709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361293.041300:0:28709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361293.041301:0:28709:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361293.041339:0:28709:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788361293.041360:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142208:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361293.041443:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361293.041560:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144142208 00000100:00100000:1.0:1788361293.041568:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144142208 00000100:00100000:1.0:1788361293.041613:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788361293.041623:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+16:28709:x1875232144142208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788361293.041662:0:27395:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788361293.041665:0:27395:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788361293.041670:0:27395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788361293.041774:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361293.049329:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+16:28709:x1875232144142208:12345-0@lo:253:mount.lustre.0 Request processed in 7699us (7878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361293.049343:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788361293.049408:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142208:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361293.049423:0:28709:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788361293.049426:0:28709:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361293.049428:0:28709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361293.049430:0:28709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361293.049431:0:28709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361293.049432:0:28709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361293.049446:0:28709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361293.049448:0:28709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361293.049450:0:28709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361293.049451:0:28709:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788361293.049471:0:28709:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8a8a109000 from lustre-OST0001 10000000:01000000:0.0:1788361293.049495:0:28709:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788361293.049498:0:28709:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788361293.049505:0:28709:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8a84f13380 local copy 00010000:00010000:0.0:1788361293.049515:0:28709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361293.049725:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142336:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361293.049750:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361293.049779:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361293.049792:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144142336 00000100:00100000:3.0:1788361293.049798:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144142336 00000100:00100000:3.0:1788361293.049836:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361293.049844:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+16:28709:x1875232144142336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361293.050131:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+16:28709:x1875232144142336:12345-0@lo:501:mount.lustre.0 Request processed in 288us (379us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361293.050136:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788361293.050191:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142336:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788361293.050199:0:28709:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788361293.050288:0:28709:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788361293.050293:0:28709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.050299:0:28709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361293.050314:0:28709:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8a8a109000 10000000:01000000:0.0:1788361293.050317:0:28709:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788361293.050320:0:28709:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788361293.050322:0:28709:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361293.050325:0:28709:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788361293.050327:0:28709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788361293.050344:0:28709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.050358:0:28709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.050380:0:28709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361293.050397:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142464:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361293.050425:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361293.050458:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361293.050512:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144142464 00000100:00100000:2.0:1788361293.050516:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144142464 00000100:00100000:2.0:1788361293.050545:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788361293.050552:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+16:28709:x1875232144142464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361293.050561:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361293.050572:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b9600/0xf6a94c97d6613341 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661333a expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361293.050590:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b9600/0xf6a94c97d6613341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661333a expref: 17 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361293.050599:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b9600/0xf6a94c97d6613341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661333a expref: 17 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361293.050606:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361293.050646:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+17:28709:x1875232144142464:12345-0@lo:101:mount.lustre.0 Request processed in 95us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361293.050652:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788361293.050768:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142464:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361293.050780:0:28709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.050789:0:28709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361293.051498:0:28709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 11 count 11 00000040:00080000:0.0:1788361293.052315:0:28709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361293.052524:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:0.0:1788361293.052555:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 128 off8544 00000040:00080000:0.0:1788361293.052571:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 112 off8656 00000040:00080000:0.0:1788361293.052594:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8880 00000040:00080000:0.0:1788361293.052611:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9104 00000040:00080000:0.0:1788361293.052627:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 80 off9184 00000040:00080000:0.0:1788361293.052663:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 224 off9408 00000040:00080000:0.0:1788361293.052691:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9632 00000040:00080000:0.0:1788361293.052716:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 120 off9752 00000040:00080000:0.0:1788361293.052744:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 224 off9976 00000040:00080000:0.0:1788361293.052755:0:28709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 10 count 11 00000100:00100000:0.0:1788361293.052812:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361293.052854:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361293.052886:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361293.052907:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144142592 00000100:00100000:3.0:1788361293.052915:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144142592 00000100:00100000:3.0:1788361293.052958:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788361293.052967:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+17:28709:x1875232144142592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361293.053539:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+17:28709:x1875232144142592:12345-0@lo:501:mount.lustre.0 Request processed in 572us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361293.053547:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788361293.053767:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142592:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361293.053804:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142720:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361293.053846:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361293.053879:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361293.054052:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144142720 00000100:00100000:1.0:1788361293.054057:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144142720 00000100:00100000:1.0:1788361293.054130:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788361293.054139:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+17:28709:x1875232144142720:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361293.054428:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+17:28709:x1875232144142720:12345-0@lo:503:mount.lustre.0 Request processed in 290us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361293.054435:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361293.054536:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142720:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788361293.055155:0:28709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361293.055221:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142848:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361293.055268:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361293.055301:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361293.055383:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144142848 00000100:00100000:3.0:1788361293.055390:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144142848 00000100:00100000:3.0:1788361293.055592:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788361293.055603:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+17:28709:x1875232144142848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361293.056323:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+17:28709:x1875232144142848:12345-0@lo:502:mount.lustre.0 Request processed in 711us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361293.056344:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788361293.056597:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142848:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361293.056927:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:0.0:1788361293.056982:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 128 off8544 00000040:00080000:0.0:1788361293.057019:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 112 off8656 00000040:00080000:0.0:1788361293.057070:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8880 00000040:00080000:0.0:1788361293.057699:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9104 00000040:00080000:0.0:1788361293.057741:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 80 off9184 00000040:00080000:0.0:1788361293.057869:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 224 off9408 00000040:00080000:0.0:1788361293.057910:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9632 00000040:00080000:0.0:1788361293.057954:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 120 off9752 00000100:00100000:0.0:1788361293.057994:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361293.058059:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361293.058115:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144142976 00000100:00100000:1.0:1788361293.058123:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144142976 00000100:00100000:0.0:1788361293.058129:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361293.058160:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788361293.058167:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+17:28709:x1875232144142976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361293.058330:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+17:28709:x1875232144142976:12345-0@lo:502:mount.lustre.0 Request processed in 163us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361293.058337:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788361293.058381:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144142976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361293.058451:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 224 off9976 00000040:00080000:0.0:1788361293.058461:0:28709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788361293.062954:0:28710:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788361293.062967:0:28710:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788361293.062974:0:28710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361293.062977:0:28710:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788361293.062982:0:28710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788361293.062996:0:28710:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a8a90bf4d40) 00000020:00000080:0.0:1788361293.063019:0:28710:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788361293.063025:0:28710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788361293.063101:0:28710:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a8a109000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788361293.063111:0:28710:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788361293.063121:0:28710:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d661334f 00010000:00010000:0.0:1788361293.067716:0:28710:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788361293.068305:0:28710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 17179869189 00080000:10000000:0.0:1788361293.074219:0:28710:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xe:0x0] (8/8/4) registered 00000020:00000080:0.0:1788361293.075674:0:28710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788361293.075685:0:28710:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361293.075692:0:28710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361293.075693:0:28710:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788361293.075697:0:28710:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361293.075700:0:28710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361293.075701:0:28710:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788361293.075704:0:28710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788361293.075706:0:28710:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788361293.075708:0:28710:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361293.075711:0:28710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361293.075712:0:28710:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788361293.075714:0:28710:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361293.075717:0:28710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361293.075718:0:28710:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788361293.075728:0:28710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788361293.075776:0:28710:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361293.075780:0:28710:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361293.075781:0:28710:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788361293.075785:0:28710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 11 count 11 00000020:01000000:2.0:1788361293.075935:0:28709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788361293.075967:0:28709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788361293.075991:0:28709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361293.076004:0:28709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361293.076012:0:28709:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a8a109000 from 1 10000000:01000000:2.0:1788361293.076015:0:28709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788361293.076047:0:28709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361293.076055:0:28709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361293.076066:0:28709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361293.076126:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361293.076192:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361293.076241:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361293.076249:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144143104 00000100:00100000:3.0:1788361293.076267:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144143104 00000100:00100000:3.0:1788361293.076320:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788361293.076330:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+17:28709:x1875232144143104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361293.076344:0:27397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361293.076358:0:27397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661335d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613356 expref: -99 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.076393:0:27397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661335d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613356 expref: 18 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.076407:0:27397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661335d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613356 expref: 18 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.076416:0:27397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:3.0:1788361293.076468:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144143104:12345-0@lo:101:mount.lustre.0 Request processed in 139us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361293.076476:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788361293.076505:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361293.076519:0:28709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361293.076540:0:28709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361293.076962:0:28709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 10 count 10 00000040:00080000:2.0:1788361293.077413:0:28709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361293.077627:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:2.0:1788361293.077673:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:2.0:1788361293.077725:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:2.0:1788361293.077763:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:2.0:1788361293.077796:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:2.0:1788361293.077843:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:2.0:1788361293.077880:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:2.0:1788361293.077916:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:2.0:1788361293.077982:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:2.0:1788361293.077989:0:28709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 9 count 10 00000100:00100000:2.0:1788361293.078045:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361293.078126:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361293.078156:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361293.078250:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144143232 00000100:00100000:0.0:1788361293.078255:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144143232 00000100:00100000:0.0:1788361293.078286:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788361293.078294:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144143232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361293.078545:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144143232:12345-0@lo:501:mount.lustre.0 Request processed in 250us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361293.078553:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788361293.078764:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361293.078794:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361293.078838:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361293.078897:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361293.078936:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144143360 00000100:00100000:3.0:1788361293.078940:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144143360 00000100:00100000:3.0:1788361293.078996:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788361293.079005:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144143360:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361293.079358:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144143360:12345-0@lo:503:mount.lustre.0 Request processed in 354us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361293.079365:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788361293.079451:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143360:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788361293.079932:0:28709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361293.079986:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361293.080024:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361293.080063:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361293.080199:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144143488 00000100:00100000:1.0:1788361293.080205:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144143488 00000100:00100000:1.0:1788361293.080269:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788361293.080278:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144143488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361293.080485:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144143488:12345-0@lo:502:mount.lustre.0 Request processed in 209us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361293.080503:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788361293.080551:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361293.080807:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:1.0:1788361293.080880:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:1.0:1788361293.080946:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:1.0:1788361293.080996:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:1.0:1788361293.081052:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:1.0:1788361293.081127:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:1.0:1788361293.081186:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:1.0:1788361293.081248:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000100:00100000:1.0:1788361293.081279:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361293.081324:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361293.081350:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83ef5540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361293.081382:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144143616 00000100:00100000:1.0:1788361293.081387:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144143616 00000100:00100000:1.0:1788361293.081408:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788361293.081414:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144143616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361293.081560:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144143616:12345-0@lo:502:mount.lustre.0 Request processed in 143us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361293.081567:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788361293.081619:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361293.081723:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:1.0:1788361293.081738:0:28709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788361293.082622:0:28714:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361293.082631:0:28714:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361293.082633:0:28714:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788361293.082640:0:28714:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a8a109000 00000020:00000080:1.0:1788361293.082649:0:28714:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788361293.082658:0:28714:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361293.082661:0:28714:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361293.082663:0:28714:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788361293.082665:0:28714:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361293.082668:0:28714:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361293.082670:0:28714:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788361293.082673:0:28714:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a8a109000 00000020:00000080:1.0:1788361293.082675:0:28714:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788361293.082716:0:28714:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361293.085007:0:28714:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361293.085013:0:28714:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788361293.085023:0:28714:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361293.085029:0:28714:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361293.085031:0:28714:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788361293.085036:0:28714:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8a8a109000 00000020:00000080:1.0:1788361293.085039:0:28714:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788361293.085162:0:28714:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361293.085167:0:28714:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361293.085169:0:28714:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788361293.085172:0:28714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000020:01000000:3.0:1788361293.086194:0:28709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788361293.086228:0:28709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361293.086252:0:28709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.086264:0:28709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361293.086311:0:28709:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788361293.086315:0:28709:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a8a109000 10000000:01000000:3.0:1788361293.086318:0:28709:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a8a109000 10000000:01000000:3.0:1788361293.086324:0:28709:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361293.086330:0:28709:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a8a109000 from 1 10000000:01000000:3.0:1788361293.086332:0:28709:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361293.086365:0:28709:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.086384:0:28709:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.086394:0:28709:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361293.086418:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361293.086477:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361293.086519:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144143744 00000100:00100000:3.0:1788361293.086520:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88c486c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361293.086528:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144143744 00000100:00100000:1.0:1788361293.086577:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788361293.086587:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144143744:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361293.086600:0:27398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361293.086613:0:27398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987623800/0xf6a94c97d661336b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613364 expref: -99 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361293.086637:0:27398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987623800/0xf6a94c97d661336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613364 expref: 19 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361293.086660:0:27398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987623800/0xf6a94c97d661336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613364 expref: 19 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361293.086669:0:27398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623800, rc 0) 00000100:00100000:1.0:1788361293.086720:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:28709:x1875232144143744:12345-0@lo:101:mount.lustre.0 Request processed in 134us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361293.086728:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788361293.087031:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361293.087044:0:28709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.087053:0:28709:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361293.087755:0:28709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 42 count 42 00000040:00080000:3.0:1788361293.088365:0:28709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361293.088712:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:3.0:1788361293.088778:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 120 off8536 00000040:00080000:3.0:1788361293.088835:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 168 off8704 00000040:00080000:3.0:1788361293.088895:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8928 00000040:00080000:3.0:1788361293.088934:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9152 00000040:00080000:3.0:1788361293.088987:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9272 00000040:00080000:3.0:1788361293.089023:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 168 off9440 00000040:00080000:3.0:1788361293.089061:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 224 off9664 00000040:00080000:3.0:1788361293.089144:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9888 00000040:00080000:3.0:1788361293.089191:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 120 off10008 00000040:00080000:3.0:1788361293.089252:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 224 off10232 00000040:00080000:3.0:1788361293.089305:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 224 off10456 00000040:00080000:3.0:1788361293.089343:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 88 off10544 00000040:00080000:3.0:1788361293.089410:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 128 off10672 00000040:00080000:3.0:1788361293.089485:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 144 off10816 00000040:00080000:3.0:1788361293.089529:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 160 off10976 00000040:00080000:3.0:1788361293.089583:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 224 off11200 00000040:00080000:3.0:1788361293.089670:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11424 00000040:00080000:3.0:1788361293.089749:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 80 off11504 00000040:00080000:3.0:1788361293.089808:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 224 off11728 00000040:00080000:3.0:1788361293.089883:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11952 00000040:00080000:3.0:1788361293.089921:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 88 off12040 00000040:00080000:3.0:1788361293.089953:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 128 off12168 00000040:00080000:3.0:1788361293.089994:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 144 off12312 00000040:00080000:3.0:1788361293.090025:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 128 off12440 00000040:00080000:3.0:1788361293.090053:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 224 off12664 00000040:00080000:3.0:1788361293.090121:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 224 off12888 00000040:00080000:3.0:1788361293.090159:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 80 off12968 00000040:00080000:3.0:1788361293.090206:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 224 off13192 00000040:00080000:3.0:1788361293.090254:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13416 00000040:00080000:3.0:1788361293.090290:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 88 off13504 00000040:00080000:3.0:1788361293.090322:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 128 off13632 00000040:00080000:3.0:1788361293.090356:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 144 off13776 00000040:00080000:3.0:1788361293.091648:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 128 off13904 00000040:00080000:3.0:1788361293.091722:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 224 off14128 00000040:00080000:3.0:1788361293.091785:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 224 off14352 00000040:00080000:3.0:1788361293.091828:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 80 off14432 00000040:00080000:3.0:1788361293.091868:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 224 off14656 00000040:00080000:3.0:1788361293.092038:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14880 00000040:00080000:3.0:1788361293.092207:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 120 off15000 00000040:00080000:3.0:1788361293.092328:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 224 off15224 00000040:00080000:3.0:1788361293.092338:0:28709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 41 count 42 00000100:00100000:3.0:1788361293.092442:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361293.092508:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361293.092592:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88c486c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361293.092646:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144143872 00000100:00100000:0.0:1788361293.092653:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144143872 00000100:00100000:0.0:1788361293.092736:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788361293.092747:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+19:28709:x1875232144143872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361293.092994:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+19:28709:x1875232144143872:12345-0@lo:501:mount.lustre.0 Request processed in 250us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361293.093002:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788361293.093069:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144143872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361293.093130:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144144000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361293.093170:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361293.093195:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144144000 00000100:00100000:3.0:1788361293.093199:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144144000 00000100:00100000:3.0:1788361293.093221:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788361293.093228:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab778e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:28709:x1875232144144000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361293.093486:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab778e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:28709:x1875232144144000:12345-0@lo:503:mount.lustre.0 Request processed in 259us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361293.093493:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788361293.093528:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88c486c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361293.093548:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144144000:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788361293.094222:0:28709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361293.094288:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144144128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361293.094334:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361293.094379:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144144128 00000100:00100000:3.0:1788361293.094385:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144144128 00000100:00100000:3.0:1788361293.094419:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788361293.094428:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab778d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:28709:x1875232144144128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361293.094690:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab778d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:28709:x1875232144144128:12345-0@lo:502:mount.lustre.0 Request processed in 263us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361293.094698:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788361293.094740:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88c486c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361293.094756:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144144128:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361293.095112:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:3.0:1788361293.095165:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 120 off8536 00000040:00080000:3.0:1788361293.095205:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 168 off8704 00000040:00080000:3.0:1788361293.095257:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8928 00000040:00080000:3.0:1788361293.095296:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9152 00000040:00080000:3.0:1788361293.095351:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9272 00000040:00080000:3.0:1788361293.095419:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 168 off9440 00000040:00080000:3.0:1788361293.095461:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 224 off9664 00000040:00080000:3.0:1788361293.095519:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9888 00000040:00080000:3.0:1788361293.095557:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 120 off10008 00000040:00080000:3.0:1788361293.095591:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 224 off10232 00000040:00080000:3.0:1788361293.095639:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 224 off10456 00000040:00080000:3.0:1788361293.095678:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 88 off10544 00000040:00080000:3.0:1788361293.095713:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 128 off10672 00000040:00080000:3.0:1788361293.095780:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 144 off10816 00000040:00080000:3.0:1788361293.095862:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 160 off10976 00000040:00080000:3.0:1788361293.095930:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 224 off11200 00000040:00080000:3.0:1788361293.096023:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11424 00000040:00080000:3.0:1788361293.096065:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 80 off11504 00000040:00080000:3.0:1788361293.096128:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 224 off11728 00000040:00080000:3.0:1788361293.096227:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11952 00000040:00080000:3.0:1788361293.096291:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 88 off12040 00000040:00080000:3.0:1788361293.096358:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 128 off12168 00000040:00080000:3.0:1788361293.099500:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 144 off12312 00000040:00080000:3.0:1788361293.099567:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 128 off12440 00000040:00080000:3.0:1788361293.099618:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 224 off12664 00000040:00080000:3.0:1788361293.099678:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 224 off12888 00000040:00080000:3.0:1788361293.099722:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 80 off12968 00000040:00080000:3.0:1788361293.099778:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 224 off13192 00000040:00080000:3.0:1788361293.099839:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13416 00000040:00080000:3.0:1788361293.099885:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 88 off13504 00000040:00080000:3.0:1788361293.099928:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 128 off13632 00000040:00080000:3.0:1788361293.099967:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 144 off13776 00000040:00080000:3.0:1788361293.100020:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 128 off13904 00000040:00080000:3.0:1788361293.100068:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 224 off14128 00000040:00080000:3.0:1788361293.103347:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 224 off14352 00000040:00080000:3.0:1788361293.103439:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 80 off14432 00000040:00080000:3.0:1788361293.103488:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 224 off14656 00000040:00080000:3.0:1788361293.103599:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14880 00000040:00080000:3.0:1788361293.103657:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 120 off15000 00000100:00100000:3.0:1788361293.103718:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144144256:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361293.103796:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361293.103844:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144144256 00000100:00100000:3.0:1788361293.103852:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144144256 00000100:00100000:3.0:1788361293.103903:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788361293.103915:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab778f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:28709:x1875232144144256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361293.105165:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aafd8c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361293.105511:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab778f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:28709:x1875232144144256:12345-0@lo:502:mount.lustre.0 Request processed in 1597us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361293.105521:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788361293.105591:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144144256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361293.105702:0:28709:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 224 off15224 00000040:00080000:3.0:1788361293.105720:0:28709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788361293.107257:0:28719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788361293.107273:0:28719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a8a84f119c0) 00000020:00000080:2.0:1788361293.107294:0:28719:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788361293.107535:0:28719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a8a109000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788361293.107540:0:28719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a8a109000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788361293.107543:0:28719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8a109000 3 00010000:00080000:2.0:1788361293.107573:0:28719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a898718d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.160@tcp at head 00010000:00010000:2.0:1788361293.109975:0:28719:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788361293.110327:0:28719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788361293.110633:0:28719:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788361293.110646:0:28719:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf6a94c97d6613379 00000100:00080000:2.0:1788361293.110656:0:28719:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788361293.110662:0:28719:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a898718d800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361293.110698:0:28719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a834c8000 x1875232144144384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361293.110725:0:28719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788361293.110762:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144144384:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361293.110833:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361293.110959:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788361293.110964:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788361293.110966:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361293.110971:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 681 00000100:00080000:1.0:1788361293.110975:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788361293.110980:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8a8a129000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361293.110993:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a89859caa00 x1875232144144640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361293.111037:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144144512:0@lo:400:kworker.0 00000100:00100000:1.0:1788361293.111072:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361293.111142:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144144768:0@lo:400:kworker.0 00000100:00100000:1.0:1788361293.111171:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144144896:0@lo:400:kworker.0 00000100:00100000:1.0:1788361293.111197:0:28040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144144512 00000100:00100000:1.0:1788361293.111204:0:28040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144144512 00000100:00100000:1.0:1788361293.111252:0:28040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361293.111261:0:28040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144144512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361293.111315:0:28040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144144512:12345-0@lo:400:kworker.0 Request processed in 55us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361293.111329:0:28040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788361293.111350:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361293.111396:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144144512:0@lo:400:kworker.0 00000100:00100000:3.0:1788361293.111545:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144144640:0@lo:8:kworker.0 00000100:00100000:3.0:1788361293.111576:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361293.111609:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144144640 00000100:00100000:3.0:1788361293.111613:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144144640 00000100:00100000:3.0:1788361293.111639:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361293.111644:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144144640:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788361293.111691:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144144640:12345-0@lo:8:kworker.0 Request processed in 45us (114us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788361293.111697:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361293.111829:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361293.111835:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361293.111839:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788361293.111842:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144144640:0@lo:8:kworker.0 00000100:00100000:2.0:1788361293.111892:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144144384 00000100:00100000:2.0:1788361293.111898:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144144384 00000100:00100000:2.0:1788361293.111932:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361293.111938:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144144384:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361293.111941:0:27405:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788361293.111951:0:27405:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1788361293.111957:0:27403:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:2.0:1788361293.111987:0:27403:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf6a94c97d6613380 00000004:00100000:2.0:1788361293.112000:0:27403:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788361293.112025:0:27403:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361293.112041:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361293.112077:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875232144144384:12345-0@lo:38:llog_process_th.0 Request processed in 136us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361293.112103:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361293.112116:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361293.112132:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144144896 00000100:00100000:2.0:1788361293.112136:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144144896 00000100:00100000:2.0:1788361293.112165:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144144768 00000100:00100000:2.0:1788361293.112168:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144144768 00000100:00100000:0.0:1788361293.112177:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361293.112188:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144144896:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361293.112203:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361293.112231:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144144896:12345-0@lo:400:kworker.0 Request processed in 45us (191us total) trans 0 rc 0/0 00010000:00080000:1.0:1788361293.112242:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a89859c9f80 x1875232144144896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361293.112255:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361293.112257:0:27403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788361293.112258:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144144896:0@lo:400:kworker.0 00000100:00100000:2.0:1788361293.112272:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361293.112281:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144144768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361293.112322:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144144768:12345-0@lo:400:kworker.0 Request processed in 43us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361293.112327:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788361293.112361:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a89859c8700 x1875232144144768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361293.112381:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144144768:0@lo:400:kworker.0 00000040:00080000:2.0:1788361293.112618:0:28719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000020:01000000:0.0:1788361293.112686:0:28709:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788361293.112714:0:28709:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361293.112738:0:28709:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.112748:0:28709:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788361293.112795:0:28709:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788361293.112798:0:28709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361293.112799:0:28709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361293.112801:0:28709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361293.112802:0:28709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361293.112803:0:28709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361293.112805:0:28709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361293.112807:0:28709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361293.112809:0:28709:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361293.112813:0:28709:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788361293.112815:0:28709:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361293.112817:0:28709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361293.112818:0:28709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361293.112820:0:28709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361293.112820:0:28709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361293.112822:0:28709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361293.112823:0:28709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361293.112825:0:28709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361293.112826:0:28709:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361293.112844:0:28709:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788361293.112856:0:28709:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144145024:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361293.112894:0:28709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361293.112925:0:28709:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361293.112938:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144145024 00000100:00100000:2.0:1788361293.112944:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144145024 00000100:00100000:2.0:1788361293.112977:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788361293.112985:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab778e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+19:28709:x1875232144145024:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361293.113005:0:27395:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788361293.113018:0:27395:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788361293.113028:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a834c8000 x1875232144144384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361293.113039:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361293.113046:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 5 00000100:00080000:3.0:1788361293.113058:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788361293.113063:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361293.113066:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a898718d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361293.113072:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144144384:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788361293.128751:0:27395:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788361293.128771:0:27395:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788361293.128798:0:27419:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361293.128804:0:27419:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361293.128826:0:27419:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.128850:0:27419:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d661324c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613245 expref: 19 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.128870:0:27419:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.128908:0:27419:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d661324c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6613245 expref: 19 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.128922:0:27419:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d661324c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6613245 expref: 19 pid: 27395 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361293.128937:0:27419:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27419:1875232144145152:0@lo:104: 00000100:00100000:0.0:1788361293.128998:0:27419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361293.129046:0:27419:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361293.129209:0:27387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144145152 00000100:00100000:3.0:1788361293.129216:0:27387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144145152 00000100:00100000:3.0:1788361293.129267:0:27387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361293.129276:0:27387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e46014fe-639d-4b32-8855-95bba88887b0+3:27419:x1875232144145152:12345-0@lo:104: 00010000:00010000:3.0:1788361293.129289:0:27387:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.129342:0:27387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788361293.129348:0:27387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e46014fe-639d-4b32-8855-95bba88887b0+3:27419:x1875232144145152:12345-0@lo:104: Request processed in 74us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361293.129355:0:27387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788361293.129385:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361293.129391:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.129398:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361293.129402:0:27391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.129410:0:27391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361293.129416:0:27391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361293.129430:0:27391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361293.129460:0:27391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.129467:0:27391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361293.129482:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.129489:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d6613245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661324c expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.129505:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361293.129507:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361293.129508:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361293.129533:0:27419:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:27419:1875232144145152:0@lo:104: 00010000:00010000:3.0:1788361293.129552:0:27419:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361293.129616:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144145280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361293.129649:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361293.129744:0:27390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144145280 00000100:00100000:0.0:1788361293.129749:0:27390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144145280 00010000:00010000:0.0:1788361293.129769:0:27390:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d661324c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613245 expref: 20 pid: 27395 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361293.129842:0:27390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361293.129851:0:27390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e46014fe-639d-4b32-8855-95bba88887b0+20:3313:x1875232144145280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361293.129862:0:27390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361293.129868:0:27390:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d661324c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613245 expref: 20 pid: 27395 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.129879:0:27390:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d661324c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6613245 expref: 20 pid: 27395 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.129893:0:27390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d661324c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6613245 expref: 20 pid: 27395 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.129919:0:27390:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.129926:0:27390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788361293.129938:0:27390:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002514753s 00010000:00010000:0.0:1788361293.129943:0:27390:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.129949:0:27390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.129957:0:27390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.129963:0:27390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.129969:0:27390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361293.129973:0:27390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.129985:0:27390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.129999:0:27390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361293.130007:0:27390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361293.130023:0:27419:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.130032:0:27419:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361293.130039:0:27419:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613387 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361293.130047:0:27390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e46014fe-639d-4b32-8855-95bba88887b0+19:3313:x1875232144145280:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361293.130055:0:27390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361293.130061:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144145280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361293.140127:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab778e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+18:28709:x1875232144145024:12345-0@lo:253:mount.lustre.0 Request processed in 27099us (27187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361293.140136:0:28709:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e46014fe-639d-4b32-8855-95bba88887b0:28709:1875232144145024:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361293.140144:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 10000000:01000000:3.0:1788361293.140153:0:28709:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788361293.140169:0:28709:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361293.140172:0:28709:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361293.140173:0:28709:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361293.140175:0:28709:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361293.140176:0:28709:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361293.140178:0:28709:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361293.140180:0:28709:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361293.140182:0:28709:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361293.140183:0:28709:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788361293.140197:0:28709:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788361293.140606:0:28709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361293.140769:0:28709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361293.140931:0:28709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361293.141132:0:28709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361293.141276:0:28709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361293.141499:0:28709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788361293.142862:0:28709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836480 00002000:00080000:3.0:1788361293.176180:0:28709:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788361293.176187:0:28709:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788361293.176223:0:28709:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788361293.176344:0:28709:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788361293.176362:0:28709:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788361293.176398:0:28709:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788361293.346629:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361294.368512:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788361295.072308:0:27400:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788361295.072315:0:27400:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8987bd6000 from 17 10000000:01000000:1.0:1788361295.072321:0:27400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788361295.072386:0:27400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361295.072398:0:27400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361295.072409:0:27400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361295.072449:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144145408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361295.072519:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361295.072568:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361295.072786:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144145408 00000100:00100000:3.0:1788361295.072794:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144145408 00000100:00100000:3.0:1788361295.072853:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788361295.072861:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+18:27400:x1875232144145408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361295.072875:0:27397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361295.072889:0:27397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d6613395 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661338e expref: -99 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361295.072913:0:27397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d6613395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661338e expref: 19 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361295.072935:0:27397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d6613395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661338e expref: 19 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361295.072945:0:27397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f000, rc 0) 00000100:00100000:3.0:1788361295.072996:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+19:27400:x1875232144145408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361295.073003:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788361295.073599:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144145408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361295.073614:0:27400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361295.073623:0:27400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361295.073675:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144145536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788361295.073710:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361295.073738:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361295.073994:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144145536 00000100:00100000:0.0:1788361295.074000:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144145536 00000100:00100000:0.0:1788361295.074041:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788361295.074050:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+19:27400:x1875232144145536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788361295.074066:0:27395:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788361295.074110:0:27395:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788361295.074114:0:27395:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 17 00000100:00100000:0.0:1788361295.074193:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+19:27400:x1875232144145536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361295.074201:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788361295.074279:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144145536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788361295.074332:0:27400:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361295.074340:0:27400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361295.074348:0:27400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361295.395014:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361296.416410:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361296.544261:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144145664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361296.544339:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361296.544441:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144145664 00000100:00100000:2.0:1788361296.544449:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144145664 00000100:00100000:2.0:1788361296.544540:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361296.544550:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144145664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361296.544584:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361296.544637:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144145664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361296.544645:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361296.545033:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144145664:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788361296.547194:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788361297.051740:0:29066:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788361297.440313:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.467136:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361298.592999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361298.593006:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788361298.593010:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361298.593020:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8a8a129000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361298.593043:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a834c8700 x1875232144146048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361298.594054:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144146048:0@lo:8:kworker.0 00000100:00100000:3.0:1788361298.594127:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361298.594158:0:28040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144146048 00000100:00100000:0.0:1788361298.594167:0:28040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144146048 00000100:00100000:0.0:1788361298.594206:0:28040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361298.594213:0:28040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144146048:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788361298.594371:0:28040:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:0.0:1788361298.594397:0:28040:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d661339c 00002000:00100000:0.0:1788361298.594412:0:28040:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a8ab77b2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788361298.594417:0:28040:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788361298.594433:0:28040:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788361298.594494:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144145792:0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.594536:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361298.594564:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144146432:0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.594597:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361298.594622:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361298.594629:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144145920:0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.594657:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361298.594690:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144146176:0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.594718:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361298.594755:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361298.594764:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144146304:0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.594790:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1788361298.594806:0:28040:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788361298.594835:0:28040:0:(import.c:65:import_set_state_nolock()) ffff9a8ab77b3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361298.594847:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144145792 00000100:00100000:1.0:1788361298.594852:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144145792 00000100:00100000:1.0:1788361298.594887:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788361298.594897:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+19:3311:x1875232144145792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361298.594897:0:28040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144146048:12345-0@lo:8:kworker.0 Request processed in 680us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.594912:0:28040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361298.594929:0:28040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144145920 00000100:00100000:0.0:1788361298.594933:0:28040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144145920 00000100:00100000:1.0:1788361298.594943:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+19:3311:x1875232144145792:12345-0@lo:400:kworker.0 Request processed in 48us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361298.594955:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788361298.594972:0:28040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361298.594981:0:28040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144145920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.595003:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144146432 00000100:00100000:1.0:1788361298.595007:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144146432 00000100:00100000:0.0:1788361298.595017:0:28040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144145920:12345-0@lo:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.595024:0:28040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361298.595038:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144146176 00000100:00100000:1.0:1788361298.595042:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144146176 00000100:00080000:0.0:1788361298.595045:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361298.595049:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361298.595056:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144146304 00000100:00100000:1.0:1788361298.595060:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144146304 00000100:00100000:1.0:1788361298.595123:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361298.595130:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144146432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.595160:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144146432:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361298.595166:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361298.595190:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361298.595197:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144146176:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788361298.595202:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361298.595232:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144146176:12345-0@lo:400:kworker.0 Request processed in 36us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361298.595238:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361298.595248:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788361298.595254:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144146304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.595289:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144146304:12345-0@lo:400:kworker.0 Request processed in 35us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361298.595296:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788361298.595318:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a834cbb80 x1875232144146304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361298.595345:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144146304:0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.595351:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144145920:0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.595366:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144145792:0@lo:400:kworker.0 00010000:00080000:0.0:1788361298.595366:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a834c9180 x1875232144146176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788361298.595383:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a834c8380 x1875232144146432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361298.595383:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144146176:0@lo:400:kworker.0 00000100:00100000:1.0:1788361298.595399:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144146432:0@lo:400:kworker.0 00010000:00080000:3.0:1788361298.595924:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a834c8700 x1875232144146048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361298.595937:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 5 00000100:00080000:3.0:1788361298.595946:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788361298.595950:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788361298.595953:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788361298.595973:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000004:00080000:2.0:1788361298.596034:0:27428:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x62:0x0] 00000100:00100000:2.0:1788361298.596055:0:27428:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:27428:1875232144146688:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788361298.596120:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144146048:0@lo:8:kworker.0 00000100:00100000:2.0:1788361298.596131:0:27428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361298.596154:0:27428:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb96c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788361298.596171:0:27427:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788361298.596265:0:28041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144146688 00000100:00100000:3.0:1788361298.596271:0:28041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144146688 00000100:00100000:3.0:1788361298.596309:0:28041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361298.596316:0:28041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:27428:x1875232144146688:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788361298.596819:0:27427:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 688611731623ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788361298.597162:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144146560:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788361298.597403:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361298.597465:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361298.597622:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144146560 00000100:00100000:2.0:1788361298.597629:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144146560 00000100:00100000:2.0:1788361298.597673:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361298.597683:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144146560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361298.597712:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361298.597766:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144146560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361298.597775:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788361298.597793:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a834caa00 x1875232144146560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361298.597826:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144146560:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1788361298.599217:0:28041:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788361298.599226:0:28041:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 129 -> diff = -31 00002000:02000040:3.0:1788361298.599231:0:28041:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:129) 00002000:00010000:3.0:1788361298.615208:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x81:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.615226:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66133a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.615242:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.615247:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x81:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.615253:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66133a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.615271:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66133a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.615282:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66133a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.615290:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66133a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.615313:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361298.615359:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361298.615367:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66133a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.615378:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361298.615383:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66133a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.615400:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66133a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.615422:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66133a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.615430:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d66133a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x81:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.615455:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.615458:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.615461:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.616191:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x80:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.616199:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000916e402f/0xf6a94c97d66133aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.616209:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.616213:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x80:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.616218:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000916e402f/0xf6a94c97d66133aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.616230:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000916e402f/0xf6a94c97d66133aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.616245:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000916e402f/0xf6a94c97d66133aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.616254:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000916e402f/0xf6a94c97d66133aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.616273:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361298.616291:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361298.616300:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000916e402f/0xf6a94c97d66133aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.616322:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361298.616326:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000916e402f/0xf6a94c97d66133aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.616345:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000916e402f/0xf6a94c97d66133aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.616363:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000916e402f/0xf6a94c97d66133aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.616371:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000916e402f/0xf6a94c97d66133aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x80:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.616389:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.616391:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.616393:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.617435:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.617444:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66133b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.617456:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.617460:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.617465:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66133b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.617476:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66133b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.617485:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66133b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.617493:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66133b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.617531:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361298.617634:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361298.617640:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66133b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.617650:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361298.617658:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66133b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.617666:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66133b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.617685:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66133b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.617692:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b6075e4/0xf6a94c97d66133b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.617708:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.617711:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.617713:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.619188:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.619199:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66133b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.619213:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7e:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.619218:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.619224:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66133b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.619237:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66133b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.619247:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66133b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.619254:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66133b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.619277:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361298.619392:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361298.619398:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66133b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.619407:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361298.619411:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66133b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.619420:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66133b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.619435:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66133b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.619442:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000961bece4/0xf6a94c97d66133b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.619471:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.619473:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.619475:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.622118:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.622131:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66133bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.622147:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.622159:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.622166:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66133bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.622181:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66133bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.622192:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66133bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.622200:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66133bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.622225:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361298.623070:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.623078:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d66133c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623112:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.623116:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.623121:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d66133c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623132:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d66133c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623142:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d66133c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623156:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d66133c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623178:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361298.623195:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361298.623201:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66133bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623209:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361298.623213:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66133bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623224:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66133bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623240:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66133bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623249:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66133bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623268:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361298.623272:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d66133c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623291:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361298.623294:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d66133c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623303:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d66133c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623314:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d66133c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.623322:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d66133c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.623345:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.623418:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.623420:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.623421:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.624170:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.624177:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec784060/0xf6a94c97d66133cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.624188:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.624191:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.624196:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec784060/0xf6a94c97d66133cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.624205:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec784060/0xf6a94c97d66133cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.624220:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec784060/0xf6a94c97d66133cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.624228:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec784060/0xf6a94c97d66133cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.624243:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361298.624253:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361298.624257:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec784060/0xf6a94c97d66133cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.624266:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361298.624269:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec784060/0xf6a94c97d66133cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.624279:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec784060/0xf6a94c97d66133cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.624421:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec784060/0xf6a94c97d66133cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.624430:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec784060/0xf6a94c97d66133cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.624446:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.624453:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.624455:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.625300:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.625308:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d260cc0/0xf6a94c97d66133d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.625319:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.625323:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.625406:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d260cc0/0xf6a94c97d66133d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.625422:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d260cc0/0xf6a94c97d66133d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.625431:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d260cc0/0xf6a94c97d66133d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.625439:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d260cc0/0xf6a94c97d66133d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.625457:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361298.625470:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361298.625474:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d260cc0/0xf6a94c97d66133d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.625482:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361298.625486:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d260cc0/0xf6a94c97d66133d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.625507:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d260cc0/0xf6a94c97d66133d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.625520:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d260cc0/0xf6a94c97d66133d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.625528:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d260cc0/0xf6a94c97d66133d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.625543:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.625545:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.625547:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.626284:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x79:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.626292:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d66133db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.626303:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x79:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.626307:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x79:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.626312:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d66133db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.626323:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d66133db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.626557:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d66133db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.626572:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d66133db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.626598:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361298.627342:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x78:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.627349:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d66133e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627359:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.627363:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x78:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.627368:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d66133e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627378:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d66133e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627386:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d66133e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627392:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d66133e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627408:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361298.627420:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361298.627425:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d66133db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627438:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361298.627443:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d66133db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627451:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d66133db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627465:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d66133db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627472:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d66133db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x79:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627486:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361298.627489:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d66133e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.627495:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361298.627498:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d66133e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.627552:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.628000:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d66133e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.628016:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d66133e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.628029:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d66133e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.628044:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.628046:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.628048:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.628631:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x77:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.628638:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d66133e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.628648:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.628651:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x77:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.628656:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d66133e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.628666:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d66133e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.628674:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d66133e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.628682:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d66133e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.628997:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361298.629281:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361298.629288:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d66133e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.629297:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361298.629302:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d66133e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.629310:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d66133e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.629327:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d66133e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.629347:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c574a4da/0xf6a94c97d66133e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.629366:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361298.629368:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361298.629369:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.630282:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x76:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.630296:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d66133f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.630307:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.630311:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x76:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.630315:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d66133f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.630326:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d66133f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.630348:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d66133f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.630356:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d66133f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.630371:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361298.630382:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361298.630387:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d66133f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.630394:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcae00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361298.630398:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d66133f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.630406:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d66133f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.630424:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d66133f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.630431:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d66133f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.630445:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.630447:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.630448:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.631112:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x75:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.631120:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d66133f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.631131:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.631135:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x75:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.631140:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d66133f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.631152:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d66133f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.631161:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d66133f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.631169:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d66133f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.631200:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361298.631226:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361298.631235:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d66133f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.631245:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361298.631249:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d66133f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.631257:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d66133f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.631272:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d66133f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.631285:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d66133f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.631304:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.631355:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.631358:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.632158:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x74:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.632165:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d66133fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.632175:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x74:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.632179:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x74:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.632184:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d66133fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.632194:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d66133fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.632202:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d66133fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.632210:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d66133fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.632226:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361298.632236:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361298.632240:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d66133fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.632247:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcba00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361298.632257:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d66133fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.632265:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d66133fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.632276:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d66133fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.632284:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d66133fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x74:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.632499:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.632502:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.632504:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361298.633034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.633118:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130567936 00000100:00100000:0.0:1788361298.633128:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130567936 00000100:00100000:0.0:1788361298.633434:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788361298.633443:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2348:x1875232130567936:12345-192.168.203.60@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788361298.633468:0:27395:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from d1c239de-6813-4ac6-9906-15c9b6340eeb@192.168.203.60@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:0.0:1788361298.633496:0:27395:0:(genops.c:1406:class_connect()) connect: client d1c239de-6813-4ac6-9906-15c9b6340eeb, cookie 0xf6a94c97d6613405 00002000:00010000:3.0:1788361298.633573:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x73:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.633580:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d661340c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.633590:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x73:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.633594:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x73:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.633599:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d661340c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.633610:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d661340c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.633618:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d661340c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.633632:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d661340c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.633650:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788361298.633704:0:27395:0:(import.c:65:import_set_state_nolock()) ffff9a8ab77b0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361298.633768:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+5:2348:x1875232130567936:12345-192.168.203.60@tcp:250:mount.lustre.0 Request processed in 325us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.633777:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00010000:00010000:2.0:1788361298.634710:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361298.634720:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d661340c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.634731:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361298.634736:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d661340c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.634746:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d661340c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.634764:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d661340c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.634772:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d661340c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x73:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.635435:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.635439:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.635441:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.637302:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x72:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.637314:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6613413 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.638436:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.638446:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x72:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.638454:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6613413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.638473:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6613413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.638485:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6613413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.638493:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6613413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.638520:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361298.638639:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361298.638646:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6613413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.638653:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361298.638657:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6613413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.638665:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6613413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.638678:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6613413 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.638683:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6613413 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x72:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.638699:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.638701:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.638702:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.641432:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x71:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.641445:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661341a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.641468:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.641473:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x71:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.641479:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661341a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.641494:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661341a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.641505:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661341a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.641513:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661341a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.641534:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361298.641616:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361298.641624:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661341a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.641634:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361298.641639:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661341a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.641661:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661341a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.641680:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661341a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.641688:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661341a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x71:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.641711:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.641714:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.641716:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.643641:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x70:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.643653:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6613421 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.643668:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x70:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.643672:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x70:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.643679:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6613421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.643693:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6613421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.643716:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6613421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.643724:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6613421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361298.643904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361298.643939:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130568064 00000100:00100000:2.0:1788361298.643948:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130568064 00000100:00100000:2.0:1788361298.643994:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788361298.644004:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+5:23964:x1875232130568064:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788361298.644022:0:27398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361298.644036:0:27398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b9200/0xf6a94c97d6613428 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ecfd expref: -99 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.644061:0:27398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b9200/0xf6a94c97d6613428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecfd expref: 6 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.644072:0:27398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b9200/0xf6a94c97d6613428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecfd expref: 6 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.644122:0:27398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9200, rc 0) 00000100:00100000:2.0:1788361298.644182:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+6:23964:x1875232130568064:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 168us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361298.644190:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00010000:00010000:3.0:1788361298.644252:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361298.644754:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.644760:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661342f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.644771:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.644775:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.644780:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661342f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.644791:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661342f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.644801:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661342f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.644809:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661342f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.645686:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361298.645697:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6613421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.645709:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcaa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361298.645714:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6613421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.645723:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6613421 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.645743:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6613421 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.645758:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d694d02/0xf6a94c97d6613421 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x70:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.645782:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361298.645786:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661342f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.645793:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361298.645796:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661342f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.645804:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661342f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.645816:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661342f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.645824:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.645826:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.645828:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.646487:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.646495:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661342f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.646523:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361298.647066:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.647074:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6613436 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.647113:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.647119:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.647126:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6613436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.647139:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6613436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.647149:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6613436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.647157:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6613436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.647227:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1788361298.647346:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788361298.647625:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.647636:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d661343d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.647644:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.647648:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.647652:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d661343d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.647662:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d661343d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.647670:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d661343d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.647678:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d661343d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.648368:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361298.648377:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6613436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.648398:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361298.648402:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6613436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.648410:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6613436 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.648425:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6613436 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.648432:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d5a6e42/0xf6a94c97d6613436 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.648449:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361298.648453:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d661343d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.648460:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361298.648462:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d661343d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.648470:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d661343d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.648479:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d661343d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.648493:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361298.648494:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361298.648496:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.651432:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.651445:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002eaf90f2/0xf6a94c97d661343d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361298.652081:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.652127:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6613444 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.652140:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.652144:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.652157:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6613444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.652171:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6613444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.652182:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6613444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.652190:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6613444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361298.652314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361298.652399:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130568192 00000100:00100000:1.0:1788361298.652409:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130568192 00000100:00100000:1.0:1788361298.652458:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:1.0:1788361298.652467:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+6:23964:x1875232130568192:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788361298.652643:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+6:23964:x1875232130568192:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 176us (332us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361298.652650:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00010000:00010000:2.0:1788361298.652838:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361298.652845:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6613444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.652854:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcba00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361298.652858:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6613444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.652867:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6613444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.652884:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6613444 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.652892:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.652893:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.652895:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.653051:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.653057:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b9055b9/0xf6a94c97d6613444 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361298.653831:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.653838:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d661344b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.653850:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.653854:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.653860:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d661344b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.653871:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d661344b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.653889:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d661344b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.653896:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d661344b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.653944:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361298.653950:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d661344b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.653958:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcae00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361298.653961:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d661344b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.653970:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d661344b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.653982:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d661344b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.653989:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361298.653995:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361298.653997:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.654056:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.654060:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d79ee19a/0xf6a94c97d661344b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361298.654459:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.654465:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6613452 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.654473:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.654476:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.654481:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6613452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.654490:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6613452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.654498:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6613452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.654517:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6613452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.654658:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361298.654664:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6613452 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.654681:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361298.654684:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6613452 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.654692:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6613452 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.654703:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6613452 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.654710:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.654711:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.654713:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.654773:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.654778:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c103c687/0xf6a94c97d6613452 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361298.655172:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x69:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.655177:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6613459 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.655185:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x69:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.655188:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x69:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.655193:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6613459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.655202:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6613459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.655210:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6613459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.655218:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6613459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.655426:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361298.655433:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6613459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.655441:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361298.655444:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6613459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.655452:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6613459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361298.655464:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6613459 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.655543:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.655546:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.655547:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.655585:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.655589:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002827ef6c/0xf6a94c97d6613459 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x69:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361298.656136:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x68:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.656142:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6613460 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.656151:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.656155:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x68:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.656159:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6613460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.656169:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6613460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.656177:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6613460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.656185:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6613460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361298.656338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.656391:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130568320 00000100:00100000:0.0:1788361298.656399:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130568320 00000100:00100000:0.0:1788361298.656446:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1788361298.656454:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+6:23964:x1875232130568320:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361298.656469:0:27397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361298.656481:0:27397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ed04 expref: -99 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.656501:0:27397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed04 expref: 7 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.656511:0:27397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed04 expref: 7 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.656517:0:27397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965a00, rc 0) 00000100:00100000:0.0:1788361298.656560:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+7:23964:x1875232130568320:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 107us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.656566:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00010000:00010000:2.0:1788361298.656798:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361298.656804:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6613460 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.656813:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361298.656816:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6613460 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.656825:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6613460 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.656837:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6613460 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.656851:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.656852:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.656854:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.656953:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.656958:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6613460 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x68:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361298.657612:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x67:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.657619:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661346e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.657629:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.657633:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x67:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.657637:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661346e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.657646:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661346e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.657654:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661346e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.657662:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661346e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.657907:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361298.657914:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661346e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.657922:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361298.657926:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661346e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.657933:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661346e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.657944:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661346e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.657959:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.657960:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.657962:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.658030:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.658035:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d661346e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x67:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361298.658794:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x66:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.658801:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6613475 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.658824:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.658827:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x66:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.658832:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6613475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.658844:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6613475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.658853:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6613475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.658860:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6613475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.658917:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361298.658924:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6613475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.658932:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361298.658936:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6613475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.658945:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6613475 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.658958:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6613475 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.658967:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.658969:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.658971:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.659038:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.659044:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000767fb55b/0xf6a94c97d6613475 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x66:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361298.659475:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x65:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.659481:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d661347c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.659490:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.659494:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x65:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.659499:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d661347c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.659520:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d661347c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.659529:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d661347c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.659537:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d661347c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.659684:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361298.659691:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d661347c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.659701:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361298.659704:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d661347c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.659714:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d661347c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.659726:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d661347c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.659733:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.659735:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.659736:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.659824:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.659830:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069df56f9/0xf6a94c97d661347c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x65:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361298.660292:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x64:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.660298:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613483 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.660308:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.660312:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x64:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.660317:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.660326:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.660357:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613483 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.660364:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613483 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.660450:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361298.660456:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613483 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.660463:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361298.660466:0:27392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613483 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.660480:0:27392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613483 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.660492:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613483 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.660500:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.660502:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361298.660503:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.660609:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.660614:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613483 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x64:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361298.661355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361298.661423:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130568448 00000100:00100000:1.0:1788361298.661433:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130568448 00000100:00100000:1.0:1788361298.661482:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:1.0:1788361298.661492:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+7:23964:x1875232130568448:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788361298.661693:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+8:23964:x1875232130568448:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 201us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361298.661701:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00002000:00010000:3.0:1788361298.662143:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x63:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361298.662151:0:28041:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d661348a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.662164:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=688s v=(0 0) 00010000:00010000:3.0:1788361298.662168:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x63:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361298.662174:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d661348a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.662187:0:28041:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d661348a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.662195:0:28041:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d661348a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361298.662214:0:28041:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d661348a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.662346:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361298.662353:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d661348a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.662360:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361298.662364:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d661348a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.662379:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d661348a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.662393:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d661348a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.662402:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.662403:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361298.662405:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361298.662498:0:28041:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361298.662503:0:28041:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000246d6c8/0xf6a94c97d661348a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x63:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788361298.662736:0:28041:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:98 00000100:00100000:3.0:1788361298.662813:0:28041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:27428:x1875232144146688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 66495us (66682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361298.662822:0:28041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361298.662907:0:27428:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:27428:1875232144146688:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788361298.662921:0:27428:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x81:0x0] from OST, last_created [0x280000400:0x81:0x0]last_used is [0x280000400:0x62:0x0] 00000100:00100000:1.0:1788361298.662971:0:27428:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:27428:1875232144146816:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788361298.663005:0:27428:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361298.663054:0:27428:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361298.663136:0:28204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144146816 00000100:00100000:3.0:1788361298.663142:0:28204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144146816 00000100:00100000:3.0:1788361298.663177:0:28204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361298.663184:0:28204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:27428:x1875232144146816:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788361298.663217:0:28204:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 130 00000100:00100000:3.0:1788361298.666067:0:28204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:27428:x1875232144146816:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2877us (3055us total) trans 21474836481 rc 0/0 00000100:00100000:3.0:1788361298.666079:0:28204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361298.666274:0:27428:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:27428:1875232144146816:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788361298.666288:0:27428:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x81:0x0]-[0x280000400:0xa1:0x0] 00000100:00100000:0.0:1788361298.666420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361298.666477:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130568576 00000100:00100000:1.0:1788361298.666484:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130568576 00000100:00100000:1.0:1788361298.666527:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:1.0:1788361298.666536:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+8:23964:x1875232130568576:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788361298.666711:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+8:23964:x1875232130568576:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 176us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361298.666719:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00010000:00010000:2.0:1788361298.666865:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361298.670380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361298.670752:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130568704 00000100:00100000:2.0:1788361298.670762:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130568704 00000100:00100000:2.0:1788361298.670815:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:2.0:1788361298.670824:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+8:23983:x1875232130568704:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361298.671745:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+8:23983:x1875232130568704:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 916us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361298.671755:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:3.0:1788361298.687399:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.687453:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130568832 00000100:00100000:0.0:1788361298.687462:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130568832 00000100:00100000:0.0:1788361298.687557:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:0.0:1788361298.687567:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+8:23983:x1875232130568832:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361298.687879:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+8:23983:x1875232130568832:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 313us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.687888:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:0.0:1788361298.691142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361298.691324:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130568960 00000100:00100000:2.0:1788361298.691343:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130568960 00000100:00100000:2.0:1788361298.691395:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788361298.691516:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+8:23964:x1875232130568960:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788361298.691532:0:27397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361298.691547:0:27397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8e00/0xf6a94c97d6613491 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ed2e expref: -99 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.691591:0:27397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8e00/0xf6a94c97d6613491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed2e expref: 9 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.691603:0:27397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b8e00/0xf6a94c97d6613491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed2e expref: 9 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361298.691612:0:27397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8e00, rc 0) 00000100:00100000:2.0:1788361298.691668:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+9:23964:x1875232130568960:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 156us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361298.691908:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788361298.696657:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.696756:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130569088 00000100:00100000:0.0:1788361298.696766:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130569088 00000100:00100000:0.0:1788361298.696821:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:0.0:1788361298.696832:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+9:23964:x1875232130569088:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788361298.696861:0:27398:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788361298.696884:0:27398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788361298.696888:0:27398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788361298.696896:0:27398:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788361298.696899:0:27398:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 17 00000100:00100000:0.0:1788361298.699142:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+9:23964:x1875232130569088:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 2304us (2486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.699152:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:2.0:1788361298.703020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.703358:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130569216 00000100:00100000:0.0:1788361298.703370:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130569216 00000100:00100000:0.0:1788361298.703436:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:0.0:1788361298.703447:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+9:23964:x1875232130569216:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361298.703463:0:27397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361298.703483:0:27397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613498 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ed35 expref: -99 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.703510:0:27397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613498 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed35 expref: 10 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.703522:0:27397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613498 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed35 expref: 10 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.703530:0:27397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965000, rc 0) 00000100:00100000:0.0:1788361298.703647:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6c9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:23964:x1875232130569216:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 202us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.703654:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:2.0:1788361298.706699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.706750:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130569344 00000100:00100000:0.0:1788361298.706760:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130569344 00000100:00100000:0.0:1788361298.706875:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:0.0:1788361298.706886:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:23964:x1875232130569344:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788361298.707194:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7525050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:23964:x1875232130569344:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 309us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.707208:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1788361298.708799:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.708946:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130569472 00000100:00100000:0.0:1788361298.708957:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130569472 00000100:00100000:0.0:1788361298.709010:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:0.0:1788361298.709020:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:23964:x1875232130569472:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788361298.709523:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7526050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:23964:x1875232130569472:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 500us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.709531:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:2.0:1788361298.711958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.712447:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130569600 00000100:00100000:0.0:1788361298.712458:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130569600 00000100:00100000:0.0:1788361298.712562:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:0.0:1788361298.712572:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:23987:x1875232130569600:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361298.713007:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7527050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:23987:x1875232130569600:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 435us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.713017:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:2.0:1788361298.715863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.716047:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130569728 00000100:00100000:0.0:1788361298.716057:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130569728 00000100:00100000:0.0:1788361298.716227:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:0.0:1788361298.716238:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:23987:x1875232130569728:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361298.716872:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7527850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:23987:x1875232130569728:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 633us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.716881:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000040:00080000:3.0:1788361298.720405:0:27435:0:(llog.c:805:llog_process_thread()) index: 4, lh_last_idx: 4 synced_idx: 4 lgh_last_idx: 4 00000040:00080000:3.0:1788361298.720413:0:27435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361298.720822:0:27435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1a:0x0] index 4 count 1 00000040:00080000:3.0:1788361298.722585:0:27435:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x1a:0x0] at index 4 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361298.722638:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 1 00000100:00100000:2.0:1788361298.725291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361298.725947:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130569856 00000100:00100000:1.0:1788361298.725958:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130569856 00000100:00100000:1.0:1788361298.726012:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361298.726020:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1875232130569856:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788361298.726049:0:27404:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from fb21609b-c21d-4d8e-b4fa-91803d858974@192.168.203.60@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:1.0:1788361298.726132:0:27404:0:(genops.c:1406:class_connect()) connect: client fb21609b-c21d-4d8e-b4fa-91803d858974, cookie 0xf6a94c97d661349f 00000004:00100000:1.0:1788361298.726161:0:27404:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788361298.726168:0:27404:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836480 00000100:00080000:2.0:1788361298.784512:0:27404:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e48800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361298.784588:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2348:x1875232130569856:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 58566us (59304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361298.784607:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361298.792284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361298.792356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361298.792460:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130569984 00000100:00100000:3.0:1788361298.792464:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130570112 00000100:00100000:1.0:1788361298.792470:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130569984 00000100:00100000:3.0:1788361298.792471:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130570112 00000100:00100000:1.0:1788361298.792536:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361298.792547:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+7:0:x1875232130569984:12345-192.168.203.60@tcp:41:mount.lustre.0 00000100:00080000:0.0:1788361298.792588:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1788361298.792600:0:27405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788361298.792659:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361298.792672:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+7:23964:x1875232130570112:12345-192.168.203.60@tcp:41:mount.lustre.0 00000100:00100000:1.0:1788361298.792681:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+7:0:x1875232130569984:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 135us (405us total) trans 0 rc 0/0 00000004:00000024:3.0:1788361298.792690:0:28722:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788361298.792690:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361298.792726:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+6:23964:x1875232130570112:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 57us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361298.792733:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361298.794499:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.794622:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130570240 00000100:00100000:0.0:1788361298.794637:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130570240 00000100:00100000:0.0:1788361298.794687:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361298.794707:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+6:23964:x1875232130570240:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788361298.794794:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+6:23964:x1875232130570240:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.794801:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788361298.796707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361298.796844:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130570368 00000100:00100000:1.0:1788361298.796862:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130570368 00000100:00100000:1.0:1788361298.796905:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1788361298.796913:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875232130570368:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788361298.796940:0:28038:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from fb21609b-c21d-4d8e-b4fa-91803d858974@192.168.203.60@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:1.0:1788361298.796977:0:28038:0:(genops.c:1406:class_connect()) connect: client fb21609b-c21d-4d8e-b4fa-91803d858974, cookie 0xf6a94c97d66134a6 00002000:00100000:1.0:1788361298.796987:0:28038:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fb21609b-c21d-4d8e-b4fa-91803d858974/ffff9a8a856eb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788361298.797009:0:28038:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788361298.797379:0:28038:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788361298.797409:0:28038:0:(import.c:65:import_set_state_nolock()) ffff9a8a856ed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361298.798223:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2348:x1875232130570368:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 1305us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361298.798234:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361298.800200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361298.800237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361298.800251:0:28204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130570496 00000100:00100000:3.0:1788361298.800262:0:28204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130570496 00000100:00100000:1.0:1788361298.800371:0:27406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130570624 00000100:00100000:1.0:1788361298.800376:0:27406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130570624 00000100:00100000:1.0:1788361298.800421:0:27406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361298.800430:0:27406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+6:23964:x1875232130570624:12345-192.168.203.60@tcp:33:mount.lustre.0 00000100:00100000:3.0:1788361298.800540:0:28204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361298.800546:0:28204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875232130570496:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361298.800570:0:28204:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from fb21609b-c21d-4d8e-b4fa-91803d858974@192.168.203.60@tcp t0 exp 0000000000000000 cur 688 last 0 00000020:00000080:3.0:1788361298.800606:0:28204:0:(genops.c:1406:class_connect()) connect: client fb21609b-c21d-4d8e-b4fa-91803d858974, cookie 0xf6a94c97d66134ad 00002000:00100000:3.0:1788361298.800617:0:28204:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fb21609b-c21d-4d8e-b4fa-91803d858974/ffff9a8a8986f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361298.800628:0:28204:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361298.801071:0:28204:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788361298.801157:0:28204:0:(import.c:65:import_set_state_nolock()) ffff9a8a8986d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361298.801214:0:28204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2348:x1875232130570496:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 667us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361298.801222:0:28204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000004:00080000:2.0:1788361298.801706:0:27406:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1217us 00000004:00200000:2.0:1788361298.812947:0:27406:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1788361298.813149:0:27406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+6:23964:x1875232130570624:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 12715us (12906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361298.813163:0:27406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788361298.936189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361298.936340:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130570752 00000100:00100000:0.0:1788361298.936352:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130570752 00000100:00100000:0.0:1788361298.936415:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361298.936426:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+6:24008:x1875232130570752:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:0.0:1788361298.936448:0:27404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361298.936474:0:27404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66134b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ed5f expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.936545:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66134bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.936560:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66134bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.936575:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66134bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361298.936815:0:27404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361298.936820:0:27404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 8 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361298.936916:0:27404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66134bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.936943:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66134b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed5f expref: 8 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.936972:0:27404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66134bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed5f expref: 7 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361298.936981:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361298.936984:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361298.936987:0:27404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964a00, rc 0) 00000100:00100000:0.0:1788361298.937051:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+7:24008:x1875232130570752:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 627us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361298.937058:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:0.0:1788361299.488362:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788361299.685391:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb21609b-c21d-4d8e-b4fa-91803d858974 00010000:00010000:0.0:1788361300.512351:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361300.811226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361300.811337:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130570880 00000100:00100000:1.0:1788361300.811347:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130570880 00000100:00100000:1.0:1788361300.811419:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1788361300.811440:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+7:24060:x1875232130570880:12345-192.168.203.60@tcp:41:lfs.0 00000004:00000024:1.0:1788361300.811484:0:27405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788361300.811572:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+7:24060:x1875232130570880:12345-192.168.203.60@tcp:41:lfs.0 Request processed in 135us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361300.811580:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:0.0:1788361300.811645:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361300.818154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361300.821112:0:28043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130571008 00000100:00100000:1.0:1788361300.821128:0:28043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130571008 00000100:00100000:1.0:1788361300.821287:0:28043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361300.821297:0:28043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb21609b-c21d-4d8e-b4fa-91803d858974+5:24060:x1875232130571008:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:1.0:1788361300.821349:0:28043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361300.821447:0:28043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb21609b-c21d-4d8e-b4fa-91803d858974+5:24060:x1875232130571008:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 151us (3302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361300.821455:0:28043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361300.824920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361300.825212:0:28043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130571136 00000100:00100000:1.0:1788361300.825223:0:28043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130571136 00000100:00080000:0.0:1788361300.825326:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361300.825331:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361300.827460:0:28043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361300.827476:0:28043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb21609b-c21d-4d8e-b4fa-91803d858974+6:24060:x1875232130571136:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:1.0:1788361300.827518:0:28043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361300.828022:0:28043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb21609b-c21d-4d8e-b4fa-91803d858974+6:24060:x1875232130571136:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 550us (3108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361300.828031:0:28043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361301.023333:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361301.024141:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130571264 00000100:00100000:0.0:1788361301.024152:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130571264 00000100:00100000:0.0:1788361301.024206:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:0.0:1788361301.024215:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:24092:x1875232130571264:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361301.024231:0:27398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361301.024248:0:27398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965800/0xf6a94c97d66134c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ed66 expref: -99 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361301.024275:0:27398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965800/0xf6a94c97d66134c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed66 expref: 11 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361301.024303:0:27398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965800/0xf6a94c97d66134c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed66 expref: 11 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361301.024324:0:27398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965800, rc 0) 00000100:00100000:0.0:1788361301.024403:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7524850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:24092:x1875232130571264:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 187us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361301.024412:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:3.0:1788361301.028800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361301.029148:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130571392 00000100:00100000:0.0:1788361301.029160:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130571392 00000100:00100000:0.0:1788361301.029244:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:0.0:1788361301.029264:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:24092:x1875232130571392:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788361301.029792:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7524050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:24092:x1875232130571392:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 526us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361301.029809:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:2.0:1788361301.038787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361301.039038:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130571520 00000100:00100000:1.0:1788361301.039048:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130571520 00000100:00100000:1.0:1788361301.039129:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788361301.039152:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:24092:x1875232130571520:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788361301.039420:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7525850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:24092:x1875232130571520:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 281us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361301.039429:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:0.0:1788361301.062192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361301.062352:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130571648 00000100:00100000:1.0:1788361301.062363:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130571648 00000100:00100000:1.0:1788361301.062425:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1788361301.062435:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:24099:x1875232130571648:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361301.062702:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7527450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:24099:x1875232130571648:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 267us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361301.062710:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:3.0:1788361301.087129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361301.087292:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130571776 00000100:00100000:0.0:1788361301.087301:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130571776 00000100:00100000:0.0:1788361301.087369:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:0.0:1788361301.087380:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:24099:x1875232130571776:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361301.087770:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7524c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:24099:x1875232130571776:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 391us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361301.087779:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:2.0:1788361301.101375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361301.101892:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130571904 00000100:00100000:0.0:1788361301.101902:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130571904 00000100:00100000:0.0:1788361301.101960:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:0.0:1788361301.101984:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:24092:x1875232130571904:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361301.102001:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361301.102018:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964000/0xf6a94c97d66134c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ed90 expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361301.102046:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964000/0xf6a94c97d66134c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed90 expref: 12 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361301.102343:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964000/0xf6a94c97d66134c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed90 expref: 12 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361301.102355:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964000, rc 0) 00000100:00100000:0.0:1788361301.102476:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7524450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:24092:x1875232130571904:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 492us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361301.102484:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:3.0:1788361301.115545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361301.115778:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130572032 00000100:00100000:0.0:1788361301.115788:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130572032 00000100:00100000:0.0:1788361301.115843:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:0.0:1788361301.115852:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:24092:x1875232130572032:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788361301.115877:0:27397:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788361301.115894:0:27397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788361301.115898:0:27397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788361301.115901:0:27397:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788361301.115903:0:27397:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 17 00000100:00100000:0.0:1788361301.119661:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7527c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:24092:x1875232130572032:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 3799us (4124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361301.119675:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:2.0:1788361301.128824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361301.128974:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130572160 00000100:00100000:0.0:1788361301.128984:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130572160 00000100:00100000:0.0:1788361301.129038:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:0.0:1788361301.129047:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:24092:x1875232130572160:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361301.129063:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361301.129081:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965400/0xf6a94c97d66134d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ed97 expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361301.129141:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965400/0xf6a94c97d66134d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed97 expref: 13 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361301.129153:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965400/0xf6a94c97d66134d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed97 expref: 13 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361301.129163:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965400, rc 0) 00000100:00100000:0.0:1788361301.129222:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7526850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:24092:x1875232130572160:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 175us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361301.129229:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:3.0:1788361301.134302:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361301.135842:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130572288 00000100:00100000:0.0:1788361301.135855:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130572288 00000100:00100000:0.0:1788361301.135938:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:0.0:1788361301.135949:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:24092:x1875232130572288:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788361301.136307:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7525450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:24092:x1875232130572288:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 358us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361301.136327:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:3.0:1788361301.148551:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361301.148702:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130572416 00000100:00100000:1.0:1788361301.148712:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130572416 00000100:00100000:1.0:1788361301.148767:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:1.0:1788361301.148778:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:24092:x1875232130572416:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788361301.149016:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7526450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:24092:x1875232130572416:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 239us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361301.149024:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:3.0:1788361301.158996:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361301.160993:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130572544 00000100:00100000:1.0:1788361301.161009:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130572544 00000100:00100000:1.0:1788361301.161080:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:1.0:1788361301.161113:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:24102:x1875232130572544:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361301.161389:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:24102:x1875232130572544:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 277us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361301.161397:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:3.0:1788361301.170209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361301.173262:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130572672 00000100:00100000:0.0:1788361301.173276:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130572672 00000100:00100000:0.0:1788361301.173358:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:0.0:1788361301.173368:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:24102:x1875232130572672:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361301.173604:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:24102:x1875232130572672:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 236us (3403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361301.173613:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:2.0:1788361301.180848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361301.180942:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130572800 00000100:00100000:0.0:1788361301.180952:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130572800 00000100:00100000:0.0:1788361301.180999:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1788361301.181008:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1875232130572800:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788361301.181036:0:27404:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from a296666d-d333-41d2-9af9-3ecf21560298@192.168.203.60@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:0.0:1788361301.181073:0:27404:0:(genops.c:1406:class_connect()) connect: client a296666d-d333-41d2-9af9-3ecf21560298, cookie 0xf6a94c97d66134d7 00000004:00100000:0.0:1788361301.181135:0:27404:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788361301.181249:0:27404:0:(import.c:65:import_set_state_nolock()) ffff9a8ac0c04800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361301.181521:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a296666d-d333-41d2-9af9-3ecf21560298+6:2348:x1875232130572800:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 511us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361301.181530:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361301.191713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361301.197217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361301.198698:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130573056 00000100:00100000:1.0:1788361301.198711:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130573056 00000100:00100000:1.0:1788361301.198785:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130572928 00000100:00100000:1.0:1788361301.198789:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130572928 00000100:00100000:1.0:1788361301.198818:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361301.198827:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a296666d-d333-41d2-9af9-3ecf21560298+7:24092:x1875232130573056:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788361301.198892:0:27405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788361301.198961:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a296666d-d333-41d2-9af9-3ecf21560298+7:24092:x1875232130573056:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 135us (7258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361301.198969:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361301.198987:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361301.198994:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a296666d-d333-41d2-9af9-3ecf21560298+6:0:x1875232130572928:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788361301.199006:0:27405:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788361301.199028:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a296666d-d333-41d2-9af9-3ecf21560298+6:0:x1875232130572928:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 34us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361301.199034:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00080000:0.0:1788361301.199275:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361301.214177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361301.215733:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130573184 00000100:00100000:1.0:1788361301.215747:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130573184 00000100:00100000:1.0:1788361301.215815:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361301.215825:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a296666d-d333-41d2-9af9-3ecf21560298+6:24092:x1875232130573184:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788361301.215931:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a296666d-d333-41d2-9af9-3ecf21560298+6:24092:x1875232130573184:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 107us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361301.215939:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361301.224140:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361301.224183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361301.224570:0:28041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130573312 00000100:00100000:3.0:1788361301.224581:0:28041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130573312 00000100:00100000:3.0:1788361301.224624:0:28041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130573440 00000100:00100000:3.0:1788361301.224628:0:28041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130573440 00000100:00100000:3.0:1788361301.224651:0:28041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361301.224659:0:28041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875232130573312:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361301.224687:0:28041:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a296666d-d333-41d2-9af9-3ecf21560298@192.168.203.60@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:3.0:1788361301.224714:0:28041:0:(genops.c:1406:class_connect()) connect: client a296666d-d333-41d2-9af9-3ecf21560298, cookie 0xf6a94c97d66134de 00002000:00100000:3.0:1788361301.224727:0:28041:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a296666d-d333-41d2-9af9-3ecf21560298/ffff9a8a89868800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361301.224737:0:28041:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361301.224978:0:28041:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788361301.225007:0:28041:0:(import.c:65:import_set_state_nolock()) ffff9a8a8986c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361301.225073:0:28041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a296666d-d333-41d2-9af9-3ecf21560298+6:2348:x1875232130573312:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 413us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361301.225081:0:28041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361301.225125:0:28041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361301.225130:0:28041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875232130573440:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788361301.225146:0:28041:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from a296666d-d333-41d2-9af9-3ecf21560298@192.168.203.60@tcp t0 exp 0000000000000000 cur 691 last 0 00000020:00000080:3.0:1788361301.225162:0:28041:0:(genops.c:1406:class_connect()) connect: client a296666d-d333-41d2-9af9-3ecf21560298, cookie 0xf6a94c97d66134e5 00002000:00100000:3.0:1788361301.225168:0:28041:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a296666d-d333-41d2-9af9-3ecf21560298/ffff9a8a8986e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788361301.225187:0:28041:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788361301.225237:0:28041:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788361301.225254:0:28041:0:(import.c:65:import_set_state_nolock()) ffff9a8ac1c6a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361301.225282:0:28041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a296666d-d333-41d2-9af9-3ecf21560298+6:2348:x1875232130573440:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 150us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361301.225289:0:28041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788361301.228512:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361301.228642:0:27407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130573568 00000100:00100000:3.0:1788361301.228652:0:27407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130573568 00000100:00100000:3.0:1788361301.228740:0:27407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361301.228750:0:27407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a296666d-d333-41d2-9af9-3ecf21560298+6:24092:x1875232130573568:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788361301.229103:0:27407:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788361301.229309:0:27407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a296666d-d333-41d2-9af9-3ecf21560298+6:24092:x1875232130573568:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 560us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361301.229328:0:27407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1788361301.388917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361301.389070:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130573696 00000100:00100000:2.0:1788361301.389080:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130573696 00000100:00100000:2.0:1788361301.389166:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361301.389176:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a296666d-d333-41d2-9af9-3ecf21560298+6:24123:x1875232130573696:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:2.0:1788361301.389197:0:27404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361301.389220:0:27404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66134ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86edc1 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361301.389283:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361301.389296:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361301.389352:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361301.389534:0:27404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361301.389538:0:27404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 8 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361301.389616:0:27404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361301.389642:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66134ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc1 expref: 8 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361301.389658:0:27404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc1 expref: 7 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361301.389666:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:2.0:1788361301.389669:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361301.389673:0:27404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8c00, rc 0) 00000100:00100000:2.0:1788361301.389743:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a296666d-d333-41d2-9af9-3ecf21560298+7:24123:x1875232130573696:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 569us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361301.389751:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:0.0:1788361301.537156:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361301.665492:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361301.665517:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144146944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361301.665587:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361301.665721:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144146944 00000100:00100000:2.0:1788361301.665729:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144146944 00000100:00100000:2.0:1788361301.665806:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361301.665815:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144146944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361301.665837:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361301.665883:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144146944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361301.665898:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788361301.665963:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361301.665997:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144146944:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361302.560992:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361303.584723:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361303.667748:0:29270:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788361303.714058:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144147072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361303.714154:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361303.714535:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144147200:0@lo:400:kworker.0 00000100:00100000:0.0:1788361303.714575:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361303.714714:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144147328:0@lo:400:kworker.0 00000100:00100000:1.0:1788361303.714744:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361303.714798:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144147712:0@lo:400:kworker.0 00000100:00100000:0.0:1788361303.714846:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361303.714896:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144147200 00000100:00100000:0.0:1788361303.714904:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144147200 00000100:00100000:0.0:1788361303.714945:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788361303.714956:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:3311:x1875232144147200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361303.715012:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:3311:x1875232144147200:12345-0@lo:400:kworker.0 Request processed in 57us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361303.715019:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788361303.715068:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144147200:0@lo:400:kworker.0 00000100:00100000:3.0:1788361303.715365:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144147072 00000100:00100000:3.0:1788361303.715371:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144147072 00000100:00100000:3.0:1788361303.715422:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361303.715430:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144147072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361303.715459:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361303.715497:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144147072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361303.715504:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361303.715525:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144147456:0@lo:400:kworker.0 00000100:00100000:3.0:1788361303.715563:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361303.715583:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361303.715590:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144147584:0@lo:400:kworker.0 00000100:00100000:3.0:1788361303.715612:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361303.715654:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144147072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361303.715675:0:28041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144147328 00000100:00100000:3.0:1788361303.715679:0:28041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144147328 00000100:00100000:3.0:1788361303.715713:0:28041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361303.715720:0:28041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144147328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361303.715752:0:28041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144147328:12345-0@lo:400:kworker.0 Request processed in 32us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361303.715758:0:28041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361303.715779:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144147712 00000100:00100000:3.0:1788361303.715782:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144147712 00000100:00100000:3.0:1788361303.715808:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144147456 00000100:00100000:3.0:1788361303.715812:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144147456 00000100:00100000:3.0:1788361303.715825:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144147584 00000100:00100000:3.0:1788361303.715827:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144147584 00000100:00100000:3.0:1788361303.715844:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361303.715862:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144147712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361303.715903:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144147712:12345-0@lo:400:kworker.0 Request processed in 42us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361303.715910:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361303.715924:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361303.715931:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144147456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361303.715963:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144147456:12345-0@lo:400:kworker.0 Request processed in 33us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361303.715979:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361303.715992:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361303.715998:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144147584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361303.716029:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144147584:12345-0@lo:400:kworker.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361303.716035:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361303.716075:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144147584:0@lo:400:kworker.0 00000100:00100000:3.0:1788361303.716119:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144147456:0@lo:400:kworker.0 00000100:00100000:3.0:1788361303.716156:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144147712:0@lo:400:kworker.0 00000100:00080000:0.0:1788361303.716528:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361303.716534:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361303.716537:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361303.716593:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f587b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144147328:0@lo:400:kworker.0 00000001:00100000:0.0:1788361303.761080:0:28726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788361303.761118:0:28726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a296666d-d333-41d2-9af9-3ecf21560298 00000001:00100000:0.0:1788361303.761124:0:28726:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb21609b-c21d-4d8e-b4fa-91803d858974 00000001:00080000:0.0:1788361303.761132:0:28726:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 21474836481 is committed 00000001:00100000:1.0:1788361304.268636:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a296666d-d333-41d2-9af9-3ecf21560298 00000001:00100000:1.0:1788361304.268654:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fb21609b-c21d-4d8e-b4fa-91803d858974 00010000:00010000:3.0:1788361304.612214:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788361304.774231:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a296666d-d333-41d2-9af9-3ecf21560298 00010000:00010000:0.0:1788361305.632332:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361306.064416:0:29422:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7e176f30 20000000:00000080:2.0:1788361306.064434:0:29422:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8986517400 uarg=0000000000000000 20000000:01000000:2.0:1788361306.064485:0:29422:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788361306.064491:0:29422:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788361306.064495:0:29422:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788361306.067249:0:29423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788361306.067421:0:29422:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788361306.067430:0:29422:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788361306.067448:0:29422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067465:0:29422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66131c7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66131c0 expref: 18 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067471:0:29422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6613214 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661320d expref: 18 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067478:0:29422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661335d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613356 expref: 18 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067487:0:29422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613498 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed35 expref: 12 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067495:0:29422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985965400/0xf6a94c97d66134d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed97 expref: 12 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067502:0:29422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067547:0:29422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985965400/0xf6a94c97d66134d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed97 expref: 12 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067560:0:29422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985965400/0xf6a94c97d66134d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed97 expref: 12 pid: 27395 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361306.067572:0:29422:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29422:1875232144147840:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361306.067730:0:29422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613498 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed35 expref: 12 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067739:0:29422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613498 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed35 expref: 12 pid: 27397 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361306.067748:0:29422:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29422:1875232144147968:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361306.067779:0:29422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661335d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6613356 expref: 18 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067786:0:29422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661335d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6613356 expref: 18 pid: 27397 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361306.067795:0:29422:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29422:1875232144148096:0@lo:104: 00000100:00100000:2.0:1788361306.067830:0:29422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361306.067868:0:29422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6613214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661320d expref: 18 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.067876:0:29422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6613214 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661320d expref: 18 pid: 27395 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361306.067897:0:29422:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29422:1875232144148224:0@lo:104: 00000100:00100000:1.0:1788361306.068006:0:27386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144148096 00000100:00100000:1.0:1788361306.068013:0:27386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144148096 00000100:00100000:1.0:1788361306.068064:0:27386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361306.068072:0:27386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e46014fe-639d-4b32-8855-95bba88887b0+3:29422:x1875232144148096:12345-0@lo:104: 00010000:00010000:1.0:1788361306.068099:0:27386:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361306.068149:0:27386:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361306.068155:0:27386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e46014fe-639d-4b32-8855-95bba88887b0+3:29422:x1875232144148096:12345-0@lo:104: Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361306.068162:0:27386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788361306.068232:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361306.068239:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.068246:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361306.068249:0:27392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.068256:0:27392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361306.068262:0:27392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361306.068267:0:27392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788361306.068382:0:29422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361306.068418:0:29422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66131c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66131c0 expref: 18 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.068427:0:29422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66131c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66131c0 expref: 18 pid: 27398 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361306.068435:0:29422:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29422:1875232144148352:0@lo:104: 00000100:00100000:2.0:1788361306.068458:0:29422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361306.068471:0:29422:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361306.068488:0:29422:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29422:1875232144148096:0@lo:104: 00000100:00100000:2.0:1788361306.068523:0:27387:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788361306.068533:0:27387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144148224 00000100:00100000:2.0:1788361306.068537:0:27387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144148224 00000100:00100000:2.0:1788361306.068552:0:27387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144148352 00000100:00100000:2.0:1788361306.068555:0:27387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144148352 00000100:00100000:2.0:1788361306.068565:0:27387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361306.068571:0:27387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e46014fe-639d-4b32-8855-95bba88887b0+4:29422:x1875232144148224:12345-0@lo:104: 00010000:00010000:2.0:1788361306.068579:0:27387:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.068614:0:27387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788361306.068619:0:27387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e46014fe-639d-4b32-8855-95bba88887b0+4:29422:x1875232144148224:12345-0@lo:104: Request processed in 49us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361306.068624:0:27387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361306.068638:0:27387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361306.068651:0:27387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9eabac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e46014fe-639d-4b32-8855-95bba88887b0+3:29422:x1875232144148352:12345-0@lo:104: 00010000:00010000:2.0:1788361306.068658:0:27387:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.068684:0:27387:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788361306.068689:0:27387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9eabac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e46014fe-639d-4b32-8855-95bba88887b0+3:29422:x1875232144148352:12345-0@lo:104: Request processed in 40us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361306.068693:0:27387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361306.068737:0:29422:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29422:1875232144148224:0@lo:104: 00000100:00100000:2.0:1788361306.068745:0:29422:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29422:1875232144148352:0@lo:104: 00010000:00010000:2.0:1788361306.068766:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361306.068888:0:29424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361306.068895:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.068901:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8800 already unused, calling callback (ffffffffc1ba5c20) 00010000:00010000:3.0:1788361306.069109:0:27392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.069122:0:27392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361306.069141:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.069147:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8200/0xf6a94c97d6613356 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661335d expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.069160:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361306.069161:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361306.069163:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361306.069174:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e46014fe-639d-4b32-8855-95bba88887b0:3312:1875232144148480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361306.069205:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361306.069235:0:27389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144148480 00000100:00100000:3.0:1788361306.069238:0:27389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144148480 00010000:00010000:3.0:1788361306.069256:0:27389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661335d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613356 expref: 19 pid: 27397 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361306.069277:0:27389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361306.069295:0:27389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+19:3312:x1875232144148480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361306.069305:0:27389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361306.069309:0:27389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661335d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613356 expref: 19 pid: 27397 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.069317:0:27389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661335d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6613356 expref: 19 pid: 27397 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.069329:0:27389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573fa00/0xf6a94c97d661335d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6613356 expref: 19 pid: 27397 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.069351:0:27389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361306.069378:0:27389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+18:3312:x1875232144148480:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361306.069385:0:27389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361306.069413:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e46014fe-639d-4b32-8855-95bba88887b0:3312:1875232144148480:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1788361306.070197:0:27391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.070208:0:27391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361306.070215:0:27391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361306.070221:0:27391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788361306.071804:0:27391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.071818:0:27391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788361306.071872:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144148608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361306.071941:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361306.072576:0:27390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144148608 00000100:00100000:1.0:1788361306.072583:0:27390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144148608 00010000:00010000:1.0:1788361306.072607:0:27390:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6613214 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661320d expref: 18 pid: 27395 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361306.072630:0:27390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361306.072636:0:27390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e46014fe-639d-4b32-8855-95bba88887b0+18:3313:x1875232144148608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361306.072645:0:27390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361306.072649:0:27390:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6613214 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661320d expref: 18 pid: 27395 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361306.072667:0:27390:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6613214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661320d expref: 18 pid: 27395 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361306.072678:0:27390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d6613214 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661320d expref: 18 pid: 27395 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361306.072690:0:27390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361306.074733:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.074749:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8800/0xf6a94c97d661320d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613214 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361306.074768:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361306.074770:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361306.074772:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361306.075048:0:27390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e46014fe-639d-4b32-8855-95bba88887b0+17:3313:x1875232144148608:12345-0@lo:103:ldlm_bl.0 Request processed in 2409us (3105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361306.075059:0:27390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361306.075257:0:29422:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29422:1875232144147840:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361306.075333:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144148608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361306.075421:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361306.075423:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361306.075425:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361306.075448:0:29424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.075471:0:29424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965c00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361306.075475:0:29424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.075484:0:29424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361306.075490:0:29424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361306.075496:0:29424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788361306.075928:0:29424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.075936:0:29424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788361306.075981:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e46014fe-639d-4b32-8855-95bba88887b0:3314:1875232144148736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361306.076029:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361306.076120:0:29424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.076128:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66131c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66131c7 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361306.076144:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361306.076146:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361306.076148:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361306.076266:0:27389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144148736 00000100:00100000:0.0:1788361306.076272:0:27389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144148736 00010000:00010000:0.0:1788361306.076308:0:27389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66131c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66131c0 expref: 17 pid: 27398 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361306.076352:0:27389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361306.076360:0:27389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a86c46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+17:3314:x1875232144148736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361306.076372:0:27389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361306.076378:0:27389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66131c7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66131c0 expref: 17 pid: 27398 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.076386:0:27389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66131c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66131c0 expref: 17 pid: 27398 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.076400:0:27389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e000/0xf6a94c97d66131c7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66131c0 expref: 17 pid: 27398 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.076412:0:27389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361306.076532:0:27389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a86c46450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+16:3314:x1875232144148736:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361306.076539:0:27389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361306.076725:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e46014fe-639d-4b32-8855-95bba88887b0:3314:1875232144148736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361306.079046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361306.079236:0:29422:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:29422:1875232144147968:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361306.079589:0:29422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361306.080022:0:27388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130573824 00000100:00100000:1.0:1788361306.080031:0:27388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130573824 00010000:00010000:1.0:1788361306.080065:0:27388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985965400/0xf6a94c97d66134d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed97 expref: 13 pid: 27395 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361306.080118:0:27388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361306.080127:0:27388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:2349:x1875232130573824:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361306.080142:0:27388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361306.080147:0:27388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985965400/0xf6a94c97d66134d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed97 expref: 13 pid: 27395 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361306.080159:0:27388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985965400/0xf6a94c97d66134d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed97 expref: 13 pid: 27395 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361306.080177:0:27388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965400/0xf6a94c97d66134d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed97 expref: 13 pid: 27395 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361306.080192:0:27388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361306.080251:0:27388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:2349:x1875232130573824:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 125us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361306.080260:0:27388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361306.081827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361306.081950:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130573952 00000100:00100000:0.0:1788361306.081958:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130573952 00010000:00010000:0.0:1788361306.081992:0:28064:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613498 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed35 expref: 12 pid: 27397 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361306.082032:0:28064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361306.082041:0:28064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:2350:x1875232130573952:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361306.082055:0:28064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361306.082060:0:28064:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613498 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed35 expref: 12 pid: 27397 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082109:0:28064:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613498 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed35 expref: 12 pid: 27397 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082125:0:28064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613498 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed35 expref: 12 pid: 27397 timeout: 796 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082139:0:28064:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082148:0:28064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082164:0:28064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082171:0:28064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082178:0:28064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082185:0:28064:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082191:0:28064:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361306.082195:0:28064:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082203:0:28064:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082239:0:28064:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361306.082251:0:28064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361306.082259:0:29422:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361306.082270:0:29422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361306.082286:0:29422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d66134fa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 29422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361306.082312:0:28064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:2350:x1875232130573952:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 270us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361306.082322:0:28064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361306.249361:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361306.249401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361306.249428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361306.249454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361306.249472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361306.249493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361306.249560:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130574336 00000100:00100000:0.0:1788361306.249569:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130574336 00000100:00100000:0.0:1788361306.249622:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130574592 00000100:00100000:0.0:1788361306.249625:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130574592 00000100:00100000:0.0:1788361306.249636:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130574208 00000100:00100000:0.0:1788361306.249638:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130574208 00000100:00100000:0.0:1788361306.249647:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130574720 00000100:00100000:0.0:1788361306.249648:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130574720 00000100:00100000:0.0:1788361306.249662:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788361306.249670:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2349:x1875232130574336:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361306.249736:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2349:x1875232130574336:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361306.249743:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788361306.249759:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361306.249765:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a296666d-d333-41d2-9af9-3ecf21560298+5:2349:x1875232130574592:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361306.249788:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a296666d-d333-41d2-9af9-3ecf21560298+5:2349:x1875232130574592:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 23us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361306.249793:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361306.249802:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361306.249822:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2350:x1875232130574208:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361306.249844:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2350:x1875232130574208:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 24us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361306.249850:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361306.249860:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361306.249866:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130574720:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361306.249887:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130574720:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 22us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361306.249893:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361306.249955:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130574080 00000100:00100000:3.0:1788361306.249959:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130574080 00000100:00100000:3.0:1788361306.249995:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130574464 00000100:00100000:3.0:1788361306.249998:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130574464 00000100:00100000:3.0:1788361306.250021:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361306.250027:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2349:x1875232130574080:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361306.250055:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2349:x1875232130574080:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361306.250061:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361306.250074:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361306.250079:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a296666d-d333-41d2-9af9-3ecf21560298+6:2350:x1875232130574464:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361306.250124:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a296666d-d333-41d2-9af9-3ecf21560298+6:2350:x1875232130574464:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 44us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361306.250130:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00080000:1.0:1788361306.250379:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361306.250384:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361306.250386:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788361306.656926:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361306.786322:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361306.786345:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144148864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361306.786427:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361306.786692:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144148864 00000100:00100000:3.0:1788361306.786701:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144148864 00000100:00100000:3.0:1788361306.786770:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361306.786779:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144148864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361306.786811:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361306.786859:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144148864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361306.786866:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788361306.787056:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361306.788012:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144148864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361307.040306:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361307.040442:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130574848 00000100:00100000:3.0:1788361307.040464:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130574848 00000100:00100000:3.0:1788361307.040533:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361307.040553:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+6:24580:x1875232130574848:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361307.040573:0:28722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361307.040595:0:28722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca000/0xf6a94c97d6613501 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86edc8 expref: -99 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.040657:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6613508 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.040671:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6613508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.040684:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6613508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.040698:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661350f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.040705:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661350f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.040711:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661350f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041248:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613516 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041258:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613516 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041265:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613516 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361307.041369:0:28722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788361307.041373:0:28722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361307.041462:0:28722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613516 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041474:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6613508 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041481:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6613508 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041488:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6613508 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041494:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361307.041497:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6613508 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041504:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6613508 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041516:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:3.0:1788361307.041518:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361307.041523:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6613508 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041529:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6613508 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041540:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661350f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041555:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661350f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041561:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661350f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041566:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361307.041570:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661350f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041576:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661350f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041584:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a8a983f4500) 00010000:00010000:3.0:1788361307.041586:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361307.041589:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661350f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041595:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661350f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041626:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca000/0xf6a94c97d6613501 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc8 expref: 8 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041639:0:28722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613516 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc8 expref: 7 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.041647:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a983f4400) 00010000:00010000:3.0:1788361307.041649:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361307.041657:0:28722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcac00, rc 0) 00000100:00100000:3.0:1788361307.043325:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+7:24580:x1875232130574848:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2774us (3018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361307.043337:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361307.057878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361307.058511:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130575104 00000100:00100000:1.0:1788361307.058522:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130575104 00000100:00100000:1.0:1788361307.058639:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1788361307.058649:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+7:24580:x1875232130575104:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361307.058672:0:27405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361307.058693:0:27405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d661351d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86edcf expref: -99 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.058789:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6613524 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.058804:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6613524 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.058817:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6613524 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.058830:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d661352b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.058838:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d661352b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.058845:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d661352b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.059946:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6613532 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.059960:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6613532 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.059969:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6613532 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361307.059978:0:27405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788361307.060302:0:27405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6613524 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060714:0:27405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6613524 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060720:0:27405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6613524 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060726:0:27405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361307.060730:0:27405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6613524 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060738:0:27405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6613524 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060752:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a983f4400) 00010000:00010000:1.0:1788361307.060755:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361307.060760:0:27405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6613524 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060766:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6613524 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060779:0:27405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d661352b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060787:0:27405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d661352b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060792:0:27405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d661352b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060797:0:27405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361307.060806:0:27405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d661352b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060812:0:27405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d661352b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060820:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8984a32300) 00010000:00010000:1.0:1788361307.060823:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361307.060825:0:27405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d661352b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.060831:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d661352b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.062794:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d661351d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edcf expref: 10 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.062819:0:27405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6613532 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edcf expref: 9 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.062828:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:1.0:1788361307.062831:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361307.062833:0:27405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623c00, rc 0) 00000100:00100000:1.0:1788361307.063041:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+9:24580:x1875232130575104:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 4392us (5170us total) trans 21474836481 rc 0/0 00000100:00100000:1.0:1788361307.063050:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1788361307.067416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.067488:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130575232 00000100:00100000:0.0:1788361307.067498:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130575232 00000100:00100000:0.0:1788361307.067557:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788361307.067567:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+9:24580:x1875232130575232:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788361307.067675:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+9:24580:x1875232130575232:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 109us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.067683:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361307.131607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.131904:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130575360 00000100:00100000:0.0:1788361307.131913:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130575360 00000100:00100000:0.0:1788361307.131966:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1788361307.131974:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+9:24589:x1875232130575360:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361307.131993:0:27403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.132010:0:27403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86edd6 expref: -99 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132127:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613547 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132142:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132153:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132167:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661354e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132174:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661354e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132181:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661354e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132442:0:27403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132450:0:27403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613547 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132457:0:27403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613547 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132462:0:27403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361307.132466:0:27403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613547 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132483:0:27403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613547 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132496:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361307.132499:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.132503:0:27403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132508:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132519:0:27403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661354e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132524:0:27403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661354e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132529:0:27403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661354e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132534:0:27403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361307.132604:0:27403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661354e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132612:0:27403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661354e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132620:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff9a8a890c3200) 00010000:00010000:0.0:1788361307.132623:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.132626:0:27403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661354e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132641:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661354e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132675:0:27403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613540 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edd6 expref: 10 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132686:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361307.132688:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.132691:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edd6 expref: 10 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.132700:0:27403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964c00, rc 0) 00000100:00100000:0.0:1788361307.132773:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+9:24589:x1875232130575360:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 799us (1175us total) trans 0 rc 301/301 00000100:00100000:0.0:1788361307.132781:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1788361307.139596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.139697:0:27412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130575488 00000100:00100000:0.0:1788361307.139706:0:27412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130575488 00000100:00100000:0.0:1788361307.139815:0:27412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361307.139826:0:27412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fb21609b-c21d-4d8e-b4fa-91803d858974+9:24589:x1875232130575488:12345-192.168.203.60@tcp:700:lfs.0 00000100:00100000:0.0:1788361307.139921:0:27412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fb21609b-c21d-4d8e-b4fa-91803d858974+9:24589:x1875232130575488:12345-192.168.203.60@tcp:700:lfs.0 Request processed in 97us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.139928:0:27412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788361307.142893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.143187:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130575744 00000100:00100000:0.0:1788361307.143196:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130575744 00000100:00100000:0.0:1788361307.143263:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788361307.143281:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+9:24589:x1875232130575744:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:0.0:1788361307.143359:0:27404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361307.143384:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66134bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed5f expref: 9 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.143399:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361307.143402:0:27404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361307.144223:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.144240:0:27404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc1 expref: 5 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.144248:0:27404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.144291:0:27404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc1 expref: 5 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.144304:0:27404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc1 expref: 5 pid: 27404 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361307.144318:0:27404:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:27404:1875232144148992:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361307.144407:0:27404:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361307.146345:0:27404:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:27404:1875232144148992:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361307.146369:0:27404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361307.147671:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361307.149217:0:27388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130575872 00000100:00100000:1.0:1788361307.149245:0:27388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130575872 00010000:00010000:1.0:1788361307.149297:0:27388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc1 expref: 6 pid: 27404 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361307.149465:0:27388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1788361307.149476:0:27388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a296666d-d333-41d2-9af9-3ecf21560298+6:2350:x1875232130575872:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361307.149492:0:27388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361307.149499:0:27388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc1 expref: 6 pid: 27404 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.149512:0:27388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc1 expref: 6 pid: 27404 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.149533:0:27388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66134f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc1 expref: 6 pid: 27404 timeout: 797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.149550:0:27388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:1.0:1788361307.149556:0:27388:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.149564:0:27388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.149571:0:27388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.149602:0:27388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361307.149661:0:27388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130575872:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 187us (1995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361307.149679:0:27388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00010000:00010000:0.0:1788361307.149732:0:27404:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.149746:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.149767:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.149777:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.149785:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361307.151218:0:27404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788361307.151232:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.151240:0:27404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.151247:0:27404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.151253:0:27404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361307.151257:0:27404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.151264:0:27404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.151289:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361307.151292:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.151303:0:27404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.151309:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613555 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361307.151327:0:27404:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000326330c6 reply state 00000000bd7b6650 transno 21474836482 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361307.151336:0:27404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361307.151403:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+10:24589:x1875232130575744:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 8128us (8515us total) trans 21474836482 rc 0/0 00000100:00100000:0.0:1788361307.151411:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00010000:00010000:2.0:1788361307.153717:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.153744:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.153750:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.153756:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361307.153760:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.153766:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.153779:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff9a8a890c3200) 00010000:00010000:2.0:1788361307.153782:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361307.153785:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.153790:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661355c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361307.164489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.164628:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130576000 00000100:00100000:0.0:1788361307.164638:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130576000 00000100:00100000:0.0:1788361307.164754:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:0.0:1788361307.164765:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+9:24590:x1875232130576000:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1788361307.164788:0:27403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.164808:0:27403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613563 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eddd expref: -99 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.164871:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661356a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.164886:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661356a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.164898:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661356a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361307.164957:0:27403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361307.164973:0:27403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 9 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361307.165019:0:27403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661356a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.165045:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613563 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eddd expref: 11 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.165063:0:27403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661356a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eddd expref: 10 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.165072:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361307.165075:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361307.165080:0:27403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964a00, rc 0) 00000100:00100000:0.0:1788361307.165181:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+10:24590:x1875232130576000:12345-192.168.203.60@tcp:101:rm.0 Request processed in 417us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.165189:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1788361307.167617:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.167860:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130576128 00000100:00100000:0.0:1788361307.167869:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130576128 00000100:00100000:0.0:1788361307.167985:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361307.167996:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+10:24590:x1875232130576128:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1788361307.168017:0:28722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.168363:0:28722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ede4 expref: -99 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168429:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613578 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168443:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168474:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168488:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661357f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168496:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661357f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168504:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661357f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168615:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6613586 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168624:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6613586 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168632:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6613586 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361307.168662:0:28722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788361307.168665:0:28722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361307.168686:0:28722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6613586 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168698:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613578 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168704:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613578 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168721:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613578 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168727:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361307.168732:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613578 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168740:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613578 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168752:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361307.168755:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.168759:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613578 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168766:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613578 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168791:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661357f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168798:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661357f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168803:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661357f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168807:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361307.168810:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661357f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168827:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661357f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168836:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa14c3501 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361307.168838:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.168841:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661357f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168846:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661357f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa14c3501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168881:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ede4 expref: 12 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168895:0:28722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6613586 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ede4 expref: 11 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.168902:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361307.168916:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788361307.168918:0:28722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965400, rc 0) 00000100:00100000:0.0:1788361307.168987:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+11:24590:x1875232130576128:12345-192.168.203.60@tcp:101:rm.0 Request processed in 994us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.168996:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361307.172366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.172625:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130576256 00000100:00100000:0.0:1788361307.172636:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130576256 00000100:00100000:0.0:1788361307.172693:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361307.172703:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+11:24590:x1875232130576256:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1788361307.172738:0:27405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.172757:0:27405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d661358d lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86edeb expref: -99 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.172827:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6613594 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.172841:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6613594 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.172852:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6613594 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.172920:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661359b lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.172929:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661359b lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.172945:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661359b lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173013:0:27405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6613594 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173021:0:27405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6613594 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173027:0:27405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6613594 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173032:0:27405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361307.173043:0:27405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6613594 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173051:0:27405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6613594 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173062:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361307.173065:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.173069:0:27405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6613594 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173075:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d6613594 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173109:0:27405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661359b lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173116:0:27405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661359b lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173122:0:27405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661359b lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173127:0:27405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361307.173130:0:27405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661359b lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173136:0:27405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661359b lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173143:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff9a8a890c3b00) 00010000:00010000:0.0:1788361307.173146:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.173156:0:27405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661359b lrc: 2/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173162:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661359b lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173197:0:27405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d661358d lrc: 1/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edeb expref: 12 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173208:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361307.173210:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.173214:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d661358d lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edeb expref: 12 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.173225:0:27405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964c00, rc 0) 00000100:00100000:0.0:1788361307.173300:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+11:24590:x1875232130576256:12345-192.168.203.60@tcp:101:rm.0 Request processed in 597us (942us total) trans 0 rc 301/301 00000100:00100000:0.0:1788361307.173306:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361307.182556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.182631:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130576384 00000100:00100000:0.0:1788361307.182641:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130576384 00000100:00100000:0.0:1788361307.182700:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788361307.182710:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+11:24590:x1875232130576384:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1788361307.182730:0:27404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.182749:0:27404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66135a2 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86edf2 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.182812:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135a9 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.182843:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135a9 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.182854:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135a9 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.182868:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135b0 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.182875:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135b0 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.182881:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135b0 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183301:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135a9 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183310:0:27404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135a9 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183317:0:27404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135a9 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183324:0:27404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361307.183328:0:27404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135a9 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183336:0:27404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135a9 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183349:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361307.183358:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.183364:0:27404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135a9 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183370:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135a9 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183383:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135b0 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183388:0:27404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135b0 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183393:0:27404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135b0 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183397:0:27404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361307.183400:0:27404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135b0 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183405:0:27404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135b0 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183412:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff9a8a890c3b00) 00010000:00010000:0.0:1788361307.183414:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.183416:0:27404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135b0 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183420:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135b0 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183452:0:27404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66135a2 lrc: 1/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edf2 expref: 12 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183467:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361307.183469:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.183472:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66135a2 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edf2 expref: 12 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.183481:0:27404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964c00, rc 0) 00000100:00100000:0.0:1788361307.183557:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+11:24590:x1875232130576384:12345-192.168.203.60@tcp:101:rm.0 Request processed in 838us (1009us total) trans 0 rc 301/301 00000100:00100000:0.0:1788361307.183565:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1788361307.228333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.228473:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130576512 00000100:00100000:0.0:1788361307.228484:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130576512 00000100:00100000:0.0:1788361307.228578:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361307.228589:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+11:24596:x1875232130576512:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361307.228608:0:27403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.228629:0:27403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66135b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86edf9 expref: -99 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.228689:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135be lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.228704:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135be lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.228714:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135be lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361307.228779:0:27403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788361307.228795:0:27403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361307.228821:0:27403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135be lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.228846:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66135b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edf9 expref: 13 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.228864:0:27403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135be lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edf9 expref: 12 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.228873:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361307.228876:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361307.228880:0:27403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965c00, rc 0) 00000100:00100000:0.0:1788361307.228941:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+12:24596:x1875232130576512:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 354us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.228948:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:1.0:1788361307.232792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361307.232870:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130576768 00000100:00100000:3.0:1788361307.232880:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130576768 00000100:00100000:3.0:1788361307.232936:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361307.232946:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+12:24596:x1875232130576768:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361307.232966:0:28722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361307.232984:0:28722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca000/0xf6a94c97d66135c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee00 expref: -99 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361307.233114:0:28722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788361307.233229:0:28722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca000/0xf6a94c97d66135c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee00 expref: 14 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.233243:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:3.0:1788361307.233245:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361307.233250:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca000/0xf6a94c97d66135c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee00 expref: 14 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.233262:0:28722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca000, rc 0) 00000100:00100000:3.0:1788361307.233516:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+13:24596:x1875232130576768:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 570us (734us total) trans 21474836483 rc 301/301 00000100:00100000:3.0:1788361307.233523:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361307.236299:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361307.236408:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130577024 00000100:00100000:1.0:1788361307.236417:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130577024 00000100:00100000:1.0:1788361307.236515:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:1.0:1788361307.236525:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+13:24596:x1875232130577024:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:1.0:1788361307.236590:0:27405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361307.236618:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d66135be lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edf9 expref: 13 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.236635:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:1.0:1788361307.236639:0:27405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361307.236674:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.236686:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.236695:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361307.236932:0:27405:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ab1cd97c reply state 000000005e318609 transno 21474836484 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361307.236941:0:27405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788361307.236954:0:27405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 512 00000100:00100000:1.0:1788361307.237035:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+14:24596:x1875232130577024:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 512us (743us total) trans 21474836484 rc 0/0 00000100:00100000:1.0:1788361307.237051:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:1.0:1788361307.241988:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1788361307.242178:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.242192:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.242199:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.242206:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361307.242210:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.242218:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.242233:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:3.0:1788361307.242235:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788361307.242239:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.242245:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d66135d3 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361307.242345:0:27406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130577280 00000100:00100000:2.0:1788361307.242354:0:27406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130577280 00000100:00100000:2.0:1788361307.242404:0:27406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1788361307.242413:0:27406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+13:24596:x1875232130577280:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361307.242699:0:27406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+14:24596:x1875232130577280:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 287us (720us total) trans 21474836485 rc 0/0 00000100:00100000:2.0:1788361307.242707:0:27406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1788361307.248039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.248192:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130577536 00000100:00100000:0.0:1788361307.248202:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130577536 00000100:00100000:0.0:1788361307.248254:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:0.0:1788361307.248263:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+14:24596:x1875232130577536:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361307.248300:0:27404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.248321:0:27404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66135da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee07 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.248445:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135e1 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.248460:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135e1 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.248482:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135e1 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361307.248493:0:27404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788361307.248607:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66135da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee07 expref: 17 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.248624:0:27404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135e1 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee07 expref: 16 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.248632:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361307.248635:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361307.248638:0:27404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964e00, rc 0) 00000100:00100000:0.0:1788361307.248688:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+16:24596:x1875232130577536:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 427us (658us total) trans 21474836486 rc 0/0 00000100:00100000:0.0:1788361307.248695:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1788361307.252064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.252192:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130577664 00000100:00100000:0.0:1788361307.252201:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130577664 00000100:00100000:0.0:1788361307.252258:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361307.252268:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+16:24596:x1875232130577664:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361307.252302:0:27403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.252384:0:27403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d66135ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee0e expref: -99 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.252467:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d66135f6 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.252492:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d66135f6 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.252569:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d66135f6 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361307.252629:0:27403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788361307.252633:0:27403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361307.252653:0:27403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d66135f6 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.252671:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d66135ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee0e expref: 18 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.252684:0:27403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d66135f6 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee0e expref: 17 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.252690:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361307.252692:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361307.252694:0:27403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965000, rc 0) 00000100:00100000:0.0:1788361307.252752:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24596:x1875232130577664:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 486us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.252759:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:1.0:1788361307.256500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361307.256557:0:27406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130577792 00000100:00100000:2.0:1788361307.256567:0:27406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130577792 00000100:00100000:2.0:1788361307.256618:0:27406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:2.0:1788361307.256628:0:27406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24596:x1875232130577792:12345-192.168.203.60@tcp:37:lfs.0 00000100:00100000:1.0:1788361307.260916:0:27406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24596:x1875232130577792:12345-192.168.203.60@tcp:37:lfs.0 Request processed in 4280us (4415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361307.260930:0:27406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 10000000:01000000:1.0:1788361307.296236:0:27400:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788361307.296244:0:27400:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a8a109000 from 10 10000000:01000000:1.0:1788361307.296249:0:27400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361307.296301:0:27400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.296312:0:27400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.296323:0:27400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361307.296350:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361307.296417:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361307.296583:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361307.299972:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144149120 00000100:00100000:0.0:1788361307.299987:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144149120 00000100:00100000:0.0:1788361307.300057:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788361307.300068:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+16:27400:x1875232144149120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361307.300165:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.300192:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964400/0xf6a94c97d6613604 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66135fd expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.300218:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964400/0xf6a94c97d6613604 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66135fd expref: 17 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.300226:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964400/0xf6a94c97d6613604 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66135fd expref: 17 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.300232:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964400, rc 0) 00000100:00100000:0.0:1788361307.300308:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+17:27400:x1875232144149120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (3890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.300315:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788361307.300430:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361307.300448:0:27400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.300469:0:27400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361307.300562:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.300596:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361307.300633:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361307.300850:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144149248 00000100:00100000:1.0:1788361307.300855:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144149248 00000100:00100000:1.0:1788361307.300887:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788361307.300894:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+17:27400:x1875232144149248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361307.301328:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+17:27400:x1875232144149248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 434us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361307.301345:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788361307.301419:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.301449:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.301488:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361307.301518:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361307.301886:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144149376 00000100:00100000:2.0:1788361307.301891:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144149376 00000100:00100000:2.0:1788361307.301996:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788361307.302005:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+17:27400:x1875232144149376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361307.302204:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+17:27400:x1875232144149376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361307.302215:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788361307.302901:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361307.304762:0:29438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788361307.305393:0:27400:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788361307.305414:0:27400:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361307.305424:0:27400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.305436:0:27400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361307.305446:0:27400:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361307.305449:0:27400:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8ac05c4000 from 10 10000000:01000000:3.0:1788361307.305451:0:27400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361307.305484:0:27400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.305496:0:27400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.305556:0:27400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361307.305580:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.305634:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361307.305673:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361307.305929:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144149504 00000100:00100000:1.0:1788361307.305945:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144149504 00000100:00100000:1.0:1788361307.305994:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788361307.306003:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+17:27400:x1875232144149504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361307.306017:0:27397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361307.306031:0:27397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987622c00/0xf6a94c97d6613612 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661360b expref: -99 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.306054:0:27397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987622c00/0xf6a94c97d6613612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661360b expref: 18 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.306064:0:27397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987622c00/0xf6a94c97d6613612 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661360b expref: 18 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.306072:0:27397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622c00, rc 0) 00000100:00100000:1.0:1788361307.306142:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+18:27400:x1875232144149504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361307.306149:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788361307.306282:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361307.306296:0:27400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.306306:0:27400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361307.306357:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.306383:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361307.306412:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361307.306472:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144149632 00000100:00100000:0.0:1788361307.306477:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144149632 00000100:00100000:0.0:1788361307.306597:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788361307.306606:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+18:27400:x1875232144149632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361307.306850:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+18:27400:x1875232144149632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.306856:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788361307.306915:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.306939:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.306974:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361307.307038:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361307.307072:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144149760 00000100:00100000:0.0:1788361307.307076:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144149760 00000100:00100000:0.0:1788361307.307122:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788361307.307128:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+18:27400:x1875232144149760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361307.307264:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+18:27400:x1875232144149760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.307280:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788361307.307377:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361307.308368:0:29439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788361307.308512:0:27400:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788361307.308528:0:27400:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361307.308594:0:27400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.308614:0:27400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361307.308624:0:27400:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361307.308626:0:27400:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8987bd6000 from 10 10000000:01000000:3.0:1788361307.308629:0:27400:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361307.308651:0:27400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.308659:0:27400:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.308668:0:27400:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361307.308685:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.308721:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361307.308777:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361307.308809:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144149888 00000100:00100000:0.0:1788361307.308815:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144149888 00000100:00100000:0.0:1788361307.308878:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788361307.308886:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+18:27400:x1875232144149888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361307.308897:0:27395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.308908:0:27395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964c00/0xf6a94c97d6613620 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613619 expref: -99 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.308926:0:27395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964c00/0xf6a94c97d6613620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613619 expref: 19 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.308935:0:27395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964c00/0xf6a94c97d6613620 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613619 expref: 19 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.308942:0:27395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964c00, rc 0) 00000100:00100000:0.0:1788361307.308980:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+19:27400:x1875232144149888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.308986:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788361307.309052:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144149888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361307.309063:0:27400:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.309071:0:27400:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361307.309145:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144150016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.309169:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361307.309455:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361307.309528:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144150016 00000100:00100000:1.0:1788361307.309533:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144150016 00000100:00100000:1.0:1788361307.309562:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788361307.309570:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+19:27400:x1875232144150016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361307.309773:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+19:27400:x1875232144150016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361307.309781:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788361307.309908:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144150016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.309937:0:27400:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144150144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361307.309972:0:27400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361307.309992:0:27400:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361307.310035:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144150144 00000100:00100000:1.0:1788361307.310040:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144150144 00000100:00100000:1.0:1788361307.310058:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788361307.310063:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+19:27400:x1875232144150144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361307.310213:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+19:27400:x1875232144150144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361307.310219:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788361307.310293:0:27400:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e46014fe-639d-4b32-8855-95bba88887b0:27400:1875232144150144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361307.311149:0:29440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788361307.311354:0:27400:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788361307.311372:0:27400:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361307.311381:0:27400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361307.311391:0:27400:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361307.561340:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.561437:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130578048 00000100:00100000:0.0:1788361307.561448:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130578048 00000100:00100000:0.0:1788361307.561509:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:0.0:1788361307.561519:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24612:x1875232130578048:12345-192.168.203.60@tcp:101:multiop.0 00010000:00010000:0.0:1788361307.561680:0:27404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.561684:0:27404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788361307.561710:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d66135f6 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee0e expref: 17 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.561729:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361307.561744:0:27404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361307.561758:0:27404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613627 lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee15 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.562039:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d661362e lrc: 3/0,1 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.562052:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d661362e lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.562449:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d661362e lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.562469:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.562476:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.562483:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563308:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661363c lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563318:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661363c lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563326:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661363c lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361307.563336:0:27404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788361307.563361:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d661362e lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563373:0:27404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d661362e lrc: 2/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563380:0:27404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d661362e lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563385:0:27404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361307.563389:0:27404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d661362e lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563396:0:27404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d661362e lrc: 4/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563407:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361307.563409:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361307.563413:0:27404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d661362e lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563419:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965c00/0xf6a94c97d661362e lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361307.563430:0:27404:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ba27d7e2 reply state 0000000024d8e8b8 transno 21474836487 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361307.563438:0:27404:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361307.563467:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613627 lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee15 expref: 19 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563480:0:27404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661363c lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee15 expref: 18 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.563497:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:0.0:1788361307.563499:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788361307.563501:0:27404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:0.0:1788361307.564745:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+19:24612:x1875232130578048:12345-192.168.203.60@tcp:101:multiop.0 Request processed in 2054us (2240us total) trans 21474836487 rc 0/0 00000100:00100000:0.0:1788361307.564760:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00010000:00010000:2.0:1788361307.569567:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.569731:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.569739:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.569745:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361307.569750:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.569759:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.569780:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361307.569783:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361307.569857:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.569865:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6613635 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361307.682193:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361307.847774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361307.847867:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130578176 00000100:00100000:0.0:1788361307.847877:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130578176 00000100:00100000:0.0:1788361307.847931:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:0.0:1788361307.847941:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:23978:x1875232130578176:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361307.847956:0:27397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361307.847973:0:27397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e600/0xf6a94c97d661364a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee1c expref: -99 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.848010:0:27397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e600/0xf6a94c97d661364a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee1c expref: 12 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.848022:0:27397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e600/0xf6a94c97d661364a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee1c expref: 12 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361307.848031:0:27397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e600, rc 0) 00000100:00100000:0.0:1788361307.848135:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:23978:x1875232130578176:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 194us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361307.848141:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:3.0:1788361307.851143:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361307.851214:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130578304 00000100:00100000:2.0:1788361307.851224:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130578304 00000100:00100000:2.0:1788361307.851325:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:2.0:1788361307.851335:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:23978:x1875232130578304:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361307.851609:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:23978:x1875232130578304:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 275us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361307.851617:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:2.0:1788361307.854942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361307.855057:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130578432 00000100:00100000:1.0:1788361307.855067:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130578432 00000100:00100000:1.0:1788361307.855194:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788361307.855204:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:23978:x1875232130578432:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361307.855463:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:23978:x1875232130578432:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 259us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361307.855471:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788361307.860753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361307.860911:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130578560 00000100:00100000:2.0:1788361307.860921:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130578560 00000100:00100000:2.0:1788361307.861047:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:2.0:1788361307.861056:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:23978:x1875232130578560:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361307.861072:0:27398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361307.861111:0:27398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8200/0xf6a94c97d6613651 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee23 expref: -99 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.861136:0:27398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8200/0xf6a94c97d6613651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee23 expref: 13 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.861145:0:27398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b8200/0xf6a94c97d6613651 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee23 expref: 13 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361307.861152:0:27398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8200, rc 0) 00000100:00100000:2.0:1788361307.861225:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:23978:x1875232130578560:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 169us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361307.861232:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:3.0:1788361307.862611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361307.862689:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130578688 00000100:00100000:1.0:1788361307.862696:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130578688 00000100:00100000:1.0:1788361307.862733:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:1.0:1788361307.862752:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:23978:x1875232130578688:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361307.863004:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:23978:x1875232130578688:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 253us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361307.863012:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:1.0:1788361307.868508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361307.868579:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130578816 00000100:00100000:2.0:1788361307.868589:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130578816 00000100:00100000:2.0:1788361307.868640:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:2.0:1788361307.868649:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:23978:x1875232130578816:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361307.868864:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:23978:x1875232130578816:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 214us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361307.868872:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00000040:00080000:3.0:1788361307.936927:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788361308.706772:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361308.832413:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361308.832576:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144150400:0@lo:400:kworker.0 00000100:00100000:3.0:1788361308.832643:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361308.832698:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361308.832704:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144150528:0@lo:400:kworker.0 00000100:00100000:3.0:1788361308.832725:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361308.832758:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144150400 00000100:00100000:3.0:1788361308.832763:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144150400 00000100:00100000:3.0:1788361308.832802:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788361308.832811:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+19:3313:x1875232144150400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361308.832860:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+19:3313:x1875232144150400:12345-0@lo:400:kworker.0 Request processed in 50us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361308.832868:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788361308.832885:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144150656:0@lo:400:kworker.0 00000100:00100000:3.0:1788361308.832915:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144150400:0@lo:400:kworker.0 00000100:00100000:0.0:1788361308.832917:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361308.832935:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144150272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361308.832957:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361308.832971:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144150272 00000100:00100000:0.0:1788361308.832981:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144150528 00000100:00100000:3.0:1788361308.832982:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144150272 00000100:00100000:0.0:1788361308.832983:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144150528 00000100:00100000:0.0:1788361308.833017:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144150656 00000100:00100000:3.0:1788361308.833019:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361308.833019:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144150656 00000100:00100000:3.0:1788361308.833025:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144150272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361308.833040:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788361308.833046:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144150528:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788361308.833050:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361308.833104:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144150272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361308.833112:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361308.833116:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144150528:12345-0@lo:400:kworker.0 Request processed in 39us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361308.833121:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788361308.833134:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361308.833141:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144150656:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361308.833162:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361308.833167:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361308.833169:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144150656:12345-0@lo:400:kworker.0 Request processed in 30us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361308.833174:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361308.833194:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144150528:0@lo:400:kworker.0 00000100:00100000:0.0:1788361308.833216:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 2 00000100:00100000:0.0:1788361308.833228:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144150656:0@lo:400:kworker.0 00000100:00100000:0.0:1788361308.833244:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144150272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361308.833569:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144151040:0@lo:400:kworker.0 00000100:00100000:3.0:1788361308.833587:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144150784:0@lo:400:kworker.0 00000100:00100000:2.0:1788361308.833616:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361308.833639:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144150912:0@lo:400:kworker.0 00000100:00100000:3.0:1788361308.833647:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144151040 00000100:00100000:2.0:1788361308.833648:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361308.833652:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144151040 00000100:00080000:3.0:1788361308.833669:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361308.833691:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144150784 00000100:00100000:1.0:1788361308.833693:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361308.833695:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144150784 00000100:00100000:2.0:1788361308.833697:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361308.833705:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144151040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361308.833709:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144150912 00000100:00100000:3.0:1788361308.833711:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144150912 00000100:00080000:3.0:1788361308.833725:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361308.833744:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361308.833745:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144151040:12345-0@lo:400:kworker.0 Request processed in 41us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361308.833749:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144150784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361308.833751:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361308.833763:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788361308.833782:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361308.833789:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144150784:12345-0@lo:400:kworker.0 Request processed in 40us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361308.833795:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361308.833811:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986360000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144150912:12345-0@lo:400:kworker.0 Request processed in 43us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361308.833818:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361308.833828:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144151040:0@lo:400:kworker.0 00000100:00100000:1.0:1788361308.833843:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144150912:0@lo:400:kworker.0 00000100:00100000:3.0:1788361308.833865:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144150784:0@lo:400:kworker.0 00000040:00080000:3.0:1788361308.960742:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1788361309.384818:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836487 is committed 00010000:00010000:2.0:1788361309.728527:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361310.430625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361310.430709:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130579072 00000100:00100000:2.0:1788361310.430720:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130579072 00000100:00100000:2.0:1788361310.430806:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:2.0:1788361310.430818:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+11:24638:x1875232130579072:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361310.430841:0:27405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361310.430863:0:27405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613658 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee2a expref: -99 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.430982:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661365f lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.430998:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661365f lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.431015:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661365f lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361310.431028:0:27405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788361310.431261:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613658 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee2a expref: 14 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.431281:0:27405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661365f lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee2a expref: 13 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.431289:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:2.0:1788361310.431292:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361310.431297:0:27405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361310.431360:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+13:24638:x1875232130579072:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 545us (745us total) trans 21474836488 rc 0/0 00000100:00100000:2.0:1788361310.431381:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00080000:3.0:1788361310.431792:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361310.434349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361310.437096:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130579200 00000100:00100000:0.0:1788361310.437110:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130579200 00000100:00100000:0.0:1788361310.437181:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361310.437189:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+13:24638:x1875232130579200:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:0.0:1788361310.437266:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661366d lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.437293:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661366d lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.437305:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661366d lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.437342:0:27403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661366d lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.437348:0:27403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661366d lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.437359:0:27403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661366d lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.437365:0:27403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361310.437372:0:27403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661366d lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.437379:0:27403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661366d lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.437389:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:0.0:1788361310.437391:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361310.437395:0:27403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661366d lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.437401:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661366d lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361310.437476:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+13:24638:x1875232130579200:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 287us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361310.437488:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788361310.440876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361310.440977:0:27407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130579456 00000100:00100000:3.0:1788361310.440988:0:27407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130579456 00000100:00100000:3.0:1788361310.441042:0:27407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361310.441051:0:27407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a909e0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+13:24638:x1875232130579456:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361310.441454:0:27407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a909e0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+14:24638:x1875232130579456:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 402us (587us total) trans 21474836489 rc 0/0 00000100:00100000:3.0:1788361310.441462:0:27407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361310.501529:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361310.501612:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130579712 00000100:00100000:2.0:1788361310.501623:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130579712 00000100:00100000:2.0:1788361310.501685:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:2.0:1788361310.501695:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+14:24648:x1875232130579712:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:2.0:1788361310.501751:0:27405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361310.501778:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661365f lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee2a expref: 14 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.501795:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:2.0:1788361310.501799:0:27405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361310.501984:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.501997:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.502005:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361310.502058:0:27405:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836490 00000004:00010000:2.0:1788361310.502078:0:27405:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000984cc102 reply state 00000000497d2f34 transno 21474836491 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361310.502363:0:27405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361310.502470:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+16:24648:x1875232130579712:12345-192.168.203.60@tcp:36:bash.0 Request processed in 776us (961us total) trans 21474836491 rc 0/0 00000100:00100000:2.0:1788361310.502479:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000020:00080000:2.0:1788361310.502499:0:27405:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361310.504744:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.504776:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.504784:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.504790:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361310.504795:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.504803:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.504820:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:3.0:1788361310.504824:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361310.504828:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.504848:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613674 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361310.505902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361310.506474:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130579840 00000100:00100000:2.0:1788361310.506485:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130579840 00000100:00100000:2.0:1788361310.506611:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1788361310.506621:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+15:24648:x1875232130579840:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361310.506645:0:27404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361310.506662:0:27404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661367b lrc: 2/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee31 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.506743:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6613682 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.506757:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6613682 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.506778:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6613682 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361310.506807:0:27404:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788361310.506811:0:27404:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361310.506829:0:27404:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6613682 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.506853:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661367b lrc: 0/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee31 expref: 17 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.506870:0:27404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6613682 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee31 expref: 16 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.506878:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:2.0:1788361310.506892:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361310.506896:0:27404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:2.0:1788361310.506963:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+16:24648:x1875232130579840:12345-192.168.203.60@tcp:101:bash.0 Request processed in 343us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361310.506970:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1788361310.537871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361310.540473:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130579968 00000100:00100000:2.0:1788361310.540490:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130579968 00000100:00100000:2.0:1788361310.540958:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1788361310.540969:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+16:24651:x1875232130579968:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361310.540990:0:28722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361310.541009:0:28722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6613689 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee38 expref: -99 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541070:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613690 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541083:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613690 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541114:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613690 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541129:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613697 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541137:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613697 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541143:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613697 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541499:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661369e lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541509:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661369e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541527:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661369e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361310.541570:0:28722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788361310.541574:0:28722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361310.541592:0:28722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661369e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541602:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661369e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541609:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613690 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541615:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613690 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541622:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613690 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541628:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361310.541632:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613690 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541639:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613690 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541659:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:2.0:1788361310.541662:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361310.541666:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613690 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541671:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613690 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541682:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613697 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541687:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613697 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541692:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613697 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541696:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361310.541699:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613697 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541703:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613697 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541708:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x4453f327 (ffff9a8aa8ee1a00) 00010000:00010000:2.0:1788361310.541710:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361310.541713:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613697 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541717:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613697 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x4453f327 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541757:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6613689 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee38 expref: 18 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541769:0:28722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661369e lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee38 expref: 17 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.541775:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:2.0:1788361310.541777:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361310.541779:0:28722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361310.541860:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24651:x1875232130579968:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 892us (3999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361310.541867:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361310.549551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361310.551333:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130580096 00000100:00100000:0.0:1788361310.551347:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130580096 00000100:00100000:0.0:1788361310.551423:0:28064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361310.551433:0:28064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986363800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+17:2350:x1875232130580096:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361310.551448:0:28064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361310.551472:0:28064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661369e lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee38 expref: 17 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.551491:0:28064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:0.0:1788361310.551495:0:28064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361310.551560:0:28064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986363800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+16:2350:x1875232130580096:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 129us (2020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361310.551567:0:28064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00010000:00010000:3.0:1788361310.752337:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361310.798404:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361310.798535:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130580352 00000100:00100000:0.0:1788361310.798546:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130580352 00000100:00100000:0.0:1788361310.798622:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788361310.798637:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+16:24681:x1875232130580352:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:0.0:1788361310.798661:0:27403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361310.798681:0:27403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66136a5 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee3f expref: -99 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.798910:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66136ac lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.798932:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66136ac lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.798965:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66136ac lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361310.798982:0:27403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788361310.799450:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66136a5 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee3f expref: 19 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.799856:0:27403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66136ac lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee3f expref: 18 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.799865:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:0.0:1788361310.799868:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361310.799871:0:27403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ea00, rc 0) 00000100:00100000:0.0:1788361310.799994:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+18:24681:x1875232130580352:12345-192.168.203.60@tcp:101:cat.0 Request processed in 1362us (1600us total) trans 21474836492 rc 0/0 00000100:00100000:0.0:1788361310.800003:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:1.0:1788361310.806256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361310.806353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361310.806447:0:27407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130580736 00000100:00100000:2.0:1788361310.806456:0:27407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130580736 00000100:00100000:2.0:1788361310.806524:0:27407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361310.806533:0:27407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+18:24681:x1875232130580736:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:2.0:1788361310.806849:0:27407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+19:24681:x1875232130580736:12345-192.168.203.60@tcp:35:cat.0 Request processed in 317us (494us total) trans 21474836493 rc 0/0 00000100:00100000:2.0:1788361310.806857:0:27407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361310.807319:0:27390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130580480 00000100:00100000:3.0:1788361310.807326:0:27390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130580480 00000100:00100000:3.0:1788361310.807361:0:27390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361310.807368:0:27390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986361c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+19:2351:x1875232130580480:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361310.807378:0:27390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361310.807401:0:27390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66136ac lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee3f expref: 19 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.807417:0:27390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:3.0:1788361310.807421:0:27390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361310.807972:0:27390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986361c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+18:2351:x1875232130580480:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 602us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361310.807980:0:27390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:1.0:1788361310.840243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361310.841013:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130580992 00000100:00100000:3.0:1788361310.841023:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130580992 00000100:00100000:3.0:1788361310.841126:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1788361310.841137:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+18:24684:x1875232130580992:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361310.841160:0:27405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361310.841310:0:27405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d66136ba lrc: 2/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee46 expref: -99 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.841430:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d66136c1 lrc: 3/1,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.841444:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d66136c1 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.841456:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d66136c1 lrc: 3/1,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361310.841466:0:27405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788361310.841587:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d66136ba lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee46 expref: 21 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.841606:0:27405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d66136c1 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee46 expref: 20 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361310.841615:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:3.0:1788361310.841618:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788361310.841621:0:27405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb000, rc 0) 00000100:00100000:3.0:1788361310.841675:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24684:x1875232130580992:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 540us (1441us total) trans 21474836494 rc 0/0 00000100:00100000:3.0:1788361310.841684:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:2.0:1788361310.845288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361310.845440:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130581120 00000100:00100000:0.0:1788361310.845449:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130581120 00000100:00100000:0.0:1788361310.845504:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1788361310.845512:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24684:x1875232130581120:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:0.0:1788361310.845571:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66136cf lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.845587:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66136cf lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.845597:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66136cf lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.845638:0:27404:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66136cf lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.845644:0:27404:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66136cf lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.845651:0:27404:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66136cf lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.845657:0:27404:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361310.845661:0:27404:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66136cf lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.845668:0:27404:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66136cf lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.845680:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:0.0:1788361310.845683:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361310.845688:0:27404:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66136cf lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.845693:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66136cf lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361310.845768:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24684:x1875232130581120:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 255us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361310.845774:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1788361310.914166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361310.914261:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130581248 00000100:00100000:2.0:1788361310.914271:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130581248 00000100:00100000:2.0:1788361310.914378:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:2.0:1788361310.914388:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24694:x1875232130581248:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361310.914408:0:28722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361310.914442:0:28722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee4d expref: -99 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.914506:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66136dd lrc: 3/1,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.914520:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66136dd lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.914532:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66136dd lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361310.914726:0:28722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361310.914730:0:28722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361310.914809:0:28722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66136dd lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.914835:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee4d expref: 22 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.914851:0:28722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66136dd lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee4d expref: 21 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.914859:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:2.0:1788361310.914861:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361310.914865:0:28722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361310.914937:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+21:24694:x1875232130581248:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 550us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361310.914944:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:1.0:1788361310.918378:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361310.919755:0:27407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130581632 00000100:00100000:2.0:1788361310.919780:0:27407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130581632 00000100:00100000:2.0:1788361310.919893:0:27407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788361310.919903:0:27407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+21:24694:x1875232130581632:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361310.920158:0:27407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+22:24694:x1875232130581632:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 255us (1787us total) trans 21474836495 rc 0/0 00000100:00100000:2.0:1788361310.920166:0:27407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361310.923186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361310.923441:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130581760 00000100:00100000:0.0:1788361310.923450:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130581760 00000100:00100000:0.0:1788361310.923580:0:28064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1788361310.923592:0:28064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+22:24694:x1875232130581760:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:0.0:1788361310.923608:0:28064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788361310.923634:0:28064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d66136c1 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee46 expref: 22 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.923655:0:28064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6613682 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee31 expref: 21 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.923668:0:28064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661363c lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee15 expref: 20 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361310.923677:0:28064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8a890c3c00) 00010000:00010000:0.0:1788361310.923686:0:28064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361310.923743:0:28064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986362680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+19:24694:x1875232130581760:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 154us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361310.923751:0:28064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1788361310.925498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361310.925735:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130581888 00000100:00100000:2.0:1788361310.925744:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130581888 00000100:00100000:2.0:1788361310.925793:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1788361310.925802:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+19:24694:x1875232130581888:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:2.0:1788361310.925961:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.925976:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.925987:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361310.927204:0:27404:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361310.927382:0:27404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 64 off8512 00000040:00080000:2.0:1788361310.927455:0:27404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].1, 136 off8328 00000100:00100000:2.0:1788361310.927766:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+19:24694:x1875232130581888:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 1961us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361310.927776:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:3.0:1788361310.934836:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361310.934978:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130582016 00000100:00100000:2.0:1788361310.934988:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130582016 00000100:00100000:2.0:1788361310.935129:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:2.0:1788361310.935139:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+19:24694:x1875232130582016:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361310.935171:0:27405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361310.935191:0:27405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66136eb lrc: 2/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee54 expref: -99 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.935255:0:27405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 2/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.935267:0:27405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66136eb lrc: 4/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee54 expref: 20 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.935286:0:27405:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.935300:0:27405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66136eb lrc: 3/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee54 expref: 20 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.935325:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:2.0:1788361310.935329:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361310.935333:0:27405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66136eb lrc: 3/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee54 expref: 20 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361310.935340:0:27405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8600, rc 0) 00000100:00100000:2.0:1788361310.935393:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24694:x1875232130582016:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 256us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361310.935401:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000040:00080000:3.0:1788361311.008360:0:27435:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1788361311.008369:0:27435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361311.008406:0:27435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 2 count 2 00000040:00080000:3.0:1788361311.008413:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1788361311.008532:0:27435:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:27435:1875232144151168:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788361311.008881:0:27435:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361311.018434:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361311.018573:0:27435:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:27435:1875232144151168:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361311.018575:0:27414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130582144 00000100:00100000:0.0:1788361311.018584:0:27414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130582144 00000100:00100000:0.0:1788361311.018693:0:27414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361311.018706:0:27414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24695:x1875232130582144:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788361311.018786:0:27414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24695:x1875232130582144:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 Request processed in 83us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.018794:0:27414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361311.021164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.021312:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130582272 00000100:00100000:0.0:1788361311.021334:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130582272 00000100:00100000:0.0:1788361311.021390:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1788361311.021400:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24695:x1875232130582272:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788361311.021435:0:27403:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200002341:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788361311.021538:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24695:x1875232130582272:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 138us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.021545:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:1.0:1788361311.025335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.026005:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130582400 00000100:00100000:0.0:1788361311.026016:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130582400 00000100:00100000:0.0:1788361311.026307:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:0.0:1788361311.026317:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24695:x1875232130582400:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788361311.026394:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66136f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026411:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66136f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026425:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66136f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026439:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66136f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026446:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66136f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026453:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66136f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026476:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026498:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026505:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361311.026647:0:28722:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788361311.026651:0:28722:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361311.026666:0:28722:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026679:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66136f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026685:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66136f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026692:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66136f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026699:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361311.026703:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66136f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026711:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66136f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026724:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:0.0:1788361311.026727:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361311.026732:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66136f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026749:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66136f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026765:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66136f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026771:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66136f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026776:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66136f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026781:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361311.026784:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66136f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026790:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66136f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026797:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x29bef300 (ffff9a8a890c3c00) 00010000:00010000:0.0:1788361311.026800:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361311.026803:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66136f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026808:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66136f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x29bef300 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026822:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026828:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026840:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026845:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361311.026848:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026855:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026863:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788361311.026866:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361311.026869:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.026875:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6613700 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361311.027026:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24695:x1875232130582400:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 708us (1697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.027045:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1788361311.036462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.037757:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130582656 00000100:00100000:0.0:1788361311.037769:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130582656 00000100:00100000:0.0:1788361311.037843:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:0.0:1788361311.037855:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24695:x1875232130582656:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361311.037876:0:27403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361311.037897:0:27403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613707 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee5b expref: -99 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038013:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d661370e lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038029:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d661370e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038040:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d661370e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361311.038051:0:27403:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788361311.038177:0:27403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d661370e lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038186:0:27403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d661370e lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038192:0:27403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d661370e lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038198:0:27403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361311.038203:0:27403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d661370e lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038209:0:27403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d661370e lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038221:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788361311.038224:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361311.038228:0:27403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d661370e lrc: 2/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038255:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d661370e lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038296:0:27403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613707 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee5b expref: 22 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038306:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:0.0:1788361311.038308:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361311.038312:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613707 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee5b expref: 22 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.038321:0:27403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:0.0:1788361311.038386:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+21:24695:x1875232130582656:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 533us (1933us total) trans 21474836496 rc 301/301 00000100:00100000:0.0:1788361311.038393:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:1.0:1788361311.041006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361311.041208:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130582784 00000100:00100000:2.0:1788361311.041218:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130582784 00000100:00100000:2.0:1788361311.041323:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:2.0:1788361311.041346:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+21:24695:x1875232130582784:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361311.041386:0:27405:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200002341:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361311.041486:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986360a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+21:24695:x1875232130582784:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 142us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361311.041493:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:1.0:1788361311.044281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361311.044898:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130583040 00000100:00100000:2.0:1788361311.044907:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130583040 00000100:00100000:2.0:1788361311.044997:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:2.0:1788361311.045008:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+21:24695:x1875232130583040:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361311.045028:0:27404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361311.045031:0:27404:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361311.045057:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66136dd lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee4d expref: 21 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.045075:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:2.0:1788361311.045080:0:27404:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361311.045112:0:27404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661371c lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee62 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361311.047529:0:27404:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x64:0x0], count =30 00000004:00080000:2.0:1788361311.047541:0:27404:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x64:0x0]+30 in llog 00000004:00080000:2.0:1788361311.047591:0:27404:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x82:0x0], index 0: 0 00010000:00010000:2.0:1788361311.049430:0:27404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613723 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.049453:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613723 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.049480:0:27404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613723 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.049553:0:27404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661371c lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee62 expref: 23 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.049571:0:27404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613723 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee62 expref: 22 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.049580:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:2.0:1788361311.049583:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361311.049586:0:27404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9e00, rc 0) 00000100:00100000:2.0:1788361311.049674:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+22:24695:x1875232130583040:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 4657us (5390us total) trans 21474836497 rc 0/0 00000100:00100000:2.0:1788361311.049682:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:1.0:1788361311.054791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.055323:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130583296 00000100:00100000:0.0:1788361311.055337:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130583296 00000100:00100000:0.0:1788361311.055427:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1788361311.055438:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+22:24695:x1875232130583296:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361311.055502:0:28722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361311.055530:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613723 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee62 expref: 22 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.055548:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:0.0:1788361311.055561:0:28722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361311.055582:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613731 lrc: 3/0,1 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.055607:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613731 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.055618:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613731 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.055632:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613738 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x1:0x0].0xd225ee50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.055639:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613738 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0xd225ee50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.055645:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613738 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0xd225ee50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056003:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613731 lrc: 3/0,1 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056012:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613731 lrc: 2/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056018:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613731 lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056024:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361311.056028:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613731 lrc: 3/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056036:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613731 lrc: 4/0,0 mode: CW/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056046:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361311.056054:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361311.056059:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613731 lrc: 2/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056066:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6613731 lrc: 0/0,0 mode: --/CW res: [0x200002341:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056076:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613738 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x1:0x0].0xd225ee50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056081:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613738 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0xd225ee50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056104:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613738 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0xd225ee50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056109:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361311.056112:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613738 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0xd225ee50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056117:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613738 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x1:0x0].0xd225ee50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056125:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0xd225ee50 (ffff9a8a890c3c00) 00010000:00010000:0.0:1788361311.056127:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361311.056129:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613738 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0xd225ee50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.056134:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613738 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x1:0x0].0xd225ee50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361311.056460:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+21:24695:x1875232130583296:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1022us (1680us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361311.056475:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:1.0:1788361311.060465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.060552:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130583424 00000100:00100000:0.0:1788361311.060561:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130583424 00000100:00100000:0.0:1788361311.060654:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1788361311.060665:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+21:24695:x1875232130583424:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361311.060687:0:27403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361311.060710:0:27403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d661373f lrc: 2/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee69 expref: -99 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.060745:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.060768:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.060780:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.060880:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d661373f lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee69 expref: 23 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.060899:0:27403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee69 expref: 22 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.060908:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361311.060910:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361311.060914:0:27403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:0.0:1788361311.060987:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+22:24695:x1875232130583424:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 324us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.061001:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:1.0:1788361311.064922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361311.067064:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130583680 00000100:00100000:2.0:1788361311.067076:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130583680 00000100:00100000:2.0:1788361311.067144:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:2.0:1788361311.067154:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+22:24695:x1875232130583680:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361311.067238:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.067281:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.067293:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361311.067677:0:27405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x1c:0x0].2, 88 off8344 00000004:00080000:2.0:1788361311.067687:0:27405:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 701082600022ns, next at 702082598065ns, rc = 0 00000004:00010000:2.0:1788361311.067933:0:27405:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008a99b12b reply state 0000000059f55f65 transno 21474836498 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361311.067997:0:27405:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361311.068406:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+24:24695:x1875232130583680:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1250us (3490us total) trans 21474836498 rc 0/0 00000100:00100000:2.0:1788361311.068414:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00010000:00010000:2.0:1788361311.070388:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.070403:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.070410:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.070416:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361311.070420:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.070428:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.070443:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361311.070447:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361311.070452:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 2/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.070476:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d661374d lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361311.070898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361311.071008:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130583808 00000100:00100000:2.0:1788361311.071017:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130583808 00000100:00100000:2.0:1788361311.071484:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:2.0:1788361311.071495:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+23:24695:x1875232130583808:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361311.071517:0:27404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361311.071533:0:27404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613754 lrc: 2/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee70 expref: -99 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.071590:0:27404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613754 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee70 expref: 24 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.071603:0:27404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613754 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee70 expref: 24 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.071622:0:27404:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361311.071624:0:27404:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361311.071628:0:27404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361311.071761:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+24:24695:x1875232130583808:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 259us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361311.071768:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:1.0:1788361311.074028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361311.074139:0:28204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130583936 00000100:00100000:3.0:1788361311.074219:0:28204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130583936 00000100:00100000:3.0:1788361311.074296:0:28204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361311.074305:0:28204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2350:x1875232130583936:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788361311.074648:0:28204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986363480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2350:x1875232130583936:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 343us (625us total) trans 21474836482 rc 0/0 00000100:00100000:3.0:1788361311.074656:0:28204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00080000:0.0:1788361311.075900:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361311.077479:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361311.077515:0:27406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130584192 00000100:00100000:2.0:1788361311.077524:0:27406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130584192 00000100:00100000:2.0:1788361311.077579:0:27406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788361311.077590:0:27406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+24:24695:x1875232130584192:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361311.077963:0:27406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+25:24695:x1875232130584192:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 375us (491us total) trans 21474836499 rc 0/0 00000100:00100000:2.0:1788361311.077971:0:27406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361311.080891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.081020:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130584448 00000100:00100000:0.0:1788361311.081039:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130584448 00000100:00100000:0.0:1788361311.081159:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:0.0:1788361311.081170:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+25:24695:x1875232130584448:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788361311.081314:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+25:24695:x1875232130584448:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 146us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.081322:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:1.0:1788361311.085268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.085469:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130584576 00000100:00100000:0.0:1788361311.085480:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130584576 00000100:00100000:0.0:1788361311.085545:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:0.0:1788361311.085554:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+25:24695:x1875232130584576:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361311.085573:0:27403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361311.085592:0:27403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d661375b lrc: 2/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee77 expref: -99 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.085658:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613762 lrc: 3/1,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.085898:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613762 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.085911:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613762 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361311.085945:0:27403:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361311.085976:0:27403:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613762 lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.086001:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d661375b lrc: 0/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee77 expref: 27 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.086018:0:27403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613762 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee77 expref: 26 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.086027:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361311.086119:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788361311.086123:0:27403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f800, rc 0) 00000100:00100000:0.0:1788361311.086287:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+26:24695:x1875232130584576:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 726us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.086295:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:3.0:1788361311.090041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.090517:0:28041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130584704 00000100:00100000:0.0:1788361311.090528:0:28041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130584704 00000100:00100000:0.0:1788361311.090597:0:28041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788361311.090608:0:28041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2350:x1875232130584704:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361311.090626:0:28041:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361311.090646:0:28041:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d6613769 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee7e expref: -99 pid: 28041 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361311.090673:0:28041:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983a5f, blocks: 0x1 00010000:00010000:0.0:1788361311.090694:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=701s v=(0 0) 00010000:00010000:0.0:1788361311.090698:0:28041:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361311.090707:0:28041:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d6613769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee7e expref: 7 pid: 28041 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.090745:0:28041:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d6613769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee7e expref: 7 pid: 28041 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.090759:0:28041:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:0.0:1788361311.090818:0:28041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+7:2350:x1875232130584704:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 212us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.090825:0:28041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361311.093901:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361311.093987:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130584960 00000100:00100000:3.0:1788361311.093998:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130584960 00000100:00100000:3.0:1788361311.094055:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:3.0:1788361311.094065:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+26:24695:x1875232130584960:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788361311.094397:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+26:24695:x1875232130584960:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 333us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361311.094409:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:1.0:1788361311.100402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361311.100615:0:28204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130585088 00000100:00100000:3.0:1788361311.100625:0:28204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130585088 00000100:00100000:3.0:1788361311.100686:0:28204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361311.100697:0:28204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+7:24695:x1875232130585088:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361311.100717:0:28204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361311.100740:0:28204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee85 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.100793:0:28204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d6613769 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee7e expref: 8 pid: 28041 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.100802:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361311.100807:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361311.100813:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 8 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.100852:0:28204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d6613769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee7e expref: 8 pid: 28041 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.100866:0:28204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d6613769 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee7e expref: 8 pid: 28041 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361311.100881:0:28204:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f585f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:28204:1875232144151296:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361311.100995:0:28204:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361311.105547:0:28204:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f585f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:28204:1875232144151296:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361311.105600:0:28204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 8 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.105624:0:28204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca600, rc 0) 00000100:00100000:2.0:1788361311.105692:0:28204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+8:24695:x1875232130585088:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 4997us (5309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361311.105702:0:28204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361311.106446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361311.106536:0:27388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130585216 00000100:00100000:1.0:1788361311.106544:0:27388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130585216 00010000:00010000:1.0:1788361311.106588:0:27388:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d6613769 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee7e expref: 8 pid: 28041 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361311.106630:0:27388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361311.106640:0:27388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a86c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+8:2349:x1875232130585216:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361311.106654:0:27388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361311.106676:0:27388:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d6613769 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee7e expref: 8 pid: 28041 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.106690:0:27388:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d6613769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee7e expref: 8 pid: 28041 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.106715:0:27388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d6613769 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee7e expref: 8 pid: 28041 timeout: 801 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.106730:0:27388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361311.106735:0:27388:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361311.106743:0:27388:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 7 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.106774:0:27388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 7 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.106816:0:27388:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 7 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361311.106830:0:27388:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89853df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:27388:1875232144151424:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361311.106912:0:27388:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361311.108632:0:27388:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89853df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:27388:1875232144151424:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361311.108657:0:27388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361311.108710:0:27388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a86c4e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+7:2349:x1875232130585216:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 2071us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361311.108719:0:27388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1788361311.111539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361311.111629:0:28044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130585344 00000100:00100000:1.0:1788361311.111639:0:28044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130585344 00002000:00100000:1.0:1788361311.111685:0:28044:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x82:0x0] (0->13) req@ffff9a8a843ebb80 x1875232130585344/t0(0) o4->fb21609b-c21d-4d8e-b4fa-91803d858974@192.168.203.60@tcp:372/0 lens 504/0 e 0 to 0 dl 1788361322 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788361311.111697:0:28044:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a843ebb80 with x1875232130585344 ext(0->13) 00002000:00010000:1.0:1788361311.111703:0:28044:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a843ebb80 00000100:00100000:1.0:1788361311.111736:0:28044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361311.111746:0:28044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+7:2349:x1875232130585344:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361311.114031:0:28044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+9:2349:x1875232130585344:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 2278us (2493us total) trans 21474836483 rc 0/0 00000100:00100000:1.0:1788361311.114045:0:28044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:1.0:1788361311.114056:0:28044:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x82:0x0] (0->13) req@ffff9a8a843ebb80 x1875232130585344/t21474836483(0) o4->fb21609b-c21d-4d8e-b4fa-91803d858974@192.168.203.60@tcp:372/0 lens 504/448 e 0 to 0 dl 1788361322 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788361311.114067:0:28044:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a843ebb80 with x1875232130585344 ext(0->13) 00002000:00010000:1.0:1788361311.114082:0:28044:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a843ebb80 00000100:00100000:1.0:1788361311.124487:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361311.124838:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130585472 00000100:00100000:2.0:1788361311.124847:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130585472 00000100:00100000:2.0:1788361311.125171:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:2.0:1788361311.125189:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+26:24695:x1875232130585472:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788361311.193125:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836496 is committed 00000001:00080000:2.0:1788361311.193164:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836499 is committed 00000004:00080000:2.0:1788361311.193184:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788361311.193461:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+14:24695:x1875232130585472:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 68269us (68977us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361311.193471:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:3.0:1788361311.193619:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361311.193636:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144151552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361311.193691:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361311.193752:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144151552 00000100:00100000:3.0:1788361311.193759:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144151552 00000100:00100000:3.0:1788361311.193886:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788361311.193895:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144151552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788361311.194151:0:28038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 0 -> 14 00002000:00010000:3.0:1788361311.194164:0:28038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb mtime from disk: 0 -> 1788361311 00002000:00010000:3.0:1788361311.194166:0:28038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788361311.194168:0:28038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb ctime from disk: 1788361311 -> 1788361311 00002000:00010000:3.0:1788361311.194170:0:28038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788361311.194208:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144151552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 315us (518us total) trans 21474836484 rc 0/0 00000100:00100000:3.0:1788361311.194217:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788361311.194236:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788361311.194282:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a8926f800/2, rc 0, transno 21474836484 00000100:00100000:3.0:1788361311.194288:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144151552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361311.202901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361311.203380:0:28040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130585600 00000100:00100000:1.0:1788361311.203391:0:28040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130585600 00000100:00100000:1.0:1788361311.203505:0:28040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361311.203516:0:28040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+9:2350:x1875232130585600:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788361311.251900:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836483 is committed 00000001:00080000:2.0:1788361311.251930:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836484 is committed 00000100:00100000:0.0:1788361311.252169:0:28040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2350:x1875232130585600:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 48650us (49272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.252181:0:28040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1788361311.258752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.259204:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130585856 00000100:00100000:0.0:1788361311.259215:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130585856 00000100:00100000:0.0:1788361311.259289:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:0.0:1788361311.259300:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+14:24695:x1875232130585856:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361311.259353:0:28722:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361311.259380:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613762 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee77 expref: 14 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.259399:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361311.259403:0:28722:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361311.259431:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.259444:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.259468:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361311.259731:0:28722:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fd60f483 reply state 000000002160c9c4 transno 21474836500 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361311.259740:0:28722:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361311.259840:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+15:24695:x1875232130585856:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 541us (1096us total) trans 21474836500 rc 0/0 00000100:00100000:0.0:1788361311.259848:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00010000:00010000:3.0:1788361311.262419:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.262434:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.262440:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.262447:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361311.262451:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.262458:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.262475:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361311.262478:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361311.262483:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 2/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361311.262574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.262657:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130585984 00000100:00100000:0.0:1788361311.262676:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130585984 00000100:00100000:0.0:1788361311.262734:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1788361311.262743:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2349:x1875232130585984:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1788361311.263506:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6613777 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361311.267918:0:28038:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb size from disk: 14 -> 14 00002000:00010000:1.0:1788361311.268908:0:28038:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb mtime from disk: 1788361311 -> 1788361311 00002000:00010000:1.0:1788361311.268911:0:28038:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb atime from disk: 0 -> 1788361308 00002000:00010000:1.0:1788361311.268913:0:28038:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb ctime from disk: 1788361311 -> 1788361311 00002000:00010000:1.0:1788361311.268915:0:28038:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x82:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788361311.269369:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+7:2349:x1875232130585984:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 6617us (6788us total) trans 21474836485 rc 0/0 00000100:00100000:1.0:1788361311.269384:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1788361311.271500:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.271579:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130586240 00000100:00100000:0.0:1788361311.271591:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130586240 00000100:00100000:0.0:1788361311.271653:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:0.0:1788361311.271663:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+14:24695:x1875232130586240:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788361311.271736:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.271755:0:27403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 2/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee69 expref: 14 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.271764:0:27403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 4/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.271803:0:27403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee69 expref: 14 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.271833:0:27403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee69 expref: 14 pid: 27403 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361311.271850:0:27403:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:27403:1875232144151680:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361311.273054:0:27403:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a864770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361311.283352:0:27403:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:27403:1875232144151680:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361311.283382:0:27403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361311.285971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361311.286198:0:27389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130586368 00000100:00100000:3.0:1788361311.286207:0:27389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130586368 00010000:00010000:3.0:1788361311.286259:0:27389:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee69 expref: 15 pid: 27403 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361311.286313:0:27389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361311.286322:0:27389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+15:2350:x1875232130586368:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361311.286338:0:27389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361311.286346:0:27389:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 4/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee69 expref: 15 pid: 27403 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.286361:0:27389:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee69 expref: 15 pid: 27403 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.286390:0:27389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6613746 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee69 expref: 15 pid: 27403 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.286406:0:27389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361311.286411:0:27389:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.286420:0:27389:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.286429:0:27389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 4/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.286480:0:27389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361311.286551:0:27389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+14:2350:x1875232130586368:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 229us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361311.286559:0:27389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00010000:00010000:0.0:1788361311.286913:0:27403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.286930:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.286960:0:27403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.286967:0:27403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.286973:0:27403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.286979:0:27403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361311.286984:0:27403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.287003:0:27403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.287013:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361311.287016:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788361311.287020:0:27403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 2/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.287025:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661377e lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361311.287678:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+13:24695:x1875232130586240:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 15426us (15597us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788361311.287688:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1788361311.290137:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361311.290182:0:28204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130586496 00000100:00100000:2.0:1788361311.290192:0:28204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130586496 00000100:00100000:2.0:1788361311.290261:0:28204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:2.0:1788361311.290273:0:28204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+7:2350:x1875232130586496:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788361311.290331:0:28204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.290353:0:28204:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 7 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.290362:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361311.290367:0:28204:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361311.290372:0:28204:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.290406:0:28204:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 7 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.290421:0:28204:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 7 pid: 28204 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361311.290447:0:28204:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:28204:1875232144151808:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361311.290532:0:28204:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361311.294680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361311.294729:0:27390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130586624 00000100:00100000:1.0:1788361311.294740:0:27390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130586624 00010000:00010000:1.0:1788361311.294779:0:27390:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 8 pid: 28204 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361311.294823:0:27390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361311.294833:0:27390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+8:2349:x1875232130586624:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361311.294848:0:27390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361311.294873:0:27390:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 8 pid: 28204 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.294902:0:27390:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 8 pid: 28204 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.294933:0:27390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361311.294938:0:27390:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x82:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361311.294945:0:27390:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.294955:0:27390:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.294978:0:27390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361311.295059:0:27390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+8:2349:x1875232130586624:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 227us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361311.295067:0:27390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00010000:00010000:3.0:1788361311.295143:0:28204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6613770 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x82:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee85 expref: 7 pid: 28204 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361311.295163:0:28204:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:28204:1875232144151808:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361311.295188:0:28204:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.295204:0:28204:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.295211:0:28204:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.295240:0:28204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.295259:0:28204:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.295268:0:28204:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.295288:0:28204:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361311.295293:0:28204:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.295302:0:28204:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.295319:0:28204:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.295327:0:28204:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6613785 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 28204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361311.295390:0:28204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2350:x1875232130586496:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 5120us (5312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361311.295398:0:28204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:2.0:1788361311.299165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.299321:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130586880 00000100:00100000:0.0:1788361311.299332:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130586880 00000100:00100000:0.0:1788361311.299387:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:0.0:1788361311.299397:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+13:24695:x1875232130586880:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788361311.299481:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661378c lrc: 3/0,1 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.299501:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661378c lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.299514:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661378c lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.299791:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.299815:0:28722:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613754 lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee70 expref: 14 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.299823:0:28722:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 4/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.299860:0:28722:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613754 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee70 expref: 14 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.299875:0:28722:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613754 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee70 expref: 14 pid: 27404 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361311.299891:0:28722:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:28722:1875232144151936:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361311.300408:0:28722:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a864770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361311.305362:0:28722:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:28722:1875232144151936:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361311.305390:0:28722:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361311.311447:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361311.311633:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130587008 00000100:00100000:0.0:1788361311.311642:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130587008 00010000:00010000:0.0:1788361311.311682:0:28064:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613754 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee70 expref: 15 pid: 27404 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361311.311731:0:28064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1788361311.311740:0:28064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+15:2349:x1875232130587008:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361311.311756:0:28064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361311.311777:0:28064:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613754 lrc: 4/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee70 expref: 15 pid: 27404 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.311790:0:28064:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613754 lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee70 expref: 15 pid: 27404 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.311817:0:28064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6613754 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee70 expref: 15 pid: 27404 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.311833:0:28064:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361311.311839:0:28064:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 3/0,1 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.311847:0:28064:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.311854:0:28064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 4/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361311.311887:0:28064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361311.311945:0:28064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+14:2349:x1875232130587008:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 205us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.311952:0:28064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00010000:00010000:2.0:1788361311.312258:0:28722:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.312274:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361311.312465:0:28722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836501 00000001:00080000:2.0:1788361311.312621:0:28722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836502 00000001:00080000:2.0:1788361311.312667:0:28722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836503 00000100:00100000:2.0:1788361311.312759:0:28722:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:28722:1875232144152064:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788361311.312827:0:28722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361311.312859:0:28722:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a850813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361311.312996:0:27408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144152064 00000100:00100000:0.0:1788361311.313001:0:27408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144152064 00000100:00100000:0.0:1788361311.313037:0:27408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361311.313045:0:27408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:28722:x1875232144152064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788361311.313149:0:27408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:28722:x1875232144152064:12345-0@lo:1000:mdt00_003.0 Request processed in 104us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.313166:0:27408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361311.313238:0:28722:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836484 gen 2 00000004:00080000:1.0:1788361311.313255:0:28722:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a8926f800, transno 21474836484 00000100:00100000:1.0:1788361311.313281:0:28722:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:28722:1875232144152064:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788361311.313902:0:28722:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836504 00000100:00100000:1.0:1788361311.313956:0:28722:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89853dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:28722:1875232144152192:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788361311.313992:0:28722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361311.314013:0:28722:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05e09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361311.314035:0:27408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144152192 00000100:00100000:1.0:1788361311.314040:0:27408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144152192 00000100:00100000:1.0:1788361311.314061:0:27408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361311.314074:0:27408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:28722:x1875232144152192:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788361311.314365:0:27408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:28722:x1875232144152192:12345-0@lo:1000:mdt00_003.0 Request processed in 290us (371us total) trans 21474836486 rc 0/0 00000100:00100000:1.0:1788361311.314372:0:27408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361311.314406:0:28722:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89853dd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:28722:1875232144152192:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788361311.314436:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314444:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 2/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314450:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314456:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361311.314459:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314466:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 4/0,0 mode: EX/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314480:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361311.314483:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361311.314487:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 2/0,0 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314493:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6613793 lrc: 0/0,0 mode: --/EX res: [0x200002341:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314526:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314538:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 2/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314544:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314549:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361311.314552:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314557:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 4/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314564:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:1.0:1788361311.314567:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361311.314572:0:28722:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66136eb lrc: 2/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee54 expref: 17 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314581:0:28722:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66136eb lrc: 2/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee54 expref: 17 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314589:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66136eb lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee54 expref: 17 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.314632:0:28722:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66136eb lrc: 3/0,0 mode: CR/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee54 expref: 17 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361311.314643:0:28722:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89853dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:28722:1875232144152320:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361311.314706:0:28722:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bd240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361311.317467:0:28722:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89853dd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:28722:1875232144152320:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361311.317494:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 2/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317504:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66136e4 lrc: 0/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 27404 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317545:0:28722:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661379a lrc: 3/0,1 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317559:0:28722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661379a lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317570:0:28722:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661379a lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317580:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661379a lrc: 3/0,1 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317586:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661379a lrc: 2/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317593:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661379a lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317599:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361311.317602:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661379a lrc: 3/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317610:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661379a lrc: 4/0,0 mode: EX/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317639:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:1.0:1788361311.317642:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361311.317646:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661379a lrc: 2/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317652:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661379a lrc: 0/0,0 mode: --/EX res: [0x200002341:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317662:0:28722:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661378c lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317668:0:28722:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661378c lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317674:0:28722:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661378c lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317679:0:28722:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361311.317682:0:28722:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661378c lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317688:0:28722:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661378c lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317695:0:28722:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:1.0:1788361311.317697:0:28722:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361311.317699:0:28722:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661378c lrc: 2/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361311.317705:0:28722:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661378c lrc: 0/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 28722 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361311.317961:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24695:x1875232130586880:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 18563us (18803us total) trans 21474836505 rc 0/0 00000100:00100000:1.0:1788361311.317971:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000020:00080000:1.0:1788361311.317978:0:28722:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788361311.318185:0:27435:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1788361311.318191:0:27435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361311.318215:0:27435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 2 count 2 00000040:00080000:3.0:1788361311.318221:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:2.0:1788361311.319261:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361311.320045:0:27407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130587136 00000100:00100000:3.0:1788361311.320054:0:27407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130587136 00000100:00100000:3.0:1788361311.321107:0:27407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361311.321126:0:27407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24694:x1875232130587136:12345-192.168.203.60@tcp:49:lfs.0 00000100:00100000:3.0:1788361311.321308:0:27407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24694:x1875232130587136:12345-192.168.203.60@tcp:49:lfs.0 Request processed in 188us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361311.321335:0:27407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361311.326832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361311.326878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361311.326954:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130587648 00000100:00100000:3.0:1788361311.326965:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130587648 00000100:00100000:3.0:1788361311.327022:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:3.0:1788361311.327031:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24694:x1875232130587648:12345-192.168.203.60@tcp:58:lfs.0 00000040:00080000:3.0:1788361311.327379:0:27404:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x20:0x0].2, 136 off8464 00000100:00100000:3.0:1788361311.327455:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24694:x1875232130587648:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 424us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361311.327463:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:2.0:1788361311.327928:0:27406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130587392 00000100:00100000:2.0:1788361311.327933:0:27406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130587392 00000100:00100000:2.0:1788361311.327968:0:27406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361311.327977:0:27406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+17:24695:x1875232130587392:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788361311.328986:0:27406:0:(mdd_object.c:4016:mdd_close()) Object [0x200002341:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788361311.329129:0:27406:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 21474836506 00010000:00010000:2.0:1788361311.329180:0:27406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 3/0,1 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.329207:0:27406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.329219:0:27406:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.329229:0:27406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 4/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.329235:0:27406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 4/0,1 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.329240:0:27406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361311.329266:0:27406:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788361311.329447:0:27406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+19:24695:x1875232130587392:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1469us (2621us total) trans 21474836507 rc 0/0 00000100:00100000:2.0:1788361311.329456:0:27406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000020:00080000:2.0:1788361311.329461:0:27406:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361311.329534:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361311.329541:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.329548:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361311.329551:0:27391:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.329559:0:27391:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.329571:0:27391:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x3:0x0].0x0 (ffff9a8aa8ee1000) 00010000:00010000:3.0:1788361311.329573:0:27391:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788361311.329578:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 1/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.329583:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66137a1 lrc: 0/0,0 mode: --/PW res: [0x200002341:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 27406 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361311.329599:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361311.329608:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361311.329610:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361311.368387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361311.368467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361311.368715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361311.368742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361311.368767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361311.368874:0:28041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130587904 00000100:00100000:3.0:1788361311.368884:0:28041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130587904 00000100:00100000:3.0:1788361311.368934:0:28041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130588160 00000100:00100000:3.0:1788361311.368937:0:28041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130588160 00000100:00100000:3.0:1788361311.368957:0:28041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361311.368966:0:28041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2350:x1875232130587904:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361311.369036:0:28041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2350:x1875232130587904:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 71us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361311.369043:0:28041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361311.369057:0:28041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361311.369062:0:28041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130588160:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361311.369080:0:28041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130588160:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 19us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361311.369109:0:28041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00080000:3.0:1788361311.369124:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361311.369127:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361311.369250:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130587776 00000100:00100000:0.0:1788361311.369256:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130587776 00000100:00100000:0.0:1788361311.369291:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:0.0:1788361311.369300:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:2350:x1875232130587776:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361311.369314:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130588032 00000100:00100000:3.0:1788361311.369318:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130588032 00000100:00100000:0.0:1788361311.369333:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:2350:x1875232130587776:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361311.369342:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:3.0:1788361311.369357:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361311.369367:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130588032:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361311.369397:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130588032:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361311.369404:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00080000:3.0:1788361311.369419:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361311.370064:0:28041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130588288 00000100:00100000:3.0:1788361311.370082:0:28041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130588288 00000100:00100000:3.0:1788361311.370223:0:28041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361311.370232:0:28041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130588288:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:0.0:1788361311.370249:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361311.370417:0:28041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130588288:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 186us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361311.370423:0:28041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361311.445183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361311.445303:0:27407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130588544 00000100:00100000:3.0:1788361311.445315:0:27407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130588544 00000100:00100000:3.0:1788361311.445403:0:27407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361311.445414:0:27407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a909e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+19:24612:x1875232130588544:12345-192.168.203.60@tcp:35:multiop.0 00000100:00100000:3.0:1788361311.445803:0:27407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a909e2450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24612:x1875232130588544:12345-192.168.203.60@tcp:35:multiop.0 Request processed in 390us (626us total) trans 21474836508 rc 0/0 00000100:00100000:3.0:1788361311.445811:0:27407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00010000:00010000:0.0:1788361311.776691:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361311.904263:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144152448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361311.904343:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361311.904576:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144152448 00000100:00100000:2.0:1788361311.904582:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144152448 00000100:00100000:2.0:1788361311.904646:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788361311.904653:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144152448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361311.904671:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3848273920 00000100:00100000:2.0:1788361311.904713:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144152448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361311.904720:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361311.904751:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144152448:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788361312.352294:0:27435:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1788361312.352304:0:27435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361312.352697:0:27435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:3.0:1788361312.352705:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:3.0:1788361312.352824:0:27435:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:27435:1875232144152576:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788361312.352918:0:27435:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361312.360222:0:27435:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:27435:1875232144152576:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361312.363231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361312.363456:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130588672 00000100:00100000:3.0:1788361312.363466:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130588672 00000100:00080000:0.0:1788361312.363531:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361312.363562:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:3.0:1788361312.363573:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24834:x1875232130588672:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788361312.363617:0:27404:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200002341:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788361312.363720:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24834:x1875232130588672:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 148us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361312.363728:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:0.0:1788361312.366074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361312.366299:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130588928 00000100:00100000:3.0:1788361312.366311:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130588928 00000100:00100000:3.0:1788361312.366372:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:3.0:1788361312.366381:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+20:24834:x1875232130588928:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361312.366401:0:27405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361312.366420:0:27405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d66137a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee8c expref: -99 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361312.366521:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66137af lrc: 3/1,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361312.366535:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66137af lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361312.366549:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66137af lrc: 3/1,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361312.366559:0:27405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002341:0x2:0x0]: returning size 14 00010000:00010000:3.0:1788361312.366744:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d66137a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee8c expref: 23 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361312.366815:0:27405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66137af lrc: 3/0,0 mode: PR/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee8c expref: 22 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361312.366838:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:3.0:1788361312.366841:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361312.366844:0:27405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb200, rc 0) 00000100:00100000:3.0:1788361312.366906:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+22:24834:x1875232130588928:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 525us (842us total) trans 21474836509 rc 0/0 00000100:00100000:3.0:1788361312.366914:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:1.0:1788361312.376947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361312.377036:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130589184 00000100:00100000:0.0:1788361312.377045:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130589184 00000100:00100000:0.0:1788361312.377117:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:0.0:1788361312.377127:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+22:24834:x1875232130589184:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788361312.377213:0:27403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66137bd lrc: 3/0,1 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361312.377232:0:27403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66137bd lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361312.377253:0:27403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66137bd lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361312.378026:0:27403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66137bd lrc: 3/0,1 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361312.378036:0:27403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66137bd lrc: 2/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361312.378043:0:27403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66137bd lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361312.378050:0:27403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361312.378054:0:27403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66137bd lrc: 3/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361312.378061:0:27403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66137bd lrc: 4/0,0 mode: PW/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361312.378114:0:27403:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:1.0:1788361312.378118:0:27403:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361312.378260:0:27403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66137bd lrc: 2/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361312.378268:0:27403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66137bd lrc: 0/0,0 mode: --/PW res: [0x200002341:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 27403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361312.378574:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+23:24834:x1875232130589184:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 1445us (1633us total) trans 21474836510 rc 0/0 00000100:00100000:1.0:1788361312.378584:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000040:00080000:3.0:1788361312.378761:0:27435:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:3.0:1788361312.378766:0:27435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361312.378793:0:27435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:3.0:1788361312.378799:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1788361312.382644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361312.382746:0:27407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130589440 00000100:00100000:3.0:1788361312.382810:0:27407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130589440 00000100:00100000:3.0:1788361312.382870:0:27407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361312.382881:0:27407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+23:24834:x1875232130589440:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361312.383198:0:27407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+24:24834:x1875232130589440:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 318us (562us total) trans 21474836511 rc 0/0 00000100:00100000:3.0:1788361312.383208:0:27407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00010000:00010000:2.0:1788361312.800480:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361313.825460:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361313.952504:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361313.952527:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89853dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144152704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361313.952590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361313.952720:0:28043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144152704 00000100:00100000:3.0:1788361313.952729:0:28043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144152704 00000100:00100000:2.0:1788361313.952962:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144153216:0@lo:400:kworker.0 00000100:00100000:3.0:1788361313.952975:0:28043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361313.952987:0:28043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144152704:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361313.953000:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361313.953020:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788361313.953027:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144152832:0@lo:400:kworker.0 00002000:00000024:3.0:1788361313.953036:0:28043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361313.953056:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361313.953108:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144153344:0@lo:400:kworker.0 00000100:00100000:3.0:1788361313.953128:0:28043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144152704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361313.953136:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361313.953159:0:28043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361313.953189:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144152832 00000100:00100000:3.0:1788361313.953193:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144152832 00000100:00100000:3.0:1788361313.953237:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788361313.953245:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:3313:x1875232144152832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361313.953286:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e46014fe-639d-4b32-8855-95bba88887b0+19:3313:x1875232144152832:12345-0@lo:400:kworker.0 Request processed in 42us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361313.953292:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788361313.953319:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144153216 00000100:00100000:3.0:1788361313.953323:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144153216 00000100:00100000:3.0:1788361313.953350:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144153344 00000100:00100000:3.0:1788361313.953353:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144153344 00000100:00100000:3.0:1788361313.953375:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361313.953385:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144153216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361313.953419:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144153216:12345-0@lo:400:kworker.0 Request processed in 37us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361313.953426:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361313.953439:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361313.953445:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144153344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361313.953471:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144153344:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361313.953477:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361313.953511:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144152832:0@lo:400:kworker.0 00000100:00100000:3.0:1788361313.953527:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144153344:0@lo:400:kworker.0 00000100:00100000:3.0:1788361313.953537:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144153216:0@lo:400:kworker.0 00000100:00080000:0.0:1788361313.956614:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361313.956624:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361313.956645:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144152960:0@lo:400:kworker.0 00000100:00100000:0.0:1788361313.956708:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361313.956752:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361313.956760:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144153088:0@lo:400:kworker.0 00000100:00100000:0.0:1788361313.956784:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361313.956818:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144153088 00000100:00100000:0.0:1788361313.956824:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144153088 00000100:00100000:0.0:1788361313.956861:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361313.956870:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144153088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361313.956917:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144153088:12345-0@lo:400:kworker.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361313.956925:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361313.956945:0:28040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144152960 00000100:00100000:0.0:1788361313.956949:0:28040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144152960 00000100:00100000:0.0:1788361313.956977:0:28040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361313.956983:0:28040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144152960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361313.957028:0:28040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144152960:12345-0@lo:400:kworker.0 Request processed in 44us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361313.957034:0:28040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788361313.957049:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361313.957109:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89853dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144152704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361313.957143:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144153088:0@lo:400:kworker.0 00000100:00100000:0.0:1788361313.957152:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144152960:0@lo:400:kworker.0 00000100:00100000:0.0:1788361314.559287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361314.559493:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130589568 00000100:00100000:1.0:1788361314.559503:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130589568 00000100:00100000:1.0:1788361314.559618:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:1.0:1788361314.559627:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+24:24580:x1875232130589568:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788361314.559747:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+24:24580:x1875232130589568:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 113us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361314.559756:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00080000:0.0:1788361314.560036:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361314.563195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361314.563438:0:27407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130589824 00000100:00100000:3.0:1788361314.563449:0:27407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130589824 00000100:00100000:3.0:1788361314.563503:0:27407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361314.563513:0:27407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+24:24580:x1875232130589824:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361314.565627:0:27407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+25:24580:x1875232130589824:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 2108us (3533us total) trans 21474836512 rc 0/0 00000100:00100000:3.0:1788361314.565647:0:27407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361314.710803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361314.710982:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130589952 00000100:00100000:0.0:1788361314.710993:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130589952 00000100:00100000:0.0:1788361314.711073:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00080000:2.0:1788361314.711124:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361314.711124:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a296666d-d333-41d2-9af9-3ecf21560298+5:25151:x1875232130589952:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:0.0:1788361314.711147:0:27405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361314.711167:0:27405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66137c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ee93 expref: -99 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361314.711237:0:27405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66137cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361314.711251:0:27405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66137cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361314.711264:0:27405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66137cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361314.711449:0:27405:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361314.711454:0:27405:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 9 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361314.711551:0:27405:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66137cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 27405 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361314.711578:0:27405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66137c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee93 expref: 7 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361314.711602:0:27405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66137cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee93 expref: 6 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361314.711612:0:27405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361314.711615:0:27405:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361314.711618:0:27405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f800, rc 0) 00000100:00100000:0.0:1788361314.711682:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a296666d-d333-41d2-9af9-3ecf21560298+6:25151:x1875232130589952:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 600us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361314.711689:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00010000:00010000:3.0:1788361314.848260:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361315.872447:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361316.488341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361316.488382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361316.488406:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361316.488421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361316.488435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361316.488452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361316.488473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361316.488497:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130590336 00000100:00100000:2.0:1788361316.488505:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130590336 00000100:00100000:2.0:1788361316.488549:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130590848 00000100:00100000:2.0:1788361316.488552:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130590848 00000100:00100000:2.0:1788361316.488565:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130590464 00000100:00100000:2.0:1788361316.488568:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130590464 00000100:00100000:2.0:1788361316.488580:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130590720 00000100:00100000:2.0:1788361316.488582:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130590720 00000100:00100000:2.0:1788361316.488598:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361316.488607:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2350:x1875232130590336:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361316.488676:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+6:2350:x1875232130590336:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 70us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361316.488683:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361316.488711:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361316.488718:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130590848:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361316.488745:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986360e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130590848:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361316.488750:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361316.488760:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361316.488765:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2350:x1875232130590464:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361316.488784:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986363800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2350:x1875232130590464:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 19us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361316.488790:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361316.488802:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361316.488807:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130590720:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361316.488829:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a296666d-d333-41d2-9af9-3ecf21560298+5:2350:x1875232130590720:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 22us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361316.488835:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361316.488853:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130590592 00000100:00100000:2.0:1788361316.488857:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130590592 00000100:00100000:2.0:1788361316.488883:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130590208 00000100:00100000:2.0:1788361316.488886:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130590208 00000100:00100000:2.0:1788361316.488906:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:2.0:1788361316.488911:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a296666d-d333-41d2-9af9-3ecf21560298+6:2350:x1875232130590592:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361316.488937:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a296666d-d333-41d2-9af9-3ecf21560298+6:2350:x1875232130590592:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361316.488944:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:2.0:1788361316.488964:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788361316.488970:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+25:2350:x1875232130590208:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361316.488998:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb21609b-c21d-4d8e-b4fa-91803d858974+25:2350:x1875232130590208:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361316.489004:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00080000:2.0:1788361316.489033:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361316.489037:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361316.489038:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361316.489344:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130590080 00000100:00100000:3.0:1788361316.489349:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130590080 00000100:00100000:3.0:1788361316.489443:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:3.0:1788361316.489451:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:2350:x1875232130590080:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361316.489494:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:2350:x1875232130590080:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 44us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361316.489500:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000001:00080000:1.0:1788361316.561850:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836485 is committed 00000001:00080000:1.0:1788361316.561864:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 21474836486 is committed 00000001:00080000:3.0:1788361316.569470:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836501 is committed 00000001:00080000:3.0:1788361316.569963:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836510 is committed 00000020:00080000:3.0:1788361316.569973:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8ac05e0900 refcount 2 committed 0 result 0 batchid 17179869275 00000020:00080000:3.0:1788361316.569979:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8abeb94200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ac05e0e40 00000020:00080000:3.0:1788361316.569983:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8abeb94d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8987268000 00000001:00080000:3.0:1788361316.570017:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836512 is committed 00000020:00080000:2.0:1788361316.570136:0:27441:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 17179869275 committed batchid 12884902008 00000020:00080000:2.0:1788361316.570367:0:27441:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 12884902008 00000001:02000400:1.0:1788361316.742044:0:29633:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 2b: Test multi remote open when creating ========================================================== 11:01:56 (1788361316) 00010000:00010000:2.0:1788361316.901509:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361317.026825:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144153472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361317.026904:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361317.027252:0:28043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144153472 00000100:00100000:2.0:1788361317.027261:0:28043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144153472 00000100:00100000:2.0:1788361317.027330:0:28043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361317.027340:0:28043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144153472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361317.027376:0:28043:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361317.027435:0:28043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144153472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361317.027442:0:28043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788361317.027711:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361317.027940:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 2 00000004:00080000:3.0:1788361317.027948:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 21474836486 committed transno 21474836486 00000100:00100000:3.0:1788361317.027977:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144153472:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1788361317.682423:0:29683:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_2b Need 2 or more clients, have 1 00010000:00010000:3.0:1788361317.921049:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361318.560301:0:27435:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1788361318.560309:0:27435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361318.560348:0:27435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:1.0:1788361318.560354:0:27435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000001:02000400:1.0:1788361318.745429:0:29732:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 2c: Test multi open on different mount points when creating ========================================================== 11:01:58 (1788361318) 00010000:00010000:3.0:1788361318.944279:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361319.072914:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144153600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361319.072979:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361319.073051:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144153600 00000100:00100000:2.0:1788361319.073059:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144153600 00000100:00100000:2.0:1788361319.073122:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361319.073132:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144153600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361319.073163:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361319.073219:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144153600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361319.073239:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361319.073284:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144153600:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788361319.073453:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361319.073525:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144153728:0@lo:400:kworker.0 00000100:00100000:0.0:1788361319.073558:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361319.073581:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144154240:0@lo:400:kworker.0 00000100:00100000:0.0:1788361319.073604:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361319.073622:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361319.073627:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144153856:0@lo:400:kworker.0 00000100:00100000:0.0:1788361319.073648:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361319.073676:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144153728 00000100:00100000:0.0:1788361319.073681:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144153728 00000100:00100000:0.0:1788361319.073712:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788361319.073726:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+19:3313:x1875232144153728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361319.073761:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+19:3313:x1875232144153728:12345-0@lo:400:kworker.0 Request processed in 36us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361319.073768:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788361319.073793:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144154240 00000100:00100000:0.0:1788361319.073797:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144154240 00000100:00100000:0.0:1788361319.073826:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788361319.073832:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144154240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361319.073935:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144154240:12345-0@lo:400:kworker.0 Request processed in 103us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361319.074018:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788361319.074040:0:28038:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144153856 00000100:00100000:0.0:1788361319.074045:0:28038:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144153856 00000100:00100000:0.0:1788361319.074071:0:28038:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361319.074077:0:28038:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144153856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361319.074125:0:28038:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144153856:12345-0@lo:400:kworker.0 Request processed in 47us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361319.074133:0:28038:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361319.074415:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144153984:0@lo:400:kworker.0 00000100:00100000:1.0:1788361319.074446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361319.074469:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361319.074474:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144154112:0@lo:400:kworker.0 00000100:00100000:1.0:1788361319.074495:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361319.074539:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144153856:0@lo:400:kworker.0 00000100:00100000:1.0:1788361319.074549:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144153728:0@lo:400:kworker.0 00000100:00100000:1.0:1788361319.074558:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144154240:0@lo:400:kworker.0 00000100:00080000:1.0:1788361319.074584:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361319.074589:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361319.074706:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144153984 00000100:00100000:2.0:1788361319.074711:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144153984 00000100:00100000:2.0:1788361319.074746:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144154112 00000100:00100000:2.0:1788361319.074749:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144154112 00000100:00100000:2.0:1788361319.074777:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788361319.074783:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144153984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361319.074820:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144153984:12345-0@lo:400:kworker.0 Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361319.074826:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788361319.075001:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788361319.075009:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144154112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361319.075043:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144154112:12345-0@lo:400:kworker.0 Request processed in 35us (547us total) trans 0 rc 0/0 00000100:00080000:1.0:1788361319.077430:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361319.077485:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144154112:0@lo:400:kworker.0 00000100:00100000:1.0:1788361319.077498:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144153984:0@lo:400:kworker.0 00000100:00100000:2.0:1788361319.081218:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788361319.970574:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361320.992643:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361321.019159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361321.019246:0:27407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130591104 00000100:00100000:3.0:1788361321.019257:0:27407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130591104 00000100:00100000:3.0:1788361321.019339:0:27407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361321.019350:0:27407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+12:25664:x1875232130591104:12345-192.168.203.60@tcp:35:umount.0 00000100:00080000:1.0:1788361321.020288:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361321.021057:0:27407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+13:25664:x1875232130591104:12345-192.168.203.60@tcp:35:umount.0 Request processed in 1703us (1899us total) trans 21474836513 rc 0/0 00000100:00100000:3.0:1788361321.021067:0:27407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361321.034170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361321.034225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361321.034335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361321.036199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361321.039551:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130591232 00000100:00100000:0.0:1788361321.039566:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130591232 00000100:00100000:0.0:1788361321.039634:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130591488 00000100:00100000:0.0:1788361321.039638:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130591488 00000100:00100000:0.0:1788361321.039652:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130591360 00000100:00100000:0.0:1788361321.039655:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130591360 00000100:00100000:0.0:1788361321.039675:0:28064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788361321.039684:0:28064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c239de-6813-4ac6-9906-15c9b6340eeb+15:2349:x1875232130591232:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361321.039713:0:28064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361321.039732:0:28064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965a00/0xf6a94c97d6613467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed04 expref: 15 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361321.039749:0:28064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361321.040007:0:27388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361321.040017:0:27388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c239de-6813-4ac6-9906-15c9b6340eeb+14:2349:x1875232130591488:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361321.040025:0:27388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361321.040035:0:27388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8200/0xf6a94c97d6613651 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee23 expref: 14 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361321.040055:0:27388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361321.040074:0:27388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c239de-6813-4ac6-9906-15c9b6340eeb+13:2349:x1875232130591488:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 59us (5848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361321.040081:0:27388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361321.040132:0:27388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361321.040139:0:27388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:2349:x1875232130591360:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361321.040146:0:27388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361321.040154:0:27388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8e00/0xf6a94c97d6613491 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed2e expref: 12 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361321.040163:0:27388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361321.040192:0:27388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:2349:x1875232130591360:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 54us (5857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361321.040198:0:27388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1788361321.040373:0:28040:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130591616 00000100:00100000:1.0:1788361321.040378:0:28040:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130591616 00000100:00100000:1.0:1788361321.040420:0:28040:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788361321.040428:0:28040:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2348:x1875232130591616:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:1.0:1788361321.040452:0:28040:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66134ad 00000100:00080000:1.0:1788361321.040465:0:28040:0:(import.c:65:import_set_state_nolock()) ffff9a8a8986d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361321.040513:0:28040:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836481 00000100:00100000:1.0:1788361321.040733:0:28040:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb21609b-c21d-4d8e-b4fa-91803d858974+2:2348:x1875232130591616:12345-192.168.203.60@tcp:9:umount.0 Request processed in 305us (4540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361321.040739:0:28040:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00080000:1.0:1788361321.040755:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788361321.041031:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361321.041109:0:28064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:2349:x1875232130591232:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1424us (6948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361321.041116:0:28064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1788361321.054423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361321.055281:0:28041:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130591744 00000100:00100000:2.0:1788361321.055293:0:28041:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130591744 00000100:00100000:2.0:1788361321.055365:0:28041:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788361321.055377:0:28041:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+5:2348:x1875232130591744:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:2.0:1788361321.055409:0:28041:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66134a6 00000100:00080000:2.0:1788361321.055428:0:28041:0:(import.c:65:import_set_state_nolock()) ffff9a8a856ed000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788361321.055980:0:28041:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836486 00000100:00100000:2.0:1788361321.056321:0:28041:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+2:2348:x1875232130591744:12345-192.168.203.60@tcp:9:umount.0 Request processed in 945us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361321.056344:0:28041:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00080000:1.0:1788361321.056410:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788361321.057554:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361321.064413:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361321.064623:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130592512 00000100:00100000:2.0:1788361321.064634:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130592512 00000100:00100000:2.0:1788361321.064724:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:2.0:1788361321.064735:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+13:2348:x1875232130592512:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:2.0:1788361321.064767:0:27405:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661349f 00000020:00010000:2.0:1788361321.064785:0:27405:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a856ed800: total 0 00000100:00080000:2.0:1788361321.064789:0:27405:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e48800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788361321.064832:0:27405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836513 00000100:00100000:2.0:1788361321.065242:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb21609b-c21d-4d8e-b4fa-91803d858974+12:2348:x1875232130592512:12345-192.168.203.60@tcp:39:umount.0 Request processed in 508us (838us total) trans 21474836514 rc 0/0 00000100:00100000:2.0:1788361321.065251:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000020:00010000:0.0:1788361321.065796:0:29425:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a856ed800: total 0 00010000:00010000:0.0:1788361321.065895:0:29425:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a856ed800, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1788361321.065928:0:29425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:0.0:1788361321.065932:0:29425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361321.065940:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6613532 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edcf expref: 11 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361321.065966:0:29425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788361321.065969:0:29425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361321.065973:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66137af lrc: 0/0,0 mode: --/PR res: [0x200002341:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee8c expref: 10 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361321.065985:0:29425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361321.065987:0:29425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361321.065991:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661356a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eddd expref: 9 pid: 27403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361321.066002:0:29425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a983f4400) 00010000:00010000:0.0:1788361321.066004:0:29425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361321.066021:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613516 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86edc8 expref: 8 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361321.066039:0:29425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361321.066041:0:29425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361321.066045:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d66135e1 lrc: 0/0,0 mode: --/CR res: [0x200002341:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee07 expref: 7 pid: 27404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361321.066057:0:29425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361321.066060:0:29425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788361321.066063:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6613586 lrc: 0/0,0 mode: --/PR res: [0x200002341:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ede4 expref: 6 pid: 28722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361321.066077:0:29425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002341:0x2:0x0].0x0 (ffff9a8aa8ee1a00) 00010000:00010000:0.0:1788361321.066079:0:29425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361321.066082:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66136eb lrc: 0/0,0 mode: --/CR res: [0x200002341:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee54 expref: 5 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361321.066143:0:29425:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a856ed800, canceled 7 locks, left on hash table 0. 00010000:00010000:0.0:1788361321.066156:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361321.066158:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361321.066160:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361321.615586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361321.616339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361321.616423:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361321.616612:0:28204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130592768 00000100:00100000:0.0:1788361321.616622:0:28204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130592768 00000100:00100000:0.0:1788361321.616683:0:28204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130592896 00000100:00100000:0.0:1788361321.616687:0:28204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130592896 00000100:00100000:0.0:1788361321.616714:0:28204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361321.616723:0:28204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a296666d-d333-41d2-9af9-3ecf21560298+5:2348:x1875232130592768:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1788361321.616774:0:28204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66134de 00000100:00080000:0.0:1788361321.616783:0:28204:0:(import.c:65:import_set_state_nolock()) ffff9a8a8986c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361321.616819:0:28204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836486 00000100:00100000:0.0:1788361321.617003:0:28204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a296666d-d333-41d2-9af9-3ecf21560298+2:2348:x1875232130592768:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 280us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361321.617011:0:28204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361321.617027:0:28204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788361321.617034:0:28204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a296666d-d333-41d2-9af9-3ecf21560298+5:2348:x1875232130592896:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1788361321.617048:0:28204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66134e5 00000100:00080000:0.0:1788361321.617053:0:28204:0:(import.c:65:import_set_state_nolock()) ffff9a8ac1c6a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361321.617072:0:28204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836481 00000100:00100000:0.0:1788361321.617213:0:28204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a296666d-d333-41d2-9af9-3ecf21560298+2:2348:x1875232130592896:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 179us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361321.617220:0:28204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00010000:00010000:0.0:1788361321.617243:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361321.617338:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361321.617347:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361321.617352:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361321.617368:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130592640 00000100:00100000:2.0:1788361321.617374:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130592640 00000100:00100000:2.0:1788361321.617475:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1788361321.617484:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a296666d-d333-41d2-9af9-3ecf21560298+6:2349:x1875232130592640:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361321.617519:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a296666d-d333-41d2-9af9-3ecf21560298+6:2349:x1875232130592640:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 36us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361321.617526:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00080000:1.0:1788361321.617914:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:3.0:1788361321.669584:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fb21609b-c21d-4d8e-b4fa-91803d858974 00000001:00080000:3.0:1788361321.669602:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836514 is committed 00000020:00080000:3.0:1788361321.669609:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 17179869275 batchid updated 00000020:00000080:3.0:1788361321.669629:0:5819:0:(genops.c:906:class_export_put()) final put ffff9a8a856ed800/fb21609b-c21d-4d8e-b4fa-91803d858974 00000020:00080000:2.0:1788361321.669687:0:27441:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869275 00000020:00080000:2.0:1788361321.669697:0:27441:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869275 00000001:00100000:1.0:1788361321.669820:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a296666d-d333-41d2-9af9-3ecf21560298 00000020:00000080:1.0:1788361321.669824:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8a89868800/a296666d-d333-41d2-9af9-3ecf21560298 00000020:00000080:0.0:1788361321.669973:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a856ed800/fb21609b-c21d-4d8e-b4fa-91803d858974 for lustre-MDT0000 00000020:00000080:0.0:1788361321.670032:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83e48800 for lustre-MDT0000 00000001:00100000:1.0:1788361321.670343:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb21609b-c21d-4d8e-b4fa-91803d858974 00000020:00000080:1.0:1788361321.670347:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8a856eb800/fb21609b-c21d-4d8e-b4fa-91803d858974 00000020:00000080:3.0:1788361321.670368:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a89868800/a296666d-d333-41d2-9af9-3ecf21560298 for lustre-OST0000 00000020:00000080:3.0:1788361321.670400:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8986c800 for lustre-OST0000 00000020:00000080:0.0:1788361321.670586:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a856eb800/fb21609b-c21d-4d8e-b4fa-91803d858974 for lustre-OST0000 00000020:00000080:0.0:1788361321.670668:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a856ed000 for lustre-OST0000 00010000:00010000:3.0:1788361322.016291:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361322.064539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361322.064582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361322.064669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361322.064826:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130593024 00000100:00100000:3.0:1788361322.064837:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130593024 00000100:00100000:3.0:1788361322.064896:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130593152 00000100:00100000:3.0:1788361322.064899:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130593152 00000100:00100000:3.0:1788361322.064912:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130593280 00000100:00100000:3.0:1788361322.064915:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130593280 00000100:00100000:3.0:1788361322.064930:0:28064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361322.064939:0:28064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a86c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c239de-6813-4ac6-9906-15c9b6340eeb+12:2351:x1875232130593024:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361322.064954:0:28064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361322.064972:0:28064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965800/0xf6a94c97d66134c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed66 expref: 12 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361322.065004:0:28064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361322.065053:0:28064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a86c4c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c239de-6813-4ac6-9906-15c9b6340eeb+11:2351:x1875232130593024:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 114us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361322.065061:0:28064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361322.065112:0:27388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361322.065124:0:27388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c239de-6813-4ac6-9906-15c9b6340eeb+10:2352:x1875232130593152:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361322.065135:0:27388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361322.065146:0:27388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e600/0xf6a94c97d661364a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee1c expref: 10 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361322.065155:0:28064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:1.0:1788361322.065158:0:27388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361322.065165:0:28064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c239de-6813-4ac6-9906-15c9b6340eeb+9:2352:x1875232130593280:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361322.065187:0:28064:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788361322.065194:0:27388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d1c239de-6813-4ac6-9906-15c9b6340eeb+9:2352:x1875232130593152:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 73us (611us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361322.065200:0:28064:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964000/0xf6a94c97d66134c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ed90 expref: 9 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361322.065207:0:27388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:3.0:1788361322.065217:0:28064:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361322.065239:0:28064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d1c239de-6813-4ac6-9906-15c9b6340eeb+7:2352:x1875232130593280:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 76us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361322.065246:0:28064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361322.070555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361322.070630:0:27403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130593536 00000100:00100000:1.0:1788361322.070640:0:27403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130593536 00000100:00100000:1.0:1788361322.070707:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1788361322.070717:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a296666d-d333-41d2-9af9-3ecf21560298+6:2348:x1875232130593536:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:1.0:1788361322.070771:0:27403:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66134d7 00000020:00010000:1.0:1788361322.070781:0:27403:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8ac0c06000: total 0 00000100:00080000:1.0:1788361322.070785:0:27403:0:(import.c:65:import_set_state_nolock()) ffff9a8ac0c04800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788361322.070815:0:27403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836514 00000020:00010000:0.0:1788361322.071117:0:29425:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8ac0c06000: total 0 00010000:00010000:0.0:1788361322.071166:0:29425:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8ac0c06000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788361322.071213:0:29425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361322.071217:0:29425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361322.071232:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d66137cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ee93 expref: 7 pid: 27405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361322.071258:0:29425:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8ac0c06000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788361322.071270:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361322.071272:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361322.071275:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361322.071316:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a296666d-d333-41d2-9af9-3ecf21560298+3:2348:x1875232130593536:12345-192.168.203.60@tcp:39:umount.0 Request processed in 598us (771us total) trans 21474836515 rc 0/0 00000100:00100000:1.0:1788361322.071325:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1788361322.079835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361322.079911:0:27398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130593792 00000100:00100000:2.0:1788361322.079920:0:27398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130593792 00000100:00100000:2.0:1788361322.079961:0:27398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:2.0:1788361322.079969:0:27398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+7:2348:x1875232130593792:12345-192.168.203.60@tcp:251:umount.0 00000020:00000080:2.0:1788361322.080021:0:27398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613405 00000020:00010000:2.0:1788361322.080029:0:27398:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8ab77b1000: total 0 00000100:00080000:2.0:1788361322.080032:0:27398:0:(import.c:65:import_set_state_nolock()) ffff9a8ab77b0000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788361322.080127:0:27398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d1c239de-6813-4ac6-9906-15c9b6340eeb+3:2348:x1875232130593792:12345-192.168.203.60@tcp:251:umount.0 Request processed in 158us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361322.080134:0:27398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000020:00010000:3.0:1788361322.080257:0:29424:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8ab77b1000: total 0 00010000:00010000:3.0:1788361322.080309:0:29424:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8ab77b1000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788361322.080346:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b9200/0xf6a94c97d6613428 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ecfd expref: 2 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361322.080359:0:29424:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8ab77b1000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788361322.080368:0:29424:0:(genops.c:906:class_export_put()) final put ffff9a8ab77b1000/d1c239de-6813-4ac6-9906-15c9b6340eeb 00010000:00010000:3.0:1788361322.080384:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361322.080386:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361322.080387:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788361322.080478:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab77b1000/d1c239de-6813-4ac6-9906-15c9b6340eeb for MGS 00000020:00000080:0.0:1788361322.080514:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ab77b0000 for MGS 00000100:00100000:0.0:1788361322.145300:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144154368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361322.145370:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361322.146298:0:28042:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144154368 00000100:00100000:3.0:1788361322.146321:0:28042:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144154368 00000100:00100000:3.0:1788361322.146401:0:28042:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361322.146413:0:28042:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144154368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361322.146466:0:28042:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00080000:2.0:1788361322.146599:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361322.150907:0:28042:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144154368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4485us (5524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361322.150921:0:28042:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788361322.151265:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144154368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361323.040331:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361323.339870:0:29928:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788361323.349345:0:29928:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788361323.349394:0:29928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.349408:0:29928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.349415:0:29928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.349421:0:29928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.349520:0:29928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788361323.349525:0:29928:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788361323.349547:0:29928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361323.349552:0:29928:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788361323.349558:0:29928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788361323.349581:0:29928:0:(import.c:65:import_set_state_nolock()) ffff9a898534c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788361323.349653:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144154496:0@lo:39:umount.0 00000100:00100000:0.0:1788361323.349719:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361323.349823:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361323.349830:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361323.349838:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361323.349841:0:27391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361323.349851:0:27391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361323.349859:0:27391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361323.349865:0:27391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361323.349868:0:27391:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788361323.349871:0:27391:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1788361323.349876:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144154496 00000100:00100000:2.0:1788361323.349883:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144154496 00010000:00010000:3.0:1788361323.349897:0:27391:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361323.349905:0:27391:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788361323.349934:0:28722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1788361323.349936:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361323.349946:0:28722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232144154496:12345-0@lo:39:umount.0 00010000:00010000:3.0:1788361323.349960:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9200/0xf6a94c97d6613181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613188 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361323.349973:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361323.349975:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361323.349977:0:28722:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66131b2 00010000:00010000:3.0:1788361323.349978:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361323.349987:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1788361323.349988:0:28722:0:(import.c:65:import_set_state_nolock()) ffff9a8a84a41000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788361323.350003:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e46014fe-639d-4b32-8855-95bba88887b0:3312:1875232144154624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361323.350043:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361323.350126:0:27388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144154624 00000100:00100000:3.0:1788361323.350130:0:27388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144154624 00000100:00100000:3.0:1788361323.350240:0:27388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361323.350248:0:27388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e46014fe-639d-4b32-8855-95bba88887b0+19:3312:x1875232144154624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361323.350259:0:27388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361323.350273:0:27388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965200/0xf6a94c97d6613188 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613181 expref: 19 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361323.350284:0:27388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361323.350314:0:27388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e46014fe-639d-4b32-8855-95bba88887b0+18:3312:x1875232144154624:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361323.350321:0:27388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361323.350395:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e46014fe-639d-4b32-8855-95bba88887b0:3312:1875232144154624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361323.350478:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361323.350698:0:28722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1875232144154496:12345-0@lo:39:umount.0 Request processed in 752us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361323.350707:0:28722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000020:00000080:2.0:1788361323.350716:0:28722:0:(genops.c:906:class_export_put()) final put ffff9a8a83cfa000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:3.0:1788361323.350737:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a898534c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788361323.350781:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144154496:0@lo:39:umount.0 00000020:00000080:0.0:1788361323.350824:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83cfa000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788361323.350876:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a84a41000 for lustre-MDT0000 00000100:00080000:1.0:1788361323.350906:0:29928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361323.350910:0:29928:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788361323.350914:0:29928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788361323.352125:0:29928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352141:0:29928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352148:0:29928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352155:0:29928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352184:0:29928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361323.352190:0:29928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352196:0:29928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352203:0:29928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352209:0:29928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352288:0:29928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361323.352296:0:29928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352314:0:29928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352320:0:29928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.352326:0:29928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352389:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788361323.352397:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352405:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361323.352408:0:27392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352416:0:27392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361323.352433:0:27392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361323.352446:0:27392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361323.352448:0:27392:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788361323.352473:0:27392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352480:0:27392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788361323.352537:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e46014fe-639d-4b32-8855-95bba88887b0:3312:1875232144154752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361323.352591:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361323.352647:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352655:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f200/0xf6a94c97d66130e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66130ee expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352668:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361323.352671:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352677:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361323.352680:0:27392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352688:0:27392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361323.352693:0:27392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361323.352698:0:27392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361323.352700:0:27392:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788361323.352702:0:27392:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788361323.352723:0:27392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352729:0:27392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361323.352746:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352753:0:27392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8987622400/0xf6a94c97d661338e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613395 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352765:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361323.352768:0:27392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352773:0:27392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361323.352776:0:27392:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352782:0:27392:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361323.352789:0:27392:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361323.352794:0:27392:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788361323.352796:0:27392:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788361323.352806:0:27392:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352812:0:27392:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361323.352818:0:27392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.352834:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361323.352835:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361323.352837:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361323.352851:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144154880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361323.352877:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361323.352895:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361323.352901:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144155008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361323.352918:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361323.352945:0:27389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144154752 00000100:00100000:2.0:1788361323.352951:0:27389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144154752 00000100:00100000:2.0:1788361323.352984:0:27389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144154880 00000100:00100000:2.0:1788361323.352987:0:27389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144154880 00000100:00100000:2.0:1788361323.352998:0:27389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144155008 00000100:00100000:2.0:1788361323.353000:0:27389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144155008 00000100:00100000:2.0:1788361323.353013:0:27389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788361323.353020:0:27389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+20:3312:x1875232144154752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361323.353029:0:27389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361323.353041:0:27389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8abeac8e00/0xf6a94c97d66130ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66130e7 expref: 20 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.353052:0:27389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361323.353113:0:29928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788361323.353118:0:29928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613619 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613620 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361323.353128:0:29928:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788361323.353134:0:29928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.353142:0:29928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.353148:0:29928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.353155:0:29928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361323.353182:0:29928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788361323.353185:0:29928:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788361323.353187:0:29928:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788361323.353212:0:29928:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788361323.353215:0:29928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788361323.353219:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361323.353224:0:29928:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1788361323.353229:0:29928:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a89864bb000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361323.353234:0:29928:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a8a8986a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361323.353241:0:29928:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9a8ac0c06000 a296666d-d333-41d2-9af9-3ecf21560298 192.168.203.60@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361323.353246:0:29928:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9a8985c60000) has exports, disconnecting them 00000020:00080000:1.0:1788361323.353249:0:29928:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a89864bb000), last request at 1788361319 00000020:00000080:1.0:1788361323.353255:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613380 00000100:00080000:1.0:1788361323.353271:0:29928:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c3000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788361323.353312:0:29928:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a89864bb000): rc 0 00000020:00000080:1.0:1788361323.353314:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a89864bb000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788361323.353324:0:29928:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a8a8986a800), last request at 1788361319 00000020:00000080:1.0:1788361323.353327:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613237 00000100:00080000:1.0:1788361323.353332:0:29928:0:(import.c:65:import_set_state_nolock()) ffff9a8a89868000 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788361323.353342:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89864bb000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788361323.353383:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ac05c3000 for lustre-MDT0000 00000020:00080000:1.0:1788361323.353395:0:29928:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a8986a800): rc 0 00000020:00000080:1.0:1788361323.353397:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8a8986a800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788361323.353406:0:29928:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa998c1d1fae0 00000020:00000080:1.0:1788361323.353416:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8986a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788361323.353436:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a89868000 for lustre-MDT0000 00000100:00080000:1.0:1788361323.353455:0:29928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361323.353458:0:29928:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 3 00000004:00080000:1.0:1788361323.353470:0:29928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788361323.353530:0:29928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788361323.353542:0:29928:0:(import.c:65:import_set_state_nolock()) ffff9a89852f3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788361323.353559:0:29928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361323.353562:0:29928:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 3 00000004:00080000:1.0:1788361323.353569:0:29928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788361323.353628:0:29928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788361323.353637:0:29928:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788361323.353659:0:29928:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a8985c60000) has no exports 00010000:00010000:3.0:1788361323.353778:0:29424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361323.353789:0:29424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361323.353796:0:29424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361323.353799:0:29424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361323.353806:0:29424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361323.353812:0:29424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361323.353818:0:29424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361323.353821:0:29424:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788361323.353822:0:29424:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788361323.353839:0:29424:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361323.353846:0:29424:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788361323.353932:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144155392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361323.353966:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361323.354044:0:27389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+19:3312:x1875232144154752:12345-0@lo:103:ldlm_bl.0 Request processed in 1022us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361323.354052:0:27389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788361323.354068:0:27389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144155392 00000100:00100000:2.0:1788361323.354073:0:27389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144155392 00000100:00100000:2.0:1788361323.354116:0:27389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361323.354129:0:27389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+19:3313:x1875232144154880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361323.354138:0:27389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361323.354147:0:27389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573f000/0xf6a94c97d6613395 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661338e expref: 19 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.354158:0:27389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361323.354200:0:27389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+18:3313:x1875232144154880:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361323.354206:0:27389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361323.354219:0:27389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361323.354225:0:27389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+17:3313:x1875232144155008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361323.354232:0:27389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361323.354240:0:27389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964c00/0xf6a94c97d6613620 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613619 expref: 17 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.354248:0:27389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361323.354267:0:27389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+16:3313:x1875232144155008:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361323.354273:0:27389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361323.354283:0:27389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361323.354288:0:27389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a86c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+15:3311:x1875232144155392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361323.354295:0:27389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361323.354302:0:27389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8abeac8200/0xf6a94c97d66130e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66130d9 expref: 15 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361323.354312:0:27389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361323.354335:0:27389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a86c4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e46014fe-639d-4b32-8855-95bba88887b0+14:3311:x1875232144155392:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361323.354349:0:27389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361323.354549:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986362680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144155008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361323.354559:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144154880:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361323.354742:0:29424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361323.354751:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f400/0xf6a94c97d66130d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66130e0 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361323.354765:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361323.354767:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361323.354768:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361323.354775:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361323.354780:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361323.354802:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144155136:0@lo:9:umount.0 00000100:00100000:3.0:1788361323.354834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361323.354857:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144155264:0@lo:9:umount.0 00000100:00100000:3.0:1788361323.354877:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361323.354903:0:28204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144155136 00000100:00100000:3.0:1788361323.354908:0:28204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144155136 00000100:00100000:3.0:1788361323.354933:0:28204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144155264 00000100:00100000:3.0:1788361323.354937:0:28204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144155264 00000100:00100000:3.0:1788361323.354965:0:28204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361323.354972:0:28204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144155136:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788361323.354991:0:28204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613253 00000100:00080000:3.0:1788361323.354998:0:28204:0:(import.c:65:import_set_state_nolock()) ffff9a8ac1c6d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361323.355029:0:28204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474836486 00000100:00100000:3.0:1788361323.355356:0:28204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144155136:12345-0@lo:9:umount.0 Request processed in 383us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361323.355363:0:28204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361323.355376:0:28204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788361323.355383:0:28204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144155264:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788361323.355393:0:28204:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661339c 00000100:00080000:3.0:1788361323.355399:0:28204:0:(import.c:65:import_set_state_nolock()) ffff9a8ab77b3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361323.355417:0:28204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 5, last_transno is 21474836481 00000100:00100000:3.0:1788361323.355585:0:28204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144155264:12345-0@lo:9:umount.0 Request processed in 202us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361323.355593:0:28204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788361323.355615:0:27399:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788361323.355625:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361323.355644:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89852f3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361323.355655:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361323.355664:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361323.355668:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144155136:0@lo:9:umount.0 00000100:00080000:3.0:1788361323.355680:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a129000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788361323.355688:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788361323.355690:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361323.355692:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144155264:0@lo:9:umount.0 00010000:00010000:3.0:1788361323.355716:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361323.355741:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361323.355763:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144155392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361323.355975:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e46014fe-639d-4b32-8855-95bba88887b0:3312:1875232144154752:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788361323.365497:0:29928:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a8985c60000) has no exports 00000020:00000080:1.0:1788361323.414866:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613134 00000020:00000080:1.0:1788361323.414945:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8985b8d000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788361323.414996:0:29928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788361323.415071:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361323.415081:0:29928:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788361323.415108:0:29928:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9a8a90bf19c0) has no exports 00000020:00000080:0.0:1788361323.415399:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661312d 00000020:00000080:0.0:1788361323.415404:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8a9efdc000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361323.415514:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8985b8d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788361323.415621:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361323.415628:0:29928:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788361323.415632:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8a8a12b000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788361323.415646:0:29928:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a12b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788361323.415654:0:29928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788361323.415757:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efdc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788361324.064383:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361324.192369:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144155776:0@lo:400:kworker.0 00000100:00100000:2.0:1788361324.192438:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361324.192496:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361324.192503:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144155648:0@lo:400:kworker.0 00000100:00100000:2.0:1788361324.192531:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361324.192565:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144155776 00000100:00100000:2.0:1788361324.192571:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144155776 00000100:00100000:2.0:1788361324.192608:0:27405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144155648 00000100:00100000:2.0:1788361324.192611:0:27405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144155648 00000100:00100000:0.0:1788361324.192689:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788361324.192698:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1875232144155776:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788361324.192706:0:27404:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361324.192757:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3314:x1875232144155776:12345-0@lo:400:kworker.0 Request processed in 57us (318us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788361324.192765:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788361324.192789:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361324.192799:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144155520:0@lo:400:kworker.0 00000100:00100000:2.0:1788361324.192814:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788361324.192820:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1875232144155648:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788361324.192826:0:27405:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788361324.192845:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361324.192870:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3314:x1875232144155648:12345-0@lo:400:kworker.0 Request processed in 47us (337us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361324.192878:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788361324.192892:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788361324.192896:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a108800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788361324.192899:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788361324.193335:0:27395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144155520 00000100:00100000:1.0:1788361324.193341:0:27395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144155520 00000100:00100000:1.0:1788361324.193376:0:27395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788361324.193385:0:27395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+14:3311:x1875232144155520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361324.193429:0:27395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e46014fe-639d-4b32-8855-95bba88887b0+14:3311:x1875232144155520:12345-0@lo:400:kworker.0 Request processed in 46us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361324.193436:0:27395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788361324.193763:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e46014fe-639d-4b32-8855-95bba88887b0:3311:1875232144155520:0@lo:400:kworker.0 00000100:00080000:0.0:1788361324.201537:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a108800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361324.201550:0:3314:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 674 00000100:00080000:0.0:1788361324.201560:0:3314:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8a8a108800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361324.201604:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a84640000 x1875232144155904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361324.201637:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144155648:0@lo:400:kworker.0 00000100:00080000:0.0:1788361324.201675:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788361324.201679:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9a898718d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788361324.201682:0:3314:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788361324.201687:0:3314:0:(import.c:65:import_set_state_nolock()) ffff9a898718d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361324.201705:0:3314:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 683 00000100:00080000:0.0:1788361324.201723:0:3314:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a898718d800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361324.201740:0:3314:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a84641500 x1875232144156032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361324.201751:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144155776:0@lo:400:kworker.0 00000100:00100000:3.0:1788361324.201916:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144155904:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788361324.201986:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361324.202020:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144156032:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788361324.202027:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144155904 00000100:00100000:3.0:1788361324.202048:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361324.202056:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144155904 00000100:00100000:0.0:1788361324.202133:0:27404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144156032 00000100:00100000:0.0:1788361324.202137:0:27404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144156032 00000100:00100000:0.0:1788361324.202174:0:27404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788361324.202181:0:27404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144155904:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788361324.202192:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788361324.202199:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144156032:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788361324.202208:0:27404:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:3.0:1788361324.202220:0:27405:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788361324.202274:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144156032:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 74us (226us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361324.202284:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788361324.202316:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a898718d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361324.202389:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361324.202394:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144156032:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788361324.209329:0:27404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144155904:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 7138us (7334us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361324.209344:0:27404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788361324.209362:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a108800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361324.209370:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788361324.209375:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84640000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144155904:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:1.0:1788361324.236560:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a296666d-d333-41d2-9af9-3ecf21560298 00000020:00000080:1.0:1788361324.236568:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a8986e000/a296666d-d333-41d2-9af9-3ecf21560298 00000001:00100000:2.0:1788361324.236574:0:28727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb21609b-c21d-4d8e-b4fa-91803d858974 00000020:00000080:2.0:1788361324.236577:0:28727:0:(genops.c:906:class_export_put()) final put ffff9a8a8986f800/fb21609b-c21d-4d8e-b4fa-91803d858974 00000001:00100000:2.0:1788361324.236600:0:28727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361324.236603:0:28727:0:(genops.c:906:class_export_put()) final put ffff9a8ab77b2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361324.237353:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8986f800/fb21609b-c21d-4d8e-b4fa-91803d858974 for lustre-OST0001 00000020:00000080:3.0:1788361324.237535:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8986e000/a296666d-d333-41d2-9af9-3ecf21560298 for lustre-OST0001 00000020:00000080:3.0:1788361324.237630:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab77b2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788361324.237762:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8986d000 for lustre-OST0001 00000020:00000080:3.0:1788361324.237769:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ac1c6a800 for lustre-OST0001 00000020:00000080:3.0:1788361324.237773:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ab77b3800 for lustre-OST0001 00010000:00010000:3.0:1788361325.088928:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361326.112472:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788361326.788982:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361326.788992:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6e000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788361326.789769:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a296666d-d333-41d2-9af9-3ecf21560298 00000001:00080000:2.0:1788361326.789783:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 21474836515 is committed 00000020:00000080:2.0:1788361326.789787:0:5819:0:(genops.c:906:class_export_put()) final put ffff9a8ac0c06000/a296666d-d333-41d2-9af9-3ecf21560298 00000020:00000080:3.0:1788361326.789802:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788361326.792470:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac0c06000/a296666d-d333-41d2-9af9-3ecf21560298 for lustre-MDT0000 00000020:00000080:2.0:1788361326.792538:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ac1c6d800 for lustre-OST0000 00000020:00000080:2.0:1788361326.792544:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ac0c04800 for lustre-MDT0000 00010000:00010000:3.0:1788361327.136263:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361328.160268:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361329.184330:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788361329.312329:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361329.312334:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361329.312338:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a108800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361329.312344:0:15670:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 714 00000100:00080000:2.0:1788361329.312349:0:15670:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788361329.312354:0:15670:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8a8a108800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361329.312370:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a898514c380 x1875232144156288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361329.312388:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788361329.312391:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788361329.312392:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a898718d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361329.312394:0:15670:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 714 00000100:00080000:2.0:1788361329.312396:0:15670:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788361329.312399:0:15670:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a898718d800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361329.312405:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a898514ed80 x1875232144156416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361329.312454:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361329.312485:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e46014fe-639d-4b32-8855-95bba88887b0:3312:1875232144156160:0@lo:400:kworker.0 00000100:00100000:1.0:1788361329.312575:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361329.312602:0:27397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144156160 00000100:00100000:0.0:1788361329.312611:0:27397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144156160 00000100:00100000:0.0:1788361329.312668:0:27397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788361329.312677:0:27397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+14:3312:x1875232144156160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361329.312731:0:27397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e46014fe-639d-4b32-8855-95bba88887b0+14:3312:x1875232144156160:12345-0@lo:400:kworker.0 Request processed in 54us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361329.312739:0:27397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788361329.312787:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e46014fe-639d-4b32-8855-95bba88887b0:3312:1875232144156160:0@lo:400:kworker.0 00000100:00100000:3.0:1788361329.313319:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144156288:0@lo:38:kworker.0 00000100:00100000:3.0:1788361329.313361:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361329.313385:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144156416:0@lo:38:kworker.0 00000100:00100000:3.0:1788361329.313410:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361329.313623:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144156288 00000100:00100000:1.0:1788361329.313627:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144156288 00000100:00100000:1.0:1788361329.313772:0:28722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144156416 00000100:00100000:1.0:1788361329.313777:0:28722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144156416 00000100:00100000:2.0:1788361329.313837:0:27403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788361329.313846:0:27403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144156288:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788361329.313862:0:27403:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788361329.313905:0:27405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788361329.313912:0:27405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144156416:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788361329.313914:0:27404:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00010000:02000000:3.0:1788361329.313922:0:27405:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788361329.313924:0:27404:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788361329.313965:0:27405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144156416:12345-0@lo:38:kworker.0 Request processed in 52us (554us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788361329.313974:0:27405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788361329.314005:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a898718d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361329.314010:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361329.314014:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144156416:0@lo:38:kworker.0 00000100:00100000:2.0:1788361329.323290:0:27403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144156288:12345-0@lo:38:kworker.0 Request processed in 9438us (9922us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361329.323303:0:27403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788361329.323405:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a108800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361329.323412:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361329.323417:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144156288:0@lo:38:kworker.0 00000020:01000000:1.0:1788361329.505700:0:29928:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8ab732ba80 - data ffff9a8ab04fa438/ffff9a8a86246400 00000020:01000000:1.0:1788361329.505820:0:29928:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8ab6cddba0 - data ffff9a8ab53b4798/ffff9a8a9f492400 00000001:00000004:1.0:1788361329.512645:0:29928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 5, last_transno is 21474836515 00000100:00080000:1.0:1788361329.580800:0:29928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788361329.580809:0:29928:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 4 00000004:00080000:1.0:1788361329.580828:0:29928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361329.580831:0:29928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788361329.581164:0:27425:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788361329.581179:0:27425:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1c:0x0] index 2 count 1 00000040:00080000:2.0:1788361329.581189:0:27425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 5 count 2 00000100:00080000:1.0:1788361329.582249:0:29928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788361329.582254:0:29928:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 4 00000004:00080000:1.0:1788361329.582270:0:29928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361329.582272:0:29928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788361329.583195:0:27427:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788361329.583200:0:27427:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x1e:0x0] index 1 count 1 00000040:00080000:2.0:1788361329.583209:0:27427:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 5 count 2 00000020:00000080:2.0:1788361329.642447:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66130fc 00000020:00000080:2.0:1788361329.642460:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fb8800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788361329.643525:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613111 00000020:00000080:2.0:1788361329.643533:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fb9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361329.643578:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fb8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788361329.644269:0:29928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788361329.644276:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361329.644285:0:29928:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788361329.644289:0:29928:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9a8985c619c0) has no exports 00000004:01000000:2.0:1788361329.644499:0:29928:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788361329.644509:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661315e 00000020:00000080:2.0:1788361329.644514:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c69000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788361329.644518:0:29928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788361329.644522:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361329.644526:0:29928:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788361329.644529:0:29928:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9a8ab7463380) has no exports 00000020:00000080:2.0:1788361329.644534:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613157 00000020:00000080:2.0:1788361329.644537:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8a9835a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788361329.644722:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fb9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1788361329.644735:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c69000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788361329.644743:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9835a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788361329.645078:0:29928:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788361329.645082:0:29928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788361329.645111:0:29928:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 21474836481 gen 5 00000004:00080000:2.0:1788361329.645127:0:29928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788361329.645130:0:29928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788361329.645170:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361329.645176:0:29928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361329.645183:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613149 00000020:00000080:2.0:1788361329.645187:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8a9efda000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788361329.645191:0:29928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788361329.645193:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361329.645207:0:29928:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788361329.645209:0:29928:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9a8a90bf3380) has no exports 00000020:00000080:2.0:1788361329.645213:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613142 00000020:00000080:2.0:1788361329.645215:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a89852f0800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788361329.645519:0:29928:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788361329.645522:0:29928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788361329.645524:0:29928:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474836486 gen 5 00000004:00080000:2.0:1788361329.645528:0:29928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788361329.645529:0:29928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788361329.645551:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361329.645555:0:29928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361329.645580:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361329.645583:0:29928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361329.645587:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8abead8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788361329.645589:0:29928:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abead8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788361329.645595:0:29928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361329.645760:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a129000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788361329.645767:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a8a9efdf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361329.645770:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efdf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788361329.645777:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361329.645852:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efda000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788361329.645859:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89852f0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361329.645864:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89852f3000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788361329.645868:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a8a9efda800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361329.645870:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efda800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788361329.645874:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361329.646044:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613118 00000020:00000080:2.0:1788361329.646050:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fb9800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788361329.646059:0:29928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788361329.646063:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361329.646161:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fb9800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788361329.646205:0:29928:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788361329.646207:0:29928:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9a8985c63380) has no exports 00000020:00000080:2.0:1788361329.646224:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361329.646227:0:29928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788361329.646230:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fb8000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788361329.646233:0:29928:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fb8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788361329.646237:0:29928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788361329.646335:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661311f 00000020:00000080:2.0:1788361329.646341:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fbf000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788361329.646362:0:29928:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8987bd6000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788361329.646366:0:29928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8987bd6000 3 00000020:01000004:2.0:1788361329.646370:0:29928:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8987bd6000 from lustre-MDT0000 00000020:00000080:2.0:1788361329.646404:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361329.646408:0:29928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788361329.646411:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8ab6fbc000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788361329.646413:0:29928:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fbc000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788361329.646420:0:29928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788361329.646442:0:29928:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788361329.646445:0:29928:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788361329.646449:0:29928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788361329.646452:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361329.646454:0:29928:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788361329.646462:0:29928:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9a8986fe4000 e46014fe-639d-4b32-8855-95bba88887b0 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361329.646489:0:29928:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9a8985c64d40) has exports, disconnecting them 00000020:00080000:2.0:1788361329.646494:0:29928:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a8986fe4000), last request at 1788361275 00000020:00000080:2.0:1788361329.646511:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66130bd 00000020:00010000:2.0:1788361329.646515:0:29928:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8986fe4000: total 1 00000100:00080000:2.0:1788361329.646518:0:29928:0:(import.c:65:import_set_state_nolock()) ffff9a8986fe0800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788361329.646586:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab6fbf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:2.0:1788361329.646623:0:29928:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8986fe4000): rc 0 00000020:00080000:2.0:1788361329.646628:0:29928:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9a8985c64d40) has no exports 00000100:00100000:1.0:1788361329.646778:0:27398:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a8a85753800:27398] 2 exiting: rc = 0 00000100:00100000:1.0:1788361329.646880:0:27395:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a8a88388800:27395] 0 exiting: rc = 1 00000100:00100000:0.0:1788361329.647238:0:27397:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a8a85752000:27397] 1 exiting: rc = 0 00000020:00010000:3.0:1788361329.647247:0:29424:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8986fe4000: total 0 00010000:00010000:3.0:1788361329.647254:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361329.647287:0:29424:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8986fe4000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788361329.647318:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b9c00/0xf6a94c97d6613222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661321b expref: 9 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361329.647338:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b9600/0xf6a94c97d6613341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661333a expref: 8 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361329.647353:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964800/0xf6a94c97d66130d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66130cb expref: 7 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361329.647367:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987623800/0xf6a94c97d661336b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613364 expref: 6 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361329.647387:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965600/0xf6a94c97d66131ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66131e3 expref: 5 pid: 27398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361329.647401:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964400/0xf6a94c97d6613604 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66135fd expref: 4 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361329.647410:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987622c00/0xf6a94c97d6613612 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661360b expref: 3 pid: 27397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361329.647484:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8400/0xf6a94c97d66131f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66131f1 expref: 2 pid: 27395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361329.647497:0:29424:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8986fe4000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788361329.647511:0:29424:0:(genops.c:906:class_export_put()) final put ffff9a8986fe4000/e46014fe-639d-4b32-8855-95bba88887b0 00010000:00010000:3.0:1788361329.647524:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361329.647527:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361329.647528:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788361329.647598:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8986fe4000/e46014fe-639d-4b32-8855-95bba88887b0 for MGS 00000020:00000080:3.0:1788361329.647702:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8986fe0800 for MGS 00000100:00100000:2.0:1788361329.647744:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647753:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647759:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647770:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647776:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647782:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647788:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647793:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647800:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647805:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647811:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647816:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647822:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647828:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647834:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647849:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647854:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647860:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647865:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647870:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647876:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647882:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647890:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647898:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647907:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647914:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647921:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647929:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647936:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647943:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647950:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647956:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647963:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647970:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647977:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647984:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.647991:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648007:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648018:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648025:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648035:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648045:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648051:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648057:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648062:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648067:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648072:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648077:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648083:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648106:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648128:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648136:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648142:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648147:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648152:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648158:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648163:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648168:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648174:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648321:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648334:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648343:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648351:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.648357:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788361329.648919:0:29928:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788361329.648923:0:29928:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788361329.649775:0:29928:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a90bfaba0 - data ffff9a8ab53501b0/ffff9a8986783400 00000020:01000000:2.0:1788361329.649941:0:29928:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a90bfe3c0 - data ffff9a8ab531f948/ffff9a8a860ecc00 00000020:00000080:2.0:1788361329.650574:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66130a8 00000020:00000080:2.0:1788361329.650581:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8abf240800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788361329.650601:0:29928:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8987bd6000 from MGS, refs=2 00000020:01000004:2.0:1788361329.650605:0:29928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8987bd6000 2 00000020:01000004:2.0:1788361329.650608:0:29928:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8987bd6000 from MGS 00000020:00000080:2.0:1788361329.650630:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361329.650786:0:29928:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788361329.650787:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abf240800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788361329.650790:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8a8370d800/MGS 00000020:00000080:2.0:1788361329.650794:0:29928:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8370d800/MGS for MGS 00000020:01000000:2.0:1788361329.650802:0:29928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788361329.650860:0:29928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788361329.650864:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361329.650869:0:29928:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788361329.650878:0:29928:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a898534a000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361329.650883:0:29928:0:(genops.c:1574:class_disconnect_exports()) OBD device 10 (ffff9a8984a5cd40) has exports, disconnecting them 00000020:00080000:2.0:1788361329.650896:0:29928:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a898534a000), last request at 1788361276 00000020:00000080:2.0:1788361329.650901:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613196 00000020:00080000:2.0:1788361329.650912:0:29928:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a898534a000): rc 0 00000020:00000080:2.0:1788361329.650917:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a898534a000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788361329.651008:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a898534a000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788361329.653178:0:29928:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788361329.653187:0:29928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361329.653191:0:29928:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788361329.653197:0:29928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361329.653335:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361329.653343:0:29928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788361329.653350:0:29928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8987bd6000 1 00000020:00000080:3.0:1788361329.653366:0:29928:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661309a 00000020:00000080:3.0:1788361329.653372:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8a8370c000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788361329.653377:0:29928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788361329.653382:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361329.653385:0:29928:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361329.653388:0:29928:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9a8a84f14d40) has no exports 00000020:00000080:1.0:1788361329.653677:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a898534c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788361329.653684:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a8abead9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788361329.653686:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abead9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788361329.653693:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788361329.653749:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8370c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361329.680535:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361329.680561:0:29928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788361329.680567:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8987bd7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361329.680571:0:29928:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8987bd7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788361329.680584:0:29928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788361329.680837:0:29928:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8987bd3800 00000020:01000000:1.0:1788361329.680861:0:29928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788361329.680866:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361329.680871:0:29928:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788361329.680874:0:29928:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9a8a90bf0000) has no exports 00000100:00100000:1.0:1788361329.680960:0:27405:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a8abeab6e00:27405] 2 exiting: rc = 0 00000100:00100000:2.0:1788361329.681155:0:28722:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a8ab7e02c00:28722] 3 exiting: rc = 0 00000100:00100000:2.0:1788361329.681207:0:27403:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a8abeab6a00:27403] 0 exiting: rc = 1 00000100:00100000:0.0:1788361329.684236:0:27404:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a8abeab6200:27404] 1 exiting: rc = 0 00000100:00100000:2.0:1788361329.684299:0:29934:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9a8a84ee6a00:29934] 4 exiting: rc = 0 00000100:00100000:1.0:1788361329.687629:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687645:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687653:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687663:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687682:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687702:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687713:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687722:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687734:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687746:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687757:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687769:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687782:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687795:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687806:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687816:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687827:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687840:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687852:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687864:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687875:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687888:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687899:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687907:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687934:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687954:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687962:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687967:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687973:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687978:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687983:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687989:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.687995:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688002:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688010:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688019:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688036:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688045:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688059:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688074:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688106:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688128:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688139:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688149:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688157:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688165:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688176:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688186:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688197:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688209:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688219:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688226:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688235:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688242:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688248:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688257:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688270:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688279:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688285:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688304:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688309:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688315:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688321:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.688327:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361329.699756:0:27407:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a8a8826ac00:27407] 1 exiting: rc = 0 00000100:00100000:2.0:1788361329.699975:0:27406:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a8abeab6800:27406] 0 exiting: rc = 1 00000100:00100000:1.0:1788361329.700081:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700133:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700142:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700149:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700156:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700165:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700175:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700184:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700194:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700200:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700209:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700215:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700220:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700226:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700232:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700238:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700454:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700465:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700470:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700477:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700483:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700488:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700494:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700786:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700798:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700805:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700812:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700819:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700826:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700833:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700853:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700860:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700867:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700874:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700881:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700887:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700894:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700900:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700906:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700913:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700922:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700929:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700936:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700944:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700951:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700962:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700971:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700978:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700987:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.700993:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701002:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701006:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701012:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701016:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701021:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701025:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701030:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701036:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701256:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701267:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701272:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701277:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701282:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.701287:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361329.702951:0:27408:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a8abcbcdc00:27408] 0 exiting: rc = 1 00000100:00100000:2.0:1788361329.703029:0:27409:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a8a99440600:27409] 1 exiting: rc = 0 00000100:00100000:1.0:1788361329.703525:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703543:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703593:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703602:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703608:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703615:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703621:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703628:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703655:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703663:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703671:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703679:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703685:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703692:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703698:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703704:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703711:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703716:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703722:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703728:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703750:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703756:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703762:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703768:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703773:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703779:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703784:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703790:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703797:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703804:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703809:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703817:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703838:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703845:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703850:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.703855:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704493:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704502:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704509:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704515:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704522:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704527:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704532:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704538:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704560:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704566:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704572:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704577:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704583:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704589:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704595:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704601:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704607:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704613:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704618:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704623:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704644:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704651:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704656:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704663:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704669:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704674:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704681:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361329.704687:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361329.720613:0:27411:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a8aae401c00:27411] 1 exiting: rc = 0 00000100:00100000:0.0:1788361329.720743:0:27410:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a8aae400400:27410] 0 exiting: rc = 1 00000100:00100000:2.0:1788361329.720828:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720836:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720841:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720846:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720851:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720856:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720861:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720865:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720871:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720876:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720882:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720886:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720891:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720896:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720901:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720905:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720910:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720914:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720919:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720924:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720929:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720934:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720939:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720945:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720962:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720967:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720973:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720978:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720983:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720987:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720992:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.720997:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721001:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721006:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721010:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721016:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721021:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721026:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721031:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721036:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721042:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721047:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721052:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721056:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721060:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721066:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721071:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721075:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721080:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721206:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721213:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721218:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721223:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721227:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721232:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721237:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721242:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721247:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721252:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721263:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721268:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721272:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721277:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721281:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361329.721776:0:27412:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a8aae400800:27412] 0 exiting: rc = 1 00000100:00100000:1.0:1788361329.721856:0:27413:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a8aae401e00:27413] 1 exiting: rc = 0 00000100:00100000:2.0:1788361329.721954:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721960:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721965:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721969:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721973:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721978:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721982:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721987:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721992:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.721996:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722002:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722006:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722010:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722015:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722019:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722024:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722029:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722033:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722038:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722043:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722048:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722053:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722058:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722063:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722068:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722073:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722079:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722364:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722371:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722376:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722503:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722508:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722513:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722518:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722523:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722529:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722534:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722539:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722544:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722549:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722554:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722558:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722563:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722567:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722571:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722576:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722580:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722584:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722588:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722593:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722598:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722602:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722607:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722611:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722617:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722622:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722627:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722632:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722637:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722642:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722647:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722652:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722656:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.722661:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361329.723284:0:27414:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a8a85e99800:27414] 0 exiting: rc = 1 00000100:00100000:1.0:1788361329.723370:0:27415:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a8a85e99400:27415] 1 exiting: rc = 0 00000100:00100000:2.0:1788361329.723510:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723525:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723530:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723535:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723540:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723545:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723551:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723556:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723562:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723566:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723572:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723577:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723581:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723587:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723592:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723597:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723602:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723607:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723612:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723617:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723622:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723627:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723632:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723637:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723642:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723647:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723652:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723657:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723662:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723667:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723672:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723676:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723682:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723686:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723691:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723696:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723709:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723714:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723719:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723723:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723728:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723733:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723739:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723744:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723749:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723754:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723759:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723764:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723769:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723775:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723779:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723784:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723789:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723794:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723799:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723804:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723810:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723815:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723819:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723823:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723828:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723833:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723838:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.723843:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361329.724381:0:27416:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a8a85e98a00:27416] 0 exiting: rc = 1 00000100:00100000:1.0:1788361329.724625:0:27417:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a8a85e98000:27417] 1 exiting: rc = 0 00000100:00100000:1.0:1788361329.724764:0:27418:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a8a85e98200:27418] 2 exiting: rc = 0 00000100:00100000:2.0:1788361329.724864:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724873:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724879:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724885:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724891:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724896:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724902:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724918:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724925:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724930:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724937:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724942:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724948:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724953:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724959:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724964:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724970:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724976:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724982:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724987:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724993:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.724998:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725004:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725009:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725014:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725035:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725042:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725047:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725052:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725058:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725063:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725069:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725074:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725079:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725268:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725276:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725283:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725288:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725294:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725299:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725305:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725310:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725324:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725329:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725335:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725340:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725346:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725351:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725357:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725376:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725456:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725464:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725470:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725476:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725481:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725486:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725492:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725498:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725504:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725510:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725515:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725520:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725525:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361329.725531:0:29928:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788361329.729694:0:29928:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361329.729707:0:29928:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788361329.729712:0:29928:0:(genops.c:906:class_export_put()) final put ffff9a8abeadb800/MDS_uuid 00000020:00000080:2.0:1788361329.729717:0:29928:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abeadb800/MDS_uuid for MDS 00000020:01000000:2.0:1788361329.729727:0:29928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788361329.729832:0:29928:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788361330.208210:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361331.232730:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361331.519645:0:30084:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788361331.537597:0:30084:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788361331.537655:0:30084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.537670:0:30084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.537678:0:30084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.537684:0:30084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.537704:0:30084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788361331.537709:0:30084:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788361331.537729:0:30084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361331.537734:0:30084:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788361331.537739:0:30084:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788361331.537745:0:30084:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a108800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788361331.537749:0:30084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361331.537750:0:30084:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788361331.537753:0:30084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788361331.540079:0:29425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361331.540188:0:29425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540201:0:29425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361331.540205:0:29425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540215:0:29425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361331.540222:0:29425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361331.540229:0:29425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361331.540232:0:29425:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788361331.540236:0:29425:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788361331.540390:0:30084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.540401:0:30084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.540409:0:30084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.540431:0:30084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.540448:0:30084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361331.540454:0:30084:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.540461:0:30084:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.540468:0:30084:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.540474:0:30084:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540496:0:29425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540505:0:29425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361331.540530:0:29425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540544:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8abeac8000/0xf6a94c97d661321b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613222 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361331.540546:0:30084:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361331.540559:0:29425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:1.0:1788361331.540560:0:30084:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1788361331.540565:0:29425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540573:0:29425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9a00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361331.540577:0:29425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788361331.540583:0:30084:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00010000:00010000:3.0:1788361331.540586:0:29425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1788361331.540588:0:30084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788361331.540594:0:30084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:00010000:3.0:1788361331.540596:0:29425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788361331.540600:0:30084:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:01000000:3.0:1788361331.540606:0:29425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00080000:1.0:1788361331.540606:0:30084:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a8ab74619c0) has no exports 10000000:01000000:3.0:1788361331.540612:0:29425:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788361331.540615:0:29425:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788361331.540632:0:29425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540639:0:29425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1788361331.540639:0:30084:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a8ab74619c0) has no exports 00010000:00010000:3.0:1788361331.540660:0:29425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540668:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9a00/0xf6a94c97d66131f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66131f8 expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540688:0:29425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361331.540692:0:29425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540698:0:29425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361331.540701:0:29425:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540707:0:29425:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361331.540713:0:29425:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361331.540718:0:29425:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788361331.540720:0:29425:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788361331.540722:0:29425:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788361331.540736:0:29425:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540742:0:29425:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361331.540748:0:29425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540754:0:29425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661360b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613612 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361331.540762:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361331.540764:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788361331.542950:0:30084:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a856554e0 - data ffff9a8ab52a70d8/ffff9a8986510000 00010000:00010000:2.0:1788361331.543039:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361331.543069:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361331.543080:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144156672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361331.543129:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e46014fe-639d-4b32-8855-95bba88887b0:3312:1875232144156544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361331.543181:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361331.543205:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e46014fe-639d-4b32-8855-95bba88887b0:3314:1875232144156800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361331.543263:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361331.543360:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144156544 00000100:00100000:3.0:1788361331.543368:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144156544 00000020:01000000:1.0:1788361331.543378:0:30084:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8ac1ce7360 - data ffff9a8abda571b0/ffff9a8985c2f400 00000100:00100000:3.0:1788361331.543414:0:28064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361331.543423:0:28064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3312:x1875232144156544:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788361331.543430:0:28064:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361331 with bad export cookie 17773821619414839485 00000100:00100000:2.0:1788361331.543623:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361331.543654:0:27390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144156672 00000100:00100000:2.0:1788361331.543658:0:27390:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144156672 00000100:00100000:2.0:1788361331.543676:0:27390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361331.543691:0:27390:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3313:x1875232144156672:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788361331.543696:0:27390:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361331 with bad export cookie 17773821619414839485 00000100:00100000:2.0:1788361331.543736:0:27390:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3313:x1875232144156672:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (113us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788361331.543742:0:27390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788361331.543770:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788361331.543774:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9a8987bd6800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788361331.543778:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:0.0:1788361331.545943:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361331.554031:0:28064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3312:x1875232144156544:12345-0@lo:103:ldlm_bl.0 Request processed in 10602us (10762us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361331.554044:0:28064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361331.554074:0:28064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144156800 00000100:00100000:3.0:1788361331.554081:0:28064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144156800 00000100:00100000:3.0:1788361331.554151:0:28064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788361331.554157:0:28064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3314:x1875232144156800:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788361331.554163:0:28064:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361331 with bad export cookie 17773821619414839485 00000100:00100000:3.0:1788361331.554193:0:28064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3314:x1875232144156800:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (8258us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361331.554199:0:28064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788361331.555486:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788361331.555794:0:3314:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788361331.566638:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.160@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788361331.566643:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788361331.566654:0:3313:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a8926f800 x1875232144156672/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361347 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361331.566667:0:3313:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a8926ca80 x1875232144156544/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361347 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361331.566678:0:3313:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a8926c000 x1875232144156800/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361347 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361331.566727:0:3314:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a8987bd6800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788361331.566760:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e46014fe-639d-4b32-8855-95bba88887b0:3314:1875232144156800:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788361331.566800:0:3312:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9a8987bd6800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788361331.566808:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e46014fe-639d-4b32-8855-95bba88887b0:3312:1875232144156544:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788361331.566842:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788361331.566845:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788361331.566846:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788361331.566905:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9a8987bd6800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361331.566910:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 665 00000100:00080000:2.0:1788361331.566919:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a8987bd6800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361331.566947:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a898514c000 x1875232144156928/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361331.566976:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e46014fe-639d-4b32-8855-95bba88887b0:3313:1875232144156672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361331.567015:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e46014fe-639d-4b32-8855-95bba88887b0:3310:1875232144156928:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788361331.567073:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875232144156928 offset 0 length 520: 4 00100000:10000000:1.0:1788361331.573206:0:30084:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788361331.591057:0:30084:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613206 00000020:00000080:2.0:1788361331.591066:0:30084:0:(genops.c:906:class_export_put()) final put ffff9a8985b8c800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788361331.591373:0:30084:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8ac05c4000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788361331.591378:0:30084:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8ac05c4000 2 00000020:01000004:2.0:1788361331.591381:0:30084:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8ac05c4000 from lustre-OST0000 00000020:00000080:2.0:1788361331.591411:0:30084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361331.591420:0:30084:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788361331.591423:0:30084:0:(genops.c:906:class_export_put()) final put ffff9a8a83e4a800/lustre-OST0000_UUID 00000020:00000080:2.0:1788361331.591427:0:30084:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e4a800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788361331.591433:0:30084:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788361331.591474:0:30084:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788361331.591479:0:30084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788361331.591483:0:30084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361331.591487:0:30084:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788361331.591495:0:30084:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a8a8a10d800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361331.591500:0:30084:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9a8984a599c0) has exports, disconnecting them 00000020:00080000:2.0:1788361331.591505:0:30084:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a8a8a10d800), last request at 1788361284 00000020:00000080:2.0:1788361331.591509:0:30084:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613230 00000020:00080000:2.0:1788361331.591519:0:30084:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a8a10d800): rc 0 00000020:00000080:2.0:1788361331.591524:0:30084:0:(genops.c:906:class_export_put()) final put ffff9a8a8a10d800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788361331.591562:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8985b8c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788361331.594768:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a10d800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788361331.596142:0:30084:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788361331.596147:0:30084:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361331.596151:0:30084:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788361331.596158:0:30084:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361331.596269:0:30084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361331.596277:0:30084:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788361331.596294:0:30084:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8ac05c4000 1 00000020:00000080:3.0:1788361331.596300:0:30084:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66131d5 00000020:00000080:3.0:1788361331.596308:0:30084:0:(genops.c:906:class_export_put()) final put ffff9a8ac05c2800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788361331.596313:0:30084:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788361331.596317:0:30084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361331.596321:0:30084:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361331.596325:0:30084:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a8984a5b380) has no exports 00000020:00000080:1.0:1788361331.597007:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a108800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788361331.597015:0:36:0:(genops.c:906:class_export_put()) final put ffff9a8a8986a000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788361331.597019:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8986a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788361331.597025:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788361331.597080:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac05c2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788361331.608813:0:30084:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361331.608827:0:30084:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788361331.608833:0:30084:0:(genops.c:906:class_export_put()) final put ffff9a8ac05c6800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788361331.608837:0:30084:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac05c6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788361331.608852:0:30084:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788361331.608984:0:30084:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8ac05c0000 00000020:02000400:1.0:1788361331.609022:0:30084:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788361332.256622:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361333.283930:0:27392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788361333.362155:0:30234:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788361333.375428:0:30234:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788361333.375504:0:30234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.375521:0:30234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.375529:0:30234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.375535:0:30234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.375562:0:30234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788361333.375568:0:30234:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788361333.375592:0:30234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361333.375606:0:30234:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788361333.375611:0:30234:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788361333.375617:0:30234:0:(import.c:65:import_set_state_nolock()) ffff9a898718d800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788361333.375621:0:30234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361333.375623:0:30234:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788361333.375626:0:30234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788361333.375691:0:29424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361333.375699:0:29424:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361333.375708:0:29424:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361333.375712:0:29424:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361333.375721:0:29424:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361333.375729:0:29424:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361333.375735:0:29424:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788361333.375737:0:29424:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788361333.375740:0:29424:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788361333.375752:0:29424:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8987bd6800 00010000:00010000:3.0:1788361333.375756:0:29424:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361333.375762:0:29424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fe00/0xf6a94c97d6613364 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d661336b expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361333.375785:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361333.375787:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361333.375789:0:29424:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361333.376746:0:30234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.376760:0:30234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.376766:0:30234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.376772:0:30234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.376795:0:30234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361333.376802:0:30234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.376809:0:30234:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.376814:0:30234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.376820:0:30234:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361333.376856:0:30234:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788361333.376861:0:30234:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788361333.376879:0:30234:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788361333.376883:0:30234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788361333.376888:0:30234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361333.376894:0:30234:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788361333.376897:0:30234:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a8a90bf4d40) has no exports 00000020:00080000:0.0:1788361333.376922:0:30234:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a8a90bf4d40) has no exports 00010000:00010000:1.0:1788361333.376924:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361333.376932:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361333.376940:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361333.376943:0:27391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361333.376951:0:27391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361333.376958:0:27391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361333.376973:0:27391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361333.376975:0:27391:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788361333.376978:0:27391:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788361333.376987:0:27391:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8987bd6800 00010000:00010000:1.0:1788361333.376991:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361333.376997:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985964600/0xf6a94c97d661333a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613341 expref: -99 pid: 28709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361333.377009:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361333.377012:0:27391:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361333.377018:0:27391:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622e00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361333.377021:0:27391:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361333.377027:0:27391:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361333.377033:0:27391:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361333.377038:0:27391:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788361333.377040:0:27391:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788361333.377042:0:27391:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788361333.377046:0:27391:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8987bd6800 00010000:00010000:1.0:1788361333.377049:0:27391:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361333.377062:0:27391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8987622e00/0xf6a94c97d66135fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613604 expref: -99 pid: 27400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361333.377074:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361333.377076:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361333.377078:0:27391:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361333.378290:0:29425:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788361333.383498:0:30234:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a86606120 - data ffff9a8ab52546c0/ffff9a8abd1dcc00 00000020:01000000:0.0:1788361333.383646:0:30234:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a90bfa360 - data ffff9a8ab52651b0/ffff9a89853ab000 00100000:10000000:0.0:1788361333.396461:0:30234:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788361333.424248:0:30234:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661334f 00000020:00000080:1.0:1788361333.424257:0:30234:0:(genops.c:906:class_export_put()) final put ffff9a8ab77b4800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788361333.424277:0:30234:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a8a109000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788361333.424281:0:30234:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8a109000 2 00000020:01000004:1.0:1788361333.424284:0:30234:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8a8a109000 from lustre-OST0001 00000020:00000080:1.0:1788361333.424309:0:30234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361333.424319:0:30234:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788361333.424322:0:30234:0:(genops.c:906:class_export_put()) final put ffff9a8aae465800/lustre-OST0001_UUID 00000020:00000080:1.0:1788361333.424325:0:30234:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae465800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788361333.424331:0:30234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1788361333.424470:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ab77b4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:1.0:1788361333.424668:0:30234:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e46014fe-639d-4b32-8855-95bba88887b0->MGS 00010000:00010000:1.0:1788361333.424689:0:30234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9000/0xf6a94c97d66131e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66131ea expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361333.424758:0:30234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9000/0xf6a94c97d66131e3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66131ea expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361333.424766:0:30234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788361333.424769:0:30234:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788361333.424772:0:30234:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788361333.424787:0:30234:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8987bd6800 00010000:00010000:1.0:1788361333.424791:0:30234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8abeac9000/0xf6a94c97d66131e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d66131ea expref: -99 pid: 28037 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361333.424828:0:30234:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361333.424835:0:30234:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361333.424840:0:30234:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361333.424842:0:30234:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788361333.424844:0:30234:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788361333.424854:0:30234:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8987bd6800 00010000:00010000:1.0:1788361333.424857:0:30234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e800/0xf6a94c97d66130cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d66130d2 expref: -99 pid: 27385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361333.424873:0:30234:0:(import.c:65:import_set_state_nolock()) ffff9a8987bd6800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788361333.424877:0:30234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788361333.424879:0:30234:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788361333.424881:0:30234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788361333.424885:0:30234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788361333.424895:0:30234:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a898514c000 x1875232144156928/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788361341 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788361333.424906:0:30234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788361333.424909:0:30234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:3.0:1788361333.424989:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e46014fe-639d-4b32-8855-95bba88887b0:3310:1875232144156928:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:1.0:1788361333.425078:0:30234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788361333.425187:0:30234:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66130b6 00000020:00000080:1.0:1788361333.425194:0:30234:0:(genops.c:906:class_export_put()) final put ffff9a8abeadb000/e46014fe-639d-4b32-8855-95bba88887b0 00000020:01000000:1.0:1788361333.425268:0:30234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.160@tcp (flags='') 00000020:00000080:1.0:1788361333.425274:0:30234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361333.425280:0:30234:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.160@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361333.425284:0:30234:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9a8a84f13380) has no exports 10000000:01000000:3.0:1788361333.425344:0:27400:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788361333.425454:0:30234:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.160@tcp: client import never connected 00000100:00080000:1.0:1788361333.425462:0:30234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788361333.425464:0:30234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788361333.425466:0:30234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788361333.425468:0:30234:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788361333.425597:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abeadb000/e46014fe-639d-4b32-8855-95bba88887b0 for MGC192.168.203.160@tcp 00000020:00000080:2.0:1788361333.425707:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8987bd6800 for MGC192.168.203.160@tcp 00000020:00000080:1.0:1788361333.425782:0:30234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361333.425787:0:30234:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.160@tcp (uuid e46014fe-639d-4b32-8855-95bba88887b0) 00000020:00000080:1.0:1788361333.425790:0:30234:0:(genops.c:906:class_export_put()) final put ffff9a8987bd0800/e46014fe-639d-4b32-8855-95bba88887b0 00000020:00000080:1.0:1788361333.425793:0:30234:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8987bd0800/e46014fe-639d-4b32-8855-95bba88887b0 for MGC192.168.203.160@tcp 00000020:01000000:1.0:1788361333.425798:0:30234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.160@tcp (e46014fe-639d-4b32-8855-95bba88887b0) 00000020:01000000:1.0:1788361333.426692:0:30234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788361333.426698:0:30234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361333.426705:0:30234:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788361333.426711:0:30234:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a89864ba000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788361333.426717:0:30234:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9a8a84f119c0) has exports, disconnecting them 00000020:00080000:1.0:1788361333.426721:0:30234:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a89864ba000), last request at 1788361293 00000020:00000080:1.0:1788361333.426726:0:30234:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613379 00000020:00080000:1.0:1788361333.426739:0:30234:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a89864ba000): rc 0 00000020:00000080:1.0:1788361333.426743:0:30234:0:(genops.c:906:class_export_put()) final put ffff9a89864ba000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788361333.426809:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89864ba000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788361333.431261:0:30234:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788361333.431272:0:30234:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361333.431276:0:30234:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788361333.431282:0:30234:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788361333.431375:0:27392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788361333.431501:0:29424:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:3.0:1788361333.431567:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a898718d800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788361333.434076:0:27391:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788361333.436255:0:29425:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1788361333.436349:0:27386:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a8abebec000:27386] 0 exiting: rc = 1 00000100:00100000:0.0:1788361333.436537:0:27387:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a8abebed200:27387] 1 exiting: rc = 0 00000100:00100000:2.0:1788361333.436717:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.437304:0:28064:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a8a882d9200:28064] 3 exiting: rc = 0 00000100:00100000:3.0:1788361333.437687:0:27388:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a8abebecc00:27388] 0 exiting: rc = 1 00000100:00100000:3.0:1788361333.437746:0:27390:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a8abebede00:27390] 2 exiting: rc = 0 00000100:00100000:3.0:1788361333.437920:0:27389:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a8abebec400:27389] 1 exiting: rc = 0 00000100:00100000:2.0:1788361333.437998:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438005:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438011:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438019:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438025:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438030:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438036:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438042:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438047:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438051:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438057:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438063:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438068:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438073:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438078:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438083:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438117:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438122:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438127:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438133:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438138:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438143:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438148:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438153:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438158:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438163:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438168:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438173:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438178:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438183:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438189:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438194:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438211:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438216:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438222:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438226:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438231:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438236:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438242:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438247:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438253:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438257:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438262:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438268:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438273:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438278:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438283:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438291:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438296:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438301:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438306:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438310:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438315:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438320:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438325:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438330:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438335:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438340:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438346:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438351:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438356:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438361:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438367:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.438372:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788361333.439001:0:30234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361333.439010:0:30234:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788361333.439016:0:30234:0:(genops.c:906:class_export_put()) final put ffff9a8a83709800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788361333.439026:0:30234:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83709800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788361333.439031:0:30234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788361333.439070:0:30234:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8a109000 1 00000020:00000080:2.0:1788361333.439076:0:30234:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613333 00000020:00000080:2.0:1788361333.439082:0:30234:0:(genops.c:906:class_export_put()) final put ffff9a8ac0c05000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788361333.439117:0:30234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788361333.439122:0:30234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361333.439127:0:30234:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788361333.439131:0:30234:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a8ab7460000) has no exports 00000020:00000080:3.0:1788361333.439641:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac0c05000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788361333.452158:0:30234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361333.452173:0:30234:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788361333.452179:0:30234:0:(genops.c:906:class_export_put()) final put ffff9a8a8a10c800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788361333.452183:0:30234:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8a10c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788361333.452193:0:30234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788361333.452378:0:30234:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8a8a10b000 00000020:01000000:2.0:1788361333.452398:0:30234:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788361333.452402:0:30234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361333.452407:0:30234:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788361333.452410:0:30234:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9a8984a58000) has no exports 00000020:00000080:2.0:1788361333.452432:0:30234:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361333.452439:0:30234:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788361333.452441:0:30234:0:(genops.c:906:class_export_put()) final put ffff9a8ac05c1800/OSS_uuid 00000020:00000080:2.0:1788361333.452444:0:30234:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac05c1800/OSS_uuid for OSS 00000020:01000000:2.0:1788361333.452447:0:30234:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788361333.453188:0:28041:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a8a9837fa00:28041] 2 exiting: rc = 0 00000100:00100000:2.0:1788361333.453272:0:28038:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a8a8b41ea00:28038] 0 exiting: rc = 1 00000100:00080000:2.0:1788361333.453315:0:27399:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788361333.455179:0:28040:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a8a9837e600:28040] 1 exiting: rc = 0 00000100:00100000:3.0:1788361333.456908:0:28204:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a8a83d50800:28204] 3 exiting: rc = 0 00000100:00100000:2.0:1788361333.457173:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457180:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457185:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457192:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457211:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457216:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457221:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457226:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457231:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457236:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457242:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457247:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457253:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457260:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457265:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457272:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457277:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457282:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457287:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457292:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457298:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457304:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457311:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457316:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457321:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457326:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457333:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457338:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457344:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457348:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457354:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457359:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457365:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457370:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457375:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457380:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457385:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457393:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457399:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457412:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457417:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457421:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457426:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457431:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457435:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457440:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457445:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457450:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457454:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457459:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457464:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457468:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457473:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457478:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457485:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457490:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457495:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457499:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457505:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457511:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457515:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457520:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457526:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.457531:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.458636:0:28042:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a8a9837f600:28042] 0 exiting: rc = 1 00000100:00100000:2.0:1788361333.458796:0:28043:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a8985352e00:28043] 1 exiting: rc = 0 00000100:00100000:2.0:1788361333.458845:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458852:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458857:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458864:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458881:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458887:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458892:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458899:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458905:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458920:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458925:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458931:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458935:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458940:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458945:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458950:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458955:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458959:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458963:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458968:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458972:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458977:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458982:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458989:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458994:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.458999:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459003:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459008:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459014:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459019:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459024:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459029:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459033:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459037:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459042:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459046:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459050:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459055:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459062:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459069:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459074:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459078:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459428:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459439:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459452:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459457:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459463:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459468:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459473:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459478:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459482:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459487:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459493:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459497:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459502:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459511:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459517:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459522:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459527:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459532:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459538:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459542:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459547:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361333.459552:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.460540:0:28045:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a8a834b7000:28045] 1 exiting: rc = 0 00000100:00100000:3.0:1788361333.460808:0:28046:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a8985353a00:28046] 2 exiting: rc = 0 00000100:00100000:1.0:1788361333.461184:0:28044:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a8a834b6200:28044] 0 exiting: rc = 1 00000100:00100000:3.0:1788361333.461254:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461263:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461274:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461282:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461289:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461307:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461314:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461320:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461326:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461332:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461337:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461354:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461359:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461364:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461370:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461376:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461382:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461388:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461408:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461415:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461421:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461426:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461432:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461437:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461443:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461450:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461456:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461461:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461467:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461473:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461479:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461485:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461490:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461496:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461501:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461509:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461514:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461520:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461525:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461530:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461536:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461541:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461562:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461570:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461575:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461581:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461595:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461600:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461606:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461612:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461618:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461623:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461628:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461633:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461639:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461656:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461663:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461669:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461674:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461679:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461685:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461690:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461696:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.461701:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472016:0:28047:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a8a85705600:28047] 0 exiting: rc = 1 00000100:00100000:0.0:1788361333.472510:0:28048:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a8a856a1800:28048] 1 exiting: rc = 0 00000100:00100000:3.0:1788361333.472594:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472603:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472616:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472621:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472627:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472633:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472638:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472643:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472748:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472756:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472761:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472766:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472771:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472776:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472781:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472786:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472898:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472913:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472919:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472931:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472940:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472953:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472959:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472964:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472969:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472974:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472980:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472985:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472991:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.472996:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473034:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473042:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473047:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473052:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473057:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473063:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473070:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473077:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473201:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473211:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473216:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473222:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473227:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473233:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473238:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473246:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473253:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473262:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473268:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473274:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473284:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473304:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473311:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473413:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473426:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473431:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473481:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473490:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473499:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473533:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473541:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473547:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473722:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.473733:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361333.475196:0:28049:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a8a882a0000:28049] 0 exiting: rc = 1 00000100:00100000:0.0:1788361333.475279:0:28050:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a8a882a1000:28050] 1 exiting: rc = 0 00000100:00100000:3.0:1788361333.475344:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475352:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475358:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475364:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475370:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475376:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475382:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475406:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475414:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475421:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475427:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475433:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475439:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475444:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475450:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475455:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475461:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475467:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475472:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475492:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475500:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475507:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475522:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475528:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475534:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475540:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475545:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475551:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475556:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475562:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475568:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475589:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475597:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475603:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475607:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475618:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475623:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475629:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475637:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475643:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475708:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475714:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475719:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475740:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475748:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475753:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475759:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475765:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475771:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475777:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475783:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475789:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475795:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475801:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475858:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475881:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475888:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475901:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475907:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475913:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475929:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475943:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475952:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361333.475966:0:30234:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788361333.494413:0:30234:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788361344.440684:0:30848:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788361349.190217:0:31261:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788361349.190222:0:31261:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788361349.190333:0:31261:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8986533800 00000020:01000004:1.0:1788361349.190348:0:31261:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788361349.190356:0:31261:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788361349.190368:0:31261:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a8ab7460000) 00000020:00000080:1.0:1788361349.190381:0:31261:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788361349.201005:0:31261:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788361349.202889:0:31261:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x39:0x0] (8/32) 00100000:10000000:1.0:1788361349.203314:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1788361349.203410:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:1.0:1788361349.203503:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:1.0:1788361349.203596:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1788361349.203693:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1788361349.203914:0:31261:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788361349.203981:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:1.0:1788361349.204325:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:1.0:1788361349.205355:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 660: rc = 0 00100000:10000000:1.0:1788361349.205454:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 660: rc = 0 00100000:10000000:1.0:1788361349.205867:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 790: rc = 0 00100000:10000000:1.0:1788361349.206288:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361349.206531:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 790: rc = 0 00100000:10000000:1.0:1788361349.206772:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361349.207014:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361349.207341:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 790: rc = 0 00100000:10000000:1.0:1788361349.207589:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 790: rc = 0 00100000:10000000:1.0:1788361349.207823:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361349.208153:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361349.208398:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 790: rc = 0 00100000:10000000:1.0:1788361349.208643:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 790: rc = 0 00100000:10000000:1.0:1788361349.208877:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 790: rc = 0 00100000:10000000:1.0:1788361349.209378:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 311: rc = 0 00100000:10000000:1.0:1788361349.209635:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 311: rc = 0 00100000:10000000:1.0:1788361349.209867:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 311: rc = 0 00100000:10000000:1.0:1788361349.210197:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 311: rc = 0 00100000:10000000:1.0:1788361349.210429:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 311: rc = 0 00100000:10000000:1.0:1788361349.210683:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 311: rc = 0 00100000:10000000:1.0:1788361349.210926:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 311: rc = 0 00100000:10000000:1.0:1788361349.211261:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 311: rc = 0 00100000:10000000:1.0:1788361349.212417:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 311: rc = 0 00100000:10000000:1.0:1788361349.212718:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 311: rc = 0 00100000:10000000:1.0:1788361349.214279:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 311: rc = 0 00100000:10000000:1.0:1788361349.214586:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 311: rc = 0 00100000:10000000:1.0:1788361349.214833:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 311: rc = 0 00100000:10000000:2.0:1788361349.215921:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 311: rc = 0 00100000:10000000:2.0:1788361349.216422:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 311: rc = 0 00100000:10000000:2.0:1788361349.216671:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 311: rc = 0 00100000:10000000:2.0:1788361349.217243:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 311: rc = 0 00100000:10000000:2.0:1788361349.217469:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 311: rc = 0 00100000:10000000:2.0:1788361349.217693:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 311: rc = 0 00100000:10000000:2.0:1788361349.218181:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 311: rc = 0 00100000:10000000:2.0:1788361349.218434:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 311: rc = 0 00100000:10000000:2.0:1788361349.218689:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 311: rc = 0 00100000:10000000:2.0:1788361349.219063:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 311: rc = 0 00100000:10000000:2.0:1788361349.219497:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 311: rc = 0 00100000:10000000:2.0:1788361349.219730:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 311: rc = 0 00100000:10000000:2.0:1788361349.220483:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 311: rc = 0 00100000:10000000:2.0:1788361349.220729:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 311: rc = 0 00100000:10000000:2.0:1788361349.220999:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 311: rc = 0 00100000:10000000:2.0:1788361349.221390:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 311: rc = 0 00100000:10000000:2.0:1788361349.221646:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 311: rc = 0 00100000:10000000:2.0:1788361349.221932:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 311: rc = 0 00100000:10000000:2.0:1788361349.223332:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 311: rc = 0 00100000:10000000:2.0:1788361349.223707:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 392: rc = 0 00100000:10000000:2.0:1788361349.224236:0:31261:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788361349.224400:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 664: rc = 0 00100000:10000000:2.0:1788361349.224598:0:31261:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788361349.224868:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 664: rc = 0 00100000:10000000:2.0:1788361349.225047:0:31261:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788361349.225572:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 664: rc = 0 00100000:10000000:2.0:1788361349.226075:0:31261:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788361349.226621:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 661: rc = 0 00100000:10000000:2.0:1788361349.226822:0:31261:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788361349.226881:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 661: rc = 0 00100000:10000000:2.0:1788361349.227066:0:31261:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788361349.227227:0:31261:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 661: rc = 0 00000020:00000080:2.0:1788361349.227483:0:31261:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788361349.227491:0:31261:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788361349.227501:0:31261:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66137d9 00000020:01000004:2.0:1788361349.227509:0:31261:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788361349.227514:0:31261:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788361349.227518:0:31261:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8986533800 from MGS 00000020:01000004:2.0:1788361349.227522:0:31261:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788361349.227531:0:31261:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a8a84f119c0) 00000020:00000080:2.0:1788361349.227548:0:31261:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788361349.227603:0:31261:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8986533800 from MGS, refs=2 00080000:01000000:2.0:1788361349.227608:0:31261:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788361349.227614:0:31261:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66137e7 00000100:00100000:2.0:1788361349.227703:0:31261:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788361349.227808:0:31261:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788361349.227813:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788361349.228446:0:31261:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788361349.228452:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788361349.229004:0:31261:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361349.229348:0:31261:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788361349.229353:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788361349.230269:0:31261:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788361349.230277:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788361349.230549:0:31261:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788361349.230555:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788361349.231080:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361349.231100:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361349.231102:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361349.232425:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361349.232431:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361349.232433:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361349.233018:0:31261:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788361349.237281:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788361349.246655:0:31261:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788361349.246670:0:31261:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788361349.246673:0:31261:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788361349.247929:0:31270:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788361349.248040:0:31261:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788361349.248156:0:31261:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361349.248534:0:31261:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788361349.248806:0:31261:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361349.248950:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788361349.248955:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788361349.249729:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788361349.249737:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788361349.253550:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788361349.253566:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788361349.255871:0:31261:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788361349.255899:0:31261:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.160@tcp' 00000020:01000004:0.0:1788361349.255901:0:31261:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788361349.255933:0:31261:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.160@tcp (typ=mgc) 00000020:00000080:0.0:1788361349.255945:0:31261:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.160@tcp (ffff9a8a90bf19c0) 00000020:00000080:0.0:1788361349.255962:0:31261:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788361349.256050:0:31261:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a8924e000@MGC192.168.203.160@tcp: add connection 192.168.203.160@tcp at head 00010000:00010000:0.0:1788361349.256228:0:31261:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.160@tcp-0 is initialized 00000040:01000000:0.0:1788361349.256234:0:31261:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788361349.256492:0:31275:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788361349.257262:0:31276:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788361349.257347:0:31261:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.160@tcp (uuid a25ae0af-c16d-4164-9502-26eb1af82516) 00000020:00000080:0.0:1788361349.257368:0:31261:0:(genops.c:1406:class_connect()) connect: client a25ae0af-c16d-4164-9502-26eb1af82516, cookie 0xf6a94c97d66137f5 00000100:00080000:0.0:1788361349.257379:0:31261:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361349.257385:0:31261:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a8a8924e000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361349.257416:0:31261:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a84643800 x1875232144157056/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361349.257442:0:31261:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a25ae0af-c16d-4164-9502-26eb1af82516->MGS 00000020:01000004:0.0:1788361349.257462:0:31261:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788361349.257466:0:31261:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788361349.257478:0:31261:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a8a90bf4d40) 00000020:00000080:0.0:1788361349.257487:0:31261:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788361349.258193:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a25ae0af-c16d-4164-9502-26eb1af82516:3310:1875232144157056:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788361349.258262:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361349.258375:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144157056 00000100:00100000:2.0:1788361349.258381:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144157056 00000100:00100000:2.0:1788361349.258423:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361349.258430:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1875232144157056:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788361349.258451:0:31271:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from a25ae0af-c16d-4164-9502-26eb1af82516@0@lo t0 exp 0000000000000000 cur 739 last 0 00000020:00000080:2.0:1788361349.258477:0:31271:0:(genops.c:1406:class_connect()) connect: client a25ae0af-c16d-4164-9502-26eb1af82516, cookie 0xf6a94c97d6613803 00000100:00080000:2.0:1788361349.258588:0:31271:0:(import.c:65:import_set_state_nolock()) ffff9a8a867a5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361349.258643:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+5:3310:x1875232144157056:12345-0@lo:250:mount.lustre.0 Request processed in 213us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361349.258650:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361349.258721:0:3310:0:(client.c:3115:ptlrpc_free_committed()) MGC192.168.203.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788361349.258730:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.160@tcp: connect to target with instance 0 00000100:00080000:3.0:1788361349.258736:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788361349.258740:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788361349.258742:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8924e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788361349.258744:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788361349.258759:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788361349.258764:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a25ae0af-c16d-4164-9502-26eb1af82516:3310:1875232144157056:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788361349.270837:0:31261:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361349.271011:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788361349.271017:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788361349.275746:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788361349.275756:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788361349.276224:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788361349.276230:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788361349.276786:0:31261:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361349.276929:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788361349.276933:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788361349.277633:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788361349.277641:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788361349.307425:0:31261:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361349.307594:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788361349.307599:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788361349.308515:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788361349.308524:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788361349.309042:0:31261:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361349.309315:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788361349.309319:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788361349.309720:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788361349.309726:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788361349.310469:0:31261:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361349.310584:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788361349.310593:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788361349.310920:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788361349.310926:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788361349.311441:0:31261:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361349.311543:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788361349.311547:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788361349.311845:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788361349.311851:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788361349.327753:0:31261:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361349.327926:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788361349.327933:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788361349.328981:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788361349.328997:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788361349.329741:0:31261:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788361349.329749:0:31261:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788361349.330485:0:31261:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788361349.330505:0:31261:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788361349.330510:0:31261:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788361349.330636:0:31261:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788361349.330667:0:31261:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788361349.330672:0:31261:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788361349.330673:0:31261:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361349.330675:0:31261:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361349.330676:0:31261:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361349.330677:0:31261:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361349.330679:0:31261:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361349.330680:0:31261:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361349.330681:0:31261:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361349.330683:0:31261:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361349.330684:0:31261:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361349.330687:0:31261:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788361349.330689:0:31261:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361349.330690:0:31261:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361349.330691:0:31261:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361349.330693:0:31261:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361349.330694:0:31261:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361349.330700:0:31261:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361349.330701:0:31261:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361349.330702:0:31261:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361349.330702:0:31261:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361349.330703:0:31261:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361349.330728:0:31261:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788361349.330746:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157184:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361349.330810:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361349.330863:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85244180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361349.330936:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144157184 00000100:00100000:0.0:1788361349.330944:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144157184 00000100:00100000:0.0:1788361349.331009:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361349.331019:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+5:31261:x1875232144157184:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361349.331065:0:31274:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361349.331068:0:31274:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788361349.331070:0:31274:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788361349.331421:0:31295:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788361349.331752:0:31274:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 17 20000000:01000000:0.0:1788361349.332865:0:31296:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788361349.332870:0:31296:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788361349.332873:0:31296:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788361349.332903:0:31296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788361349.333405:0:31274:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361349.333415:0:31274:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788361349.343916:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+5:31261:x1875232144157184:12345-0@lo:253:mount.lustre.0 Request processed in 12889us (13095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361349.343937:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361349.344046:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157184:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361349.344061:0:31261:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788361349.344065:0:31261:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361349.344067:0:31261:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361349.344068:0:31261:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361349.344069:0:31261:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361349.344070:0:31261:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361349.344071:0:31261:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361349.344072:0:31261:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361349.344073:0:31261:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361349.344075:0:31261:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361349.344076:0:31261:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788361349.344126:0:31261:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8986533800 from lustre-MDT0000 10000000:01000000:3.0:1788361349.344149:0:31261:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788361349.344152:0:31261:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788361349.344156:0:31261:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a8a90bf19c0 10000000:01000000:3.0:1788361349.344161:0:31261:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361349.344168:0:31261:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a8a90bf19c0 from 1 10000000:01000000:3.0:1788361349.344170:0:31261:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788361349.344203:0:31261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.344212:0:31261:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.344235:0:31261:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361349.344262:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361349.344294:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361349.344324:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aafd8c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788361349.344474:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144157312 00000100:00100000:0.0:1788361349.344480:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144157312 00000100:00100000:0.0:1788361349.344511:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361349.344519:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+5:31261:x1875232144157312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361349.344532:0:31272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361349.344546:0:31272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573e600/0xf6a94c97d6613811 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661380a expref: -99 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.344568:0:31272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573e600/0xf6a94c97d6613811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661380a expref: 6 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.344578:0:31272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573e600/0xf6a94c97d6613811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661380a expref: 6 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.344586:0:31272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e600, rc 0) 00000100:00100000:0.0:1788361349.344623:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+6:31261:x1875232144157312:12345-0@lo:101:mount.lustre.0 Request processed in 104us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361349.344628:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361349.344737:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361349.344751:0:31261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.344758:0:31261:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361349.344803:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361349.344827:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361349.344853:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aafd8c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361349.344900:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144157440 00000100:00100000:1.0:1788361349.344905:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144157440 00000100:00100000:1.0:1788361349.344936:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361349.344942:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+6:31261:x1875232144157440:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361349.345184:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+6:31261:x1875232144157440:12345-0@lo:501:mount.lustre.0 Request processed in 241us (354us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361349.345196:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361349.345372:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157440:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788361349.345400:0:31261:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788361349.345417:0:31261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.345424:0:31261:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361349.345432:0:31261:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8986533800 10000000:01000000:3.0:1788361349.345437:0:31261:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788361349.345447:0:31261:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a8986533800 10000000:01000000:3.0:1788361349.345449:0:31261:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788361349.345452:0:31261:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a8986533800 from 1 10000000:01000000:3.0:1788361349.345454:0:31261:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788361349.345479:0:31261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.345486:0:31261:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.345494:0:31261:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361349.345506:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361349.345533:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361349.345558:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aafd8c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361349.345609:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144157568 00000100:00100000:1.0:1788361349.345619:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144157568 00000100:00100000:1.0:1788361349.345650:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361349.345656:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+6:31261:x1875232144157568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361349.345664:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361349.345676:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987622a00/0xf6a94c97d661381f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613818 expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.345691:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987622a00/0xf6a94c97d661381f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613818 expref: 7 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.345699:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987622a00/0xf6a94c97d661381f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613818 expref: 7 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.345705:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622a00, rc 0) 00000100:00100000:1.0:1788361349.345730:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+7:31261:x1875232144157568:12345-0@lo:101:mount.lustre.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361349.345735:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361349.345832:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361349.345842:0:31261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.345850:0:31261:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361349.345861:0:31261:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788361349.345876:0:31261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.345883:0:31261:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361349.345899:0:31261:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788361349.345903:0:31261:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361349.345907:0:31261:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a8986533800 10000000:01000000:3.0:1788361349.345909:0:31261:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788361349.345912:0:31261:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788361349.345914:0:31261:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788361349.345928:0:31261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.345935:0:31261:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.345942:0:31261:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361349.345953:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361349.345977:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361349.346043:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aafd8c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361349.346370:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144157696 00000100:00100000:1.0:1788361349.346376:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144157696 00000100:00100000:1.0:1788361349.346438:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361349.346445:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+7:31261:x1875232144157696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361349.346455:0:31272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361349.346463:0:31272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987623000/0xf6a94c97d661382d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613826 expref: -99 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.346478:0:31272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987623000/0xf6a94c97d661382d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613826 expref: 8 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.346486:0:31272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987623000/0xf6a94c97d661382d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613826 expref: 8 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.346499:0:31272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623000, rc 0) 00000100:00100000:1.0:1788361349.346574:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+8:31261:x1875232144157696:12345-0@lo:101:mount.lustre.0 Request processed in 129us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361349.346581:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361349.346685:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361349.346698:0:31261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.346706:0:31261:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361349.346752:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361349.347699:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361349.347799:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361349.347879:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144157824 00000100:00100000:1.0:1788361349.347885:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144157824 00000100:00100000:1.0:1788361349.347968:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361349.347976:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+8:31261:x1875232144157824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361349.348653:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+9:31261:x1875232144157824:12345-0@lo:501:mount.lustre.0 Request processed in 676us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361349.348661:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361349.349173:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361349.349237:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361349.349295:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361349.349319:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f90240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361349.349438:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144157952 00000100:00100000:3.0:1788361349.349444:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144157952 00000100:00100000:3.0:1788361349.349482:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361349.349489:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+9:31261:x1875232144157952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361349.349767:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+9:31261:x1875232144157952:12345-0@lo:503:mount.lustre.0 Request processed in 278us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361349.349780:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361349.349900:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144157952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361349.350227:0:31297:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31297:1875232144158080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361349.350324:0:31297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361349.350349:0:31297:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8677ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361349.350388:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144158080 00000100:00100000:3.0:1788361349.350392:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144158080 00000100:00100000:3.0:1788361349.350424:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361349.350430:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+9:31297:x1875232144158080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361349.350633:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+9:31297:x1875232144158080:12345-0@lo:502:llog_process_th.0 Request processed in 203us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361349.350639:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361349.350736:0:31297:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31297:1875232144158080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361349.350757:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361349.350766:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361349.350769:0:31297:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788361349.350779:0:31297:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788361349.350781:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361349.350793:0:31297:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a8a84f13380) 00000020:00000080:2.0:1788361349.350807:0:31297:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788361349.350812:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788361349.350865:0:31297:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788361349.350870:0:31297:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d661383b 00000020:00000080:2.0:1788361349.351065:0:31297:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788361349.351068:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361349.351071:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361349.351072:0:31297:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788361349.351075:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361349.351078:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361349.351079:0:31297:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788361349.351082:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361349.351158:0:31297:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a8a84f14d40) 00000020:00000080:2.0:1788361349.351166:0:31297:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788361349.351170:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788361349.351172:0:31297:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788361349.351175:0:31297:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788361349.351180:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788361349.351214:0:31297:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8986533800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788361349.351224:0:31297:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a8a84f10000) 00000020:00000080:2.0:1788361349.351229:0:31297:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788361349.351386:0:31297:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788361349.351393:0:31297:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6613850 00000020:00000080:2.0:1788361349.351469:0:31297:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788361349.351474:0:31297:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788361349.351479:0:31297:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf6a94c97d6613857 00080000:01000000:2.0:1788361349.351483:0:31297:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788361349.351486:0:31297:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d661385e 00010000:00010000:2.0:1788361349.407467:0:31297:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788361349.407841:0:31297:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 21474836515 00000001:00080000:2.0:1788361349.408009:0:31297:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788361349.408703:0:31297:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a8985c64d40) 00000020:00000080:2.0:1788361349.408724:0:31297:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788361349.408807:0:31297:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788361349.408814:0:31297:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d661386c 00000020:00000080:3.0:1788361349.409223:0:31297:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788361349.414233:0:31297:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf6a94c97d6613873 00000020:00000080:2.0:1788361349.417441:0:31297:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788361349.417454:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361349.417518:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.417522:0:31297:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788361349.417526:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361349.417532:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.417534:0:31297:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788361349.417538:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788361349.417579:0:31297:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788361349.417594:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361349.417597:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.417598:0:31297:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788361349.417600:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788361349.417602:0:31297:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788361349.417604:0:31297:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361349.417605:0:31297:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361349.417607:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788361349.417609:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.417610:0:31297:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788361349.417612:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788361349.417615:0:31297:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788361349.417618:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.417619:0:31297:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788361349.417622:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788361349.417627:0:31297:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:3.0:1788361349.417651:0:31297:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788361349.417660:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361349.417675:0:31297:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a8984a58000) 00000020:00000080:3.0:1788361349.417691:0:31297:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788361349.417697:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788361349.417752:0:31297:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788361349.417756:0:31297:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788361349.417763:0:31297:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d6613881 00010000:00080000:3.0:1788361349.417792:0:31297:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a89249000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361349.418001:0:31297:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788361349.418383:0:31297:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788361349.418421:0:31297:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788361349.419315:0:31297:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361349.419367:0:31297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].6, 64 off8576 00000040:00080000:3.0:1788361349.419429:0:31297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].1, 64 off8256 00000040:00080000:3.0:1788361349.423466:0:31301:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788361349.423473:0:31301:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x22:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788361349.424058:0:31297:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361349.424067:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788361349.424109:0:31297:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788361349.424128:0:31297:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6613888 00000100:00080000:3.0:1788361349.424137:0:31297:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361349.424142:0:31297:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8a89249000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361349.424172:0:31297:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a8926f100 x1875232144158208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361349.424197:0:31297:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788361349.426406:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144158208:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788361349.426468:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144158208 offset 0 length 520: 4 00000020:01000000:3.0:1788361349.430450:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361349.430459:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.430461:0:31297:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788361349.430465:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788361349.430467:0:31297:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788361349.430481:0:31297:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361349.430483:0:31297:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788361349.430484:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788361349.430487:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.430489:0:31297:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788361349.430491:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788361349.430496:0:31297:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788361349.430499:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.430501:0:31297:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788361349.430503:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788361349.430508:0:31297:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:3.0:1788361349.430533:0:31297:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788361349.430535:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361349.430550:0:31297:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a8984a5b380) 00000020:00000080:3.0:1788361349.430569:0:31297:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788361349.430575:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788361349.430639:0:31297:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788361349.430645:0:31297:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788361349.430653:0:31297:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d6613896 00010000:00080000:3.0:1788361349.430683:0:31297:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a89879b4800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361349.430904:0:31297:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788361349.431114:0:31297:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788361349.431137:0:31297:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788361349.431974:0:31297:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361349.432039:0:31297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].6, 64 off8576 00000040:00080000:3.0:1788361349.432217:0:31297:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].1, 64 off8256 00000040:00080000:1.0:1788361349.432652:0:31303:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788361349.432657:0:31303:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x24:0x0] at index 6 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788361349.433363:0:31297:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361349.433374:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788361349.433401:0:31297:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788361349.433418:0:31297:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d661389d 00000100:00080000:3.0:1788361349.433427:0:31297:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361349.433432:0:31297:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a89879b4800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361349.433469:0:31297:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a8926e680 x1875232144158336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361349.433532:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144158336:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788361349.433577:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144158336 offset 0 length 520: 4 00000100:00080000:3.0:1788361349.433626:0:31297:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788361349.433716:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361349.433720:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.433722:0:31297:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788361349.433724:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361349.433728:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.433729:0:31297:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788361349.433731:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788361349.433733:0:31297:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788361349.433735:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361349.433737:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.433738:0:31297:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788361349.433740:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361349.433742:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.433743:0:31297:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788361349.433747:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788361349.433775:0:31297:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31297:1875232144158464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361349.433824:0:31297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361349.433852:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144158464 00000100:00100000:3.0:1788361349.433857:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144158464 00000100:00100000:3.0:1788361349.433887:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361349.433894:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+9:31297:x1875232144158464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361349.434127:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+9:31297:x1875232144158464:12345-0@lo:502:llog_process_th.0 Request processed in 232us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361349.434134:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361349.434168:0:31297:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8529e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788361349.434186:0:31297:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31297:1875232144158464:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361349.434213:0:31297:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361349.434216:0:31297:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361349.434218:0:31297:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788361349.434222:0:31297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788361349.434337:0:31261:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788361349.434354:0:31261:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788361349.434365:0:31261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.434376:0:31261:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361349.434384:0:31261:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8986533800 from 1 10000000:01000000:3.0:1788361349.434387:0:31261:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361349.434407:0:31261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.434414:0:31261:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.434424:0:31261:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361349.434435:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144158592:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361349.434458:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361349.434471:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361349.434803:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144158592 00000100:00100000:1.0:1788361349.434808:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144158592 00000100:00100000:1.0:1788361349.434860:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361349.434867:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+9:31261:x1875232144158592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361349.434877:0:31272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361349.434889:0:31272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987623a00/0xf6a94c97d66138ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66138a4 expref: -99 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.434908:0:31272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987623a00/0xf6a94c97d66138ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66138a4 expref: 10 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.434918:0:31272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987623a00/0xf6a94c97d66138ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66138a4 expref: 10 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.434937:0:31272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623a00, rc 0) 00000100:00100000:1.0:1788361349.434974:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+10:31261:x1875232144158592:12345-0@lo:101:mount.lustre.0 Request processed in 108us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361349.434981:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361349.435043:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144158592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361349.435055:0:31261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.435064:0:31261:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361349.435648:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144158720:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788361349.435697:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361349.436153:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85659540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361349.436257:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144158720 00000100:00100000:3.0:1788361349.436263:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144158720 00000100:00100000:3.0:1788361349.436292:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361349.436301:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+10:31261:x1875232144158720:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788361349.436324:0:31274:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788361349.436330:0:31274:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788361349.436405:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+10:31261:x1875232144158720:12345-0@lo:256:mount.lustre.0 Request processed in 105us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361349.436412:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361349.436544:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144158720:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788361349.437138:0:31261:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788361349.437154:0:31261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.437164:0:31261:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361349.437171:0:31261:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8986533800 from 1 10000000:01000000:0.0:1788361349.437173:0:31261:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361349.437204:0:31261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.437211:0:31261:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.437219:0:31261:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361349.437234:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144158848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361349.437282:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361349.437300:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85659540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361349.437438:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144158848 00000100:00100000:3.0:1788361349.437444:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144158848 00000100:00100000:3.0:1788361349.437469:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361349.437475:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+10:31261:x1875232144158848:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361349.437485:0:31274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361349.437497:0:31274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d66138b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66138b2 expref: -99 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.437516:0:31274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d66138b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66138b2 expref: 11 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.437526:0:31274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d66138b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66138b2 expref: 11 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361349.437535:0:31274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcae00, rc 0) 00000100:00100000:3.0:1788361349.437564:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+11:31261:x1875232144158848:12345-0@lo:101:mount.lustre.0 Request processed in 89us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361349.437570:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361349.437644:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144158848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361349.437712:0:31261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.437720:0:31261:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361349.437767:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144158976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361349.437790:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361349.437818:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85659540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361349.437859:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144158976 00000100:00100000:3.0:1788361349.437863:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144158976 00000100:00100000:3.0:1788361349.437880:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788361349.437885:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+11:31261:x1875232144158976:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361349.438477:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+11:31261:x1875232144158976:12345-0@lo:501:mount.lustre.0 Request processed in 590us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361349.438490:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361349.438663:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144158976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361349.438697:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144159104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361349.438736:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361349.438793:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85659540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361349.438807:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144159104 00000100:00100000:0.0:1788361349.438811:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144159104 00000100:00100000:3.0:1788361349.438852:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361349.438860:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+11:31261:x1875232144159104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361349.439045:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+11:31261:x1875232144159104:12345-0@lo:503:mount.lustre.0 Request processed in 186us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361349.439052:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361349.442386:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144159104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361349.442839:0:31305:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31305:1875232144159232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361349.442913:0:31305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361349.442954:0:31305:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85659000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361349.443021:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144159232 00000100:00100000:2.0:1788361349.443028:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144159232 00000100:00100000:2.0:1788361349.443074:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361349.443112:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+11:31305:x1875232144159232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361349.443509:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+11:31305:x1875232144159232:12345-0@lo:502:llog_process_th.0 Request processed in 426us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361349.443518:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361349.443675:0:31305:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31305:1875232144159232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361349.443700:0:31305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361349.443708:0:31305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361349.443711:0:31305:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788361349.443717:0:31305:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8986533800 00000020:00000080:0.0:1788361349.443720:0:31305:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361349.443728:0:31305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361349.443730:0:31305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361349.443732:0:31305:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788361349.443740:0:31305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361349.443744:0:31305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361349.443745:0:31305:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788361349.443748:0:31305:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8986533800 00000020:00000080:0.0:1788361349.443750:0:31305:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361349.443846:0:31305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361349.443850:0:31305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361349.443852:0:31305:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788361349.443854:0:31305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361349.443856:0:31305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361349.443857:0:31305:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788361349.443861:0:31305:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8986533800 00000020:00000080:0.0:1788361349.443862:0:31305:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788361349.447247:0:31305:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31305:1875232144159360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361349.447416:0:31305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361349.447463:0:31305:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85659000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361349.447546:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144159360 00000100:00100000:2.0:1788361349.447554:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144159360 00000100:00100000:2.0:1788361349.447604:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361349.447614:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+11:31305:x1875232144159360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361349.447830:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+11:31305:x1875232144159360:12345-0@lo:502:llog_process_th.0 Request processed in 217us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361349.447838:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361349.447941:0:31305:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31305:1875232144159360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788361349.447967:0:31305:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361349.447974:0:31305:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361349.447976:0:31305:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788361349.447980:0:31305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788361349.451174:0:31261:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788361349.451212:0:31261:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788361349.451235:0:31261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.451369:0:31261:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361349.451415:0:31261:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788361349.451419:0:31261:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8986533800 10000000:01000000:2.0:1788361349.451422:0:31261:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8986533800 10000000:01000000:2.0:1788361349.451425:0:31261:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788361349.451431:0:31261:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8986533800 from 1 10000000:01000000:2.0:1788361349.451434:0:31261:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788361349.451468:0:31261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.451476:0:31261:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.451486:0:31261:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361349.451509:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144159488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361349.451573:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361349.451611:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361349.451633:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144159488 00000100:00100000:2.0:1788361349.451639:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144159488 00000100:00100000:2.0:1788361349.451674:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788361349.451681:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+11:31261:x1875232144159488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361349.451694:0:31274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361349.451712:0:31274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d66138c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66138c0 expref: -99 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.451733:0:31274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d66138c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66138c0 expref: 12 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.451743:0:31274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d66138c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66138c0 expref: 12 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.451751:0:31274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361349.451795:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:31261:x1875232144159488:12345-0@lo:101:mount.lustre.0 Request processed in 114us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361349.451801:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361349.451893:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144159488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361349.451907:0:31261:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.451916:0:31261:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361349.451962:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144159616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361349.451999:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361349.452020:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361349.452071:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144159616 00000100:00100000:2.0:1788361349.452076:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144159616 00000100:00100000:2.0:1788361349.452136:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788361349.452143:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+12:31261:x1875232144159616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361349.452551:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+12:31261:x1875232144159616:12345-0@lo:501:mount.lustre.0 Request processed in 408us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361349.452558:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361349.454804:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144159616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361349.454865:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144159744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361349.454935:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361349.459452:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144159744 00000100:00100000:2.0:1788361349.459465:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144159744 00000100:00100000:3.0:1788361349.459693:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361349.460195:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788361349.460209:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+12:31261:x1875232144159744:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361349.462573:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+12:31261:x1875232144159744:12345-0@lo:503:mount.lustre.0 Request processed in 2361us (7630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361349.462587:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361349.462705:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144159744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361349.471381:0:31310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31310:1875232144159872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361349.471473:0:31310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361349.471518:0:31310:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aafd8c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361349.471622:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144159872 00000100:00100000:0.0:1788361349.471629:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144159872 00000100:00100000:0.0:1788361349.471706:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788361349.471716:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+12:31310:x1875232144159872:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361349.471960:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+12:31310:x1875232144159872:12345-0@lo:502:llog_process_th.0 Request processed in 245us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361349.471968:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361349.472056:0:31310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31310:1875232144159872:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788361349.472154:0:31310:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788361349.472168:0:31310:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a8985c60000) 00000020:00000080:2.0:1788361349.472189:0:31310:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788361349.472648:0:31310:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8986533800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788361349.472653:0:31310:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8986533800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788361349.472655:0:31310:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8986533800 4 00010000:00080000:3.0:1788361349.472684:0:31310:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a8377d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361349.474248:0:31310:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788361349.474400:0:31310:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788361349.474435:0:31310:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788361349.474447:0:31310:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf6a94c97d66138d5 00000100:00080000:3.0:1788361349.474457:0:31310:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361349.474463:0:31310:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a8a8377d000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361349.474498:0:31310:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a8926ca80 x1875232144160000/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361349.474528:0:31310:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788361349.474728:0:31310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31310:1875232144160128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361349.474799:0:31310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361349.474870:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144160000:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361349.474902:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361349.475475:0:31310:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8802d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361349.475515:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144160128 00000100:00100000:1.0:1788361349.475522:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144160128 00000100:00100000:0.0:1788361349.475579:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361349.475596:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+12:31310:x1875232144160128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788361349.475841:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+12:31310:x1875232144160128:12345-0@lo:502:llog_process_th.0 Request processed in 246us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361349.475849:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361349.475955:0:31310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a25ae0af-c16d-4164-9502-26eb1af82516:31310:1875232144160128:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788361349.475998:0:31310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:3.0:1788361349.476143:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144160000 00000100:00100000:3.0:1788361349.476148:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144160000 00000100:00100000:3.0:1788361349.476168:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361349.476173:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144160000:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361349.476223:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144160000:12345-0@lo:38:llog_process_th.0 Request processed in 48us (1319us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788361349.476230:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361349.476715:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361349.476722:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8377d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361349.476726:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788361349.476729:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144160000:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788361349.477365:0:31261:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788361349.477386:0:31261:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361349.477409:0:31261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.477421:0:31261:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788361349.477464:0:31261:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788361349.477466:0:31261:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361349.477468:0:31261:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361349.477469:0:31261:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361349.477470:0:31261:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361349.477471:0:31261:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361349.477472:0:31261:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361349.477474:0:31261:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361349.477476:0:31261:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361349.477477:0:31261:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788361349.477481:0:31261:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788361349.477483:0:31261:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788361349.477485:0:31261:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361349.477486:0:31261:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361349.477487:0:31261:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361349.477488:0:31261:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361349.477494:0:31261:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361349.477495:0:31261:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361349.477496:0:31261:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361349.477497:0:31261:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361349.477498:0:31261:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788361349.477529:0:31261:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788361349.477546:0:31261:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144160256:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788361349.477593:0:31261:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361349.477622:0:31261:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a87f2d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361349.477646:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144160256 00000100:00100000:2.0:1788361349.477651:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144160256 00000100:00100000:2.0:1788361349.477678:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788361349.477685:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+12:31261:x1875232144160256:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361349.477707:0:31272:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788361349.477718:0:31272:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788361349.513500:0:31272:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361349.513521:0:31272:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788361349.514055:0:31295:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361349.514060:0:31295:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361349.514103:0:31295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.514124:0:31295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8987623a00/0xf6a94c97d66138ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66138a4 expref: 12 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.514131:0:31295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.514175:0:31295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8987623a00/0xf6a94c97d66138ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66138a4 expref: 12 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.514188:0:31295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8987623a00/0xf6a94c97d66138ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66138a4 expref: 12 pid: 31272 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361349.514204:0:31295:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31295:1875232144160384:0@lo:104: 00000100:00100000:0.0:1788361349.514286:0:31295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361349.514333:0:31295:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85659cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361349.514457:0:31262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144160384 00000100:00100000:1.0:1788361349.514466:0:31262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144160384 00000100:00100000:1.0:1788361349.514515:0:31262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361349.514538:0:31262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+3:31295:x1875232144160384:12345-0@lo:104: 00010000:00010000:1.0:1788361349.514551:0:31262:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361349.514604:0:31262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361349.514610:0:31262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+3:31295:x1875232144160384:12345-0@lo:104: Request processed in 75us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361349.514617:0:31262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361349.514755:0:31295:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31295:1875232144160384:0@lo:104: 00010000:00010000:0.0:1788361349.514774:0:31295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.514886:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361349.514894:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.514902:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361349.514906:0:31268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.514914:0:31268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361349.514921:0:31268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361349.514927:0:31268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361349.514963:0:31268:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.514993:0:31268:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361349.515017:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515025:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca800/0xf6a94c97d66138a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66138ab expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515041:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361349.515043:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361349.515045:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361349.515169:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144160512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361349.515210:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361349.515421:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144160512 00000100:00100000:2.0:1788361349.515427:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144160512 00010000:00010000:2.0:1788361349.515446:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8987623a00/0xf6a94c97d66138ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66138a4 expref: 13 pid: 31272 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361349.515477:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361349.515485:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25ae0af-c16d-4164-9502-26eb1af82516+13:3311:x1875232144160512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361349.515497:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361349.515503:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8987623a00/0xf6a94c97d66138ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66138a4 expref: 13 pid: 31272 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515513:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8987623a00/0xf6a94c97d66138ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66138a4 expref: 13 pid: 31272 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515526:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987623a00/0xf6a94c97d66138ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66138a4 expref: 13 pid: 31272 timeout: 839 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515541:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515558:0:31264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361349.515573:0:31264:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001513037s 00010000:00010000:2.0:1788361349.515578:0:31264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515583:0:31264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515590:0:31264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515596:0:31264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515602:0:31264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361349.515606:0:31264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515613:0:31264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515625:0:31264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361349.515634:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361349.515667:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25ae0af-c16d-4164-9502-26eb1af82516+12:3311:x1875232144160512:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361349.515674:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361349.515789:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144160512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361349.515820:0:31295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.515828:0:31295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361349.515835:0:31295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573f800/0xf6a94c97d66138dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361349.527703:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+11:31261:x1875232144160256:12345-0@lo:253:mount.lustre.0 Request processed in 50007us (50098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361349.527718:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788361349.527803:0:31261:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31261:1875232144160256:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788361349.527817:0:31261:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788361349.527821:0:31261:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788361349.527823:0:31261:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361349.527824:0:31261:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361349.527826:0:31261:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361349.527827:0:31261:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361349.527828:0:31261:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361349.527830:0:31261:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361349.527831:0:31261:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361349.527833:0:31261:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361349.527835:0:31261:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788361349.527861:0:31261:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788361349.529073:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361349.529316:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361349.529589:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361349.529747:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361349.530028:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361349.530347:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361349.531066:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361349.531365:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361349.531612:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361349.531774:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361349.532026:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788361349.532486:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788361349.558003:0:31261:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 17179869275 00000040:01000000:2.0:1788361349.558540:0:31261:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788361349.558776:0:31316:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 17179869275 00000020:00080000:1.0:1788361349.558781:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869275 00000040:01000000:3.0:1788361349.558855:0:31317:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788361349.558918:0:31317:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788361349.563583:0:31261:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788361349.563707:0:31261:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788361349.564184:0:31261:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788361349.564192:0:31261:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788361349.564317:0:31261:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361349.565053:0:31317:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788361349.565131:0:31317:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788361349.565142:0:31317:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1788361349.565800:0:31261:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788361349.566589:0:31261:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788361349.566703:0:31261:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788361349.567225:0:31261:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 4, last_idx 5 00080000:10000000:3.0:1788361349.568049:0:31261:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3a:0x0] (8/8/4) registered 00000001:00000004:2.0:1788361349.572864:0:31261:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803776 00000001:00080000:1.0:1788361349.605948:0:31261:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788361349.605993:0:31261:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa998c1553988 00100000:10000000:1.0:1788361349.606002:0:31261:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788361349.606810:0:31261:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788361349.606827:0:31261:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788361349.606840:0:31261:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788361349.606870:0:31261:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788361350.243372:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361350.496523:0:31311:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1788361350.496533:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361350.496914:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:1.0:1788361350.496922:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 10000000:01000000:1.0:1788361350.688176:0:31276:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788361350.688184:0:31276:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8986533800 from 18 10000000:01000000:1.0:1788361350.688190:0:31276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788361350.688241:0:31276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361350.688272:0:31276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361350.688294:0:31276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361350.688319:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144160640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361350.688437:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361350.688504:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361350.688652:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144160640 00000100:00100000:0.0:1788361350.688660:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144160640 00000100:00100000:0.0:1788361350.688718:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361350.688728:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+11:31276:x1875232144160640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361350.688744:0:31274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361350.688757:0:31274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66138ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66138e3 expref: -99 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361350.688781:0:31274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66138ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66138e3 expref: 12 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361350.688792:0:31274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66138ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66138e3 expref: 12 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361350.688801:0:31274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:0.0:1788361350.688855:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:31276:x1875232144160640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361350.688862:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788361350.689022:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144160640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361350.689039:0:31276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361350.689048:0:31276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361350.689124:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144160768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788361350.689157:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361350.689188:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361350.689227:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144160768 00000100:00100000:2.0:1788361350.689234:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144160768 00000100:00100000:2.0:1788361350.689347:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361350.689355:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+12:31276:x1875232144160768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788361350.689372:0:31272:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788361350.689389:0:31272:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788361350.689393:0:31272:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 18 00000100:00100000:2.0:1788361350.689489:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+12:31276:x1875232144160768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361350.689498:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361350.689528:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144160768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361350.689574:0:31276:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361350.689581:0:31276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361350.689590:0:31276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361351.268163:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361351.520398:0:31311:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1788361351.520407:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361351.520437:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:1.0:1788361351.520443:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:1.0:1788361352.288327:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361352.776479:0:31559:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788361353.312305:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361354.336486:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361354.912795:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361354.912803:0:15670:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788361354.912805:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361354.912808:0:15670:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788361354.912811:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788361354.912814:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788361354.912819:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8a8377d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361354.912832:0:15670:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a8a8377d000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361354.912858:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a84643800 x1875232144161024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788361354.912929:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144161024:0@lo:38:kworker.0 00000100:00100000:1.0:1788361354.912933:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361354.912958:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144160896:0@lo:400:kworker.0 00000100:00100000:1.0:1788361354.915351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361354.915417:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144160896 00000100:00100000:1.0:1788361354.915426:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144160896 00000100:00100000:1.0:1788361354.915479:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361354.915491:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:3311:x1875232144160896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361354.915554:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:3311:x1875232144160896:12345-0@lo:400:kworker.0 Request processed in 66us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361354.915561:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361354.915628:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144160896:0@lo:400:kworker.0 00000100:00100000:3.0:1788361354.915689:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361354.915786:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144161024 00000100:00100000:2.0:1788361354.915792:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144161024 00000100:00100000:2.0:1788361354.915822:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361354.915828:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144161024:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788361354.915851:0:31281:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 744 last 0 00000020:00000080:2.0:1788361354.916159:0:31281:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf6a94c97d66138f1 00000004:00100000:2.0:1788361354.916603:0:31281:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788361354.916750:0:31281:0:(import.c:65:import_set_state_nolock()) ffff9a8a85da9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361354.916812:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232144161024:12345-0@lo:38:kworker.0 Request processed in 983us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361354.916820:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788361354.917426:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8a84643800 x1875232144161024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788361354.917442:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 6 00000100:00080000:3.0:1788361354.917449:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788361354.917454:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788361354.917457:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8377d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788361354.917462:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144161024:0@lo:38:kworker.0 00000020:00000080:1.0:1788361355.038269:0:31711:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5d136e90 20000000:00000080:1.0:1788361355.038286:0:31711:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8a84e52800 uarg=0000000000000000 20000000:01000000:1.0:1788361355.038315:0:31711:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788361355.038322:0:31711:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788361355.038326:0:31711:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788361355.039787:0:31712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788361355.039937:0:31711:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788361355.053071:0:31711:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788361355.053205:0:31711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361355.053286:0:31711:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d66138b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66138b2 expref: 11 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361355.053296:0:31711:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361355.053407:0:31711:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d66138b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66138b2 expref: 11 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361355.053425:0:31711:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d66138b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66138b2 expref: 11 pid: 31274 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361355.053454:0:31711:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:31711:1875232144161152:0@lo:104: 00000100:00100000:1.0:1788361355.053516:0:31711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361355.053561:0:31711:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a995f93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361355.054561:0:31262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144161152 00000100:00100000:0.0:1788361355.054570:0:31262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144161152 00000100:00100000:0.0:1788361355.054620:0:31262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361355.054629:0:31262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+3:31711:x1875232144161152:12345-0@lo:104: 00010000:00010000:0.0:1788361355.054643:0:31262:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361355.054708:0:31262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788361355.054713:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788361355.054714:0:31262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+3:31711:x1875232144161152:12345-0@lo:104: Request processed in 87us (1200us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361355.054720:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361355.054721:0:31262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788361355.054728:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361355.054732:0:31268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.054740:0:31268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361355.054748:0:31268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361355.054765:0:31268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788361355.054772:0:31711:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:31711:1875232144161152:0@lo:104: 00010000:00010000:3.0:1788361355.054794:0:31711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.054806:0:31268:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.054813:0:31268:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361355.054847:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.054854:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f600/0xf6a94c97d66138b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66138b9 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.054869:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361355.054872:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361355.054873:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361355.054883:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25ae0af-c16d-4164-9502-26eb1af82516:3313:1875232144161280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361355.054927:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361355.055023:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144161280 00000100:00100000:2.0:1788361355.055028:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144161280 00010000:00010000:2.0:1788361355.055047:0:31266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d66138b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66138b2 expref: 12 pid: 31274 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361355.055075:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361355.055081:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a25ae0af-c16d-4164-9502-26eb1af82516+12:3313:x1875232144161280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361355.055111:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361355.055116:0:31266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d66138b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66138b2 expref: 12 pid: 31274 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055127:0:31266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d66138b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66138b2 expref: 12 pid: 31274 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055141:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d66138b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66138b2 expref: 12 pid: 31274 timeout: 845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055159:0:31266:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055166:0:31266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055176:0:31266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055181:0:31266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055186:0:31266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055190:0:31266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055193:0:31266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361355.055196:0:31266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055200:0:31266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055215:0:31266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.055220:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361355.055250:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a25ae0af-c16d-4164-9502-26eb1af82516+11:3313:x1875232144161280:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361355.055262:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361355.055276:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25ae0af-c16d-4164-9502-26eb1af82516:3313:1875232144161280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361355.055338:0:31711:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361355.055347:0:31711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361355.055354:0:31711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987623400/0xf6a94c97d66138f8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361355.360238:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361356.384398:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788361356.833151:0:31276:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361356.833165:0:31276:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8986533800 from 10 10000000:01000000:0.0:1788361356.833172:0:31276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361356.833227:0:31276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361356.833239:0:31276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361356.833250:0:31276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361356.833274:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144161408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361356.833339:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361356.833390:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144161408 00000100:00100000:0.0:1788361356.833394:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361356.833398:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144161408 00000100:00100000:2.0:1788361356.833465:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788361356.833475:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+11:31276:x1875232144161408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361356.833490:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361356.833505:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b9400/0xf6a94c97d6613906 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66138ff expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361356.833538:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b9400/0xf6a94c97d6613906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66138ff expref: 12 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361356.833549:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b9400/0xf6a94c97d6613906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66138ff expref: 12 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361356.833558:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9400, rc 0) 00000100:00100000:2.0:1788361356.833605:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+12:31276:x1875232144161408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361356.833612:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788361356.833700:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144161408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361356.833716:0:31276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361356.833724:0:31276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361356.833774:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144161536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361356.833801:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361356.833826:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788361356.833944:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144161536 00000100:00100000:0.0:1788361356.833949:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144161536 00000100:00100000:0.0:1788361356.833986:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361356.833993:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:31276:x1875232144161536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361356.834251:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:31276:x1875232144161536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361356.834257:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361356.834286:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144161536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361356.834315:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144161664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361356.834351:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361356.834365:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361356.834376:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144161664 00000100:00100000:0.0:1788361356.834379:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144161664 00000100:00100000:0.0:1788361356.834395:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361356.834408:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:31276:x1875232144161664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361356.834554:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:31276:x1875232144161664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361356.834561:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361356.834596:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144161664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361356.835275:0:31816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788361356.835324:0:31276:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788361356.835342:0:31276:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361356.835351:0:31276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361356.835361:0:31276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361357.408526:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361358.010467:0:31911:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788361358.010471:0:31911:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788361358.010578:0:31911:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8ac05c5800 00000020:01000004:0.0:1788361358.010595:0:31911:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788361358.010608:0:31911:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788361358.010621:0:31911:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a8a90bf0000) 00000020:00000080:0.0:1788361358.010638:0:31911:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788361358.031309:0:31911:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788361358.031554:0:31911:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788361358.032347:0:31911:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788361358.032589:0:31911:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788361358.032853:0:31911:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xe:0x0] (8/32) 00100000:10000000:2.0:1788361358.033254:0:31911:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1788361358.033340:0:31911:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1788361358.033417:0:31911:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1788361358.033903:0:31911:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 720: rc = 0 00100000:10000000:2.0:1788361358.034344:0:31911:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 720: rc = 0 00100000:10000000:2.0:1788361358.034712:0:31911:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 720: rc = 0 00100000:10000000:2.0:1788361358.034967:0:31911:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 720: rc = 0 00100000:10000000:2.0:1788361358.035226:0:31911:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 720: rc = 0 00100000:10000000:2.0:1788361358.035410:0:31911:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 720: rc = 0 00000020:00000080:2.0:1788361358.035949:0:31911:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788361358.035960:0:31911:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788361358.035970:0:31911:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d6613914 00000020:01000004:2.0:1788361358.035979:0:31911:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788361358.036000:0:31911:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788361358.036004:0:31911:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788361358.036009:0:31911:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788361358.036014:0:31911:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788361358.036024:0:31911:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a8985c63380) 00000020:00000080:2.0:1788361358.036034:0:31911:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788361358.037529:0:31911:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361358.037772:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788361358.037779:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788361358.038481:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788361358.038488:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788361358.038835:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788361358.038841:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788361358.042878:0:31911:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361358.043049:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788361358.043056:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788361358.044749:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788361358.044758:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788361358.058060:0:31911:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361358.058305:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788361358.058311:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788361358.059514:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788361358.059524:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788361358.061248:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788361358.061260:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788361358.064996:0:31911:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361358.065236:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788361358.065243:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788361358.066959:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788361358.066976:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788361358.096059:0:31911:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361358.096330:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788361358.096339:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788361358.101334:0:31911:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788361358.101352:0:31911:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788361358.105166:0:31911:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788361358.105281:0:31911:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788361358.105288:0:31911:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788361358.118381:0:31911:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788361358.118418:0:31911:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788361358.118422:0:31911:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788361358.118424:0:31911:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788361358.118426:0:31911:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361358.118427:0:31911:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361358.118428:0:31911:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361358.118429:0:31911:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361358.118430:0:31911:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361358.118432:0:31911:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361358.118434:0:31911:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361358.118437:0:31911:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788361358.118439:0:31911:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361358.118440:0:31911:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788361358.118441:0:31911:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361358.118442:0:31911:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361358.118443:0:31911:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361358.118444:0:31911:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361358.118445:0:31911:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361358.118446:0:31911:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361358.118447:0:31911:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788361358.118485:0:31911:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788361358.118505:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144161792:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361358.120428:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361358.120487:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361358.120545:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144161792 00000100:00100000:2.0:1788361358.120554:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144161792 00000100:00100000:2.0:1788361358.120605:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788361358.120615:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:31911:x1875232144161792:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361358.120646:0:31274:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788361358.120649:0:31274:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788361358.120653:0:31274:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788361358.129544:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:31911:x1875232144161792:12345-0@lo:253:mount.lustre.0 Request processed in 8921us (9112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361358.129567:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788361358.129719:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144161792:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361358.129744:0:31911:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788361358.129747:0:31911:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361358.129761:0:31911:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788361358.129762:0:31911:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361358.129763:0:31911:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361358.129764:0:31911:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361358.129766:0:31911:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361358.129767:0:31911:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361358.129769:0:31911:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361358.129770:0:31911:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788361358.129789:0:31911:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8ac05c5800 from lustre-OST0000 10000000:01000000:0.0:1788361358.129812:0:31911:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788361358.129815:0:31911:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788361358.129822:0:31911:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8a90bf19c0 local copy 00010000:00010000:0.0:1788361358.129832:0:31911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361358.130065:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144161920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361358.130137:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361358.130173:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8138b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361358.130348:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144161920 00000100:00100000:2.0:1788361358.130353:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144161920 00000100:00100000:2.0:1788361358.130387:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788361358.130395:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+12:31911:x1875232144161920:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361358.130637:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+12:31911:x1875232144161920:12345-0@lo:501:mount.lustre.0 Request processed in 241us (498us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361358.130645:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361358.130814:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144161920:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788361358.130825:0:31911:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788361358.130922:0:31911:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788361358.130941:0:31911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361358.130951:0:31911:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361358.130971:0:31911:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8ac05c5800 10000000:01000000:0.0:1788361358.130976:0:31911:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788361358.130981:0:31911:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a8a90bf19c0 10000000:01000000:0.0:1788361358.130983:0:31911:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788361358.130993:0:31911:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a8a90bf19c0 from 1 10000000:01000000:0.0:1788361358.130996:0:31911:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788361358.131021:0:31911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e000/0xf6a94c97d6613922 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361358.131029:0:31911:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e000/0xf6a94c97d6613922 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361358.131037:0:31911:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e000/0xf6a94c97d6613922 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361358.131050:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361358.131077:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361358.131147:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8138b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361358.131637:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144162048 00000100:00100000:1.0:1788361358.131643:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144162048 00000100:00100000:1.0:1788361358.131685:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788361358.131693:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+12:31911:x1875232144162048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361358.131704:0:31274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361358.131717:0:31274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987623800/0xf6a94c97d6613929 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613922 expref: -99 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.131739:0:31274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987623800/0xf6a94c97d6613929 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613922 expref: 13 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.131749:0:31274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987623800/0xf6a94c97d6613929 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613922 expref: 13 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.131757:0:31274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623800, rc 0) 00000100:00100000:1.0:1788361358.131797:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+13:31911:x1875232144162048:12345-0@lo:101:mount.lustre.0 Request processed in 105us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361358.131804:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788361358.131920:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361358.131941:0:31911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e000/0xf6a94c97d6613922 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613929 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361358.131950:0:31911:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e000/0xf6a94c97d6613922 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613929 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361358.131966:0:31911:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788361358.131983:0:31911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e000/0xf6a94c97d6613922 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613929 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361358.131991:0:31911:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e000/0xf6a94c97d6613922 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613929 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361358.131997:0:31911:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788361358.132008:0:31911:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361358.132013:0:31911:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788361358.132015:0:31911:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788361358.132032:0:31911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361358.132038:0:31911:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361358.132045:0:31911:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361358.132057:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361358.132116:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361358.132149:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8138b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361358.132253:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144162176 00000100:00100000:3.0:1788361358.132258:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144162176 00000100:00100000:3.0:1788361358.132289:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361358.132297:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+13:31911:x1875232144162176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361358.132304:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361358.132314:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6613937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613930 expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361358.132328:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6613937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613930 expref: 14 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361358.132344:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6613937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613930 expref: 14 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361358.132350:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcbc00, rc 0) 00000100:00100000:3.0:1788361358.132389:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+14:31911:x1875232144162176:12345-0@lo:101:mount.lustre.0 Request processed in 93us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361358.132395:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788361358.132642:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361358.132654:0:31911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361358.132662:0:31911:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361358.133277:0:31911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 14 count 14 00000040:00080000:1.0:1788361358.134640:0:31911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361358.134902:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:1.0:1788361358.135254:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 128 off8544 00000040:00080000:1.0:1788361358.135286:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 112 off8656 00000040:00080000:1.0:1788361358.135314:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8880 00000040:00080000:1.0:1788361358.135334:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9104 00000040:00080000:1.0:1788361358.135350:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 80 off9184 00000040:00080000:1.0:1788361358.135385:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9408 00000040:00080000:1.0:1788361358.135407:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9632 00000040:00080000:1.0:1788361358.135423:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 80 off9712 00000040:00080000:1.0:1788361358.135446:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off9936 00000040:00080000:1.0:1788361358.135463:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 224 off10160 00000040:00080000:1.0:1788361358.135487:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 120 off10280 00000040:00080000:1.0:1788361358.135532:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].13, 224 off10504 00000040:00080000:1.0:1788361358.135541:0:31911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 13 count 14 00000100:00100000:1.0:1788361358.135715:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361358.135782:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361358.135829:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361358.135910:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144162304 00000100:00100000:3.0:1788361358.135919:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144162304 00000100:00100000:3.0:1788361358.136022:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788361358.136032:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+14:31911:x1875232144162304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361358.136407:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+14:31911:x1875232144162304:12345-0@lo:501:mount.lustre.0 Request processed in 376us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361358.136416:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361358.140161:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361358.140222:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361358.140294:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361358.140335:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361358.140405:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144162432 00000100:00100000:2.0:1788361358.140411:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144162432 00000100:00100000:2.0:1788361358.140464:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788361358.140472:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+14:31911:x1875232144162432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361358.140857:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+14:31911:x1875232144162432:12345-0@lo:503:mount.lustre.0 Request processed in 384us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361358.140865:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788361358.141019:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162432:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361358.141571:0:31911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361358.141633:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361358.141676:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361358.141709:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361358.141816:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144162560 00000100:00100000:2.0:1788361358.141821:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144162560 00000100:00100000:2.0:1788361358.141858:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788361358.141865:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+14:31911:x1875232144162560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361358.142074:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+14:31911:x1875232144162560:12345-0@lo:502:mount.lustre.0 Request processed in 208us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361358.142081:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788361358.144276:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361358.144663:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:2.0:1788361358.144728:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 128 off8544 00000040:00080000:2.0:1788361358.144765:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 112 off8656 00000040:00080000:2.0:1788361358.144816:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8880 00000040:00080000:2.0:1788361358.144857:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9104 00000040:00080000:2.0:1788361358.144893:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 80 off9184 00000040:00080000:2.0:1788361358.144957:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9408 00000040:00080000:2.0:1788361358.145011:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:2.0:1788361358.145049:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 80 off9712 00000040:00080000:2.0:1788361358.145148:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9936 00000040:00080000:2.0:1788361358.145188:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 224 off10160 00000040:00080000:2.0:1788361358.145233:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 120 off10280 00000100:00100000:2.0:1788361358.145284:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162688:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361358.145377:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361358.145437:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96300 going to sleep for 11 seconds 00000100:00100000:3.0:1788361358.146741:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144162688 00000100:00100000:3.0:1788361358.146752:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144162688 00000100:00100000:3.0:1788361358.146854:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788361358.146865:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+14:31911:x1875232144162688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361358.147811:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+14:31911:x1875232144162688:12345-0@lo:502:mount.lustre.0 Request processed in 945us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361358.147820:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788361358.147933:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162688:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361358.148056:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].13, 224 off10504 00000040:00080000:2.0:1788361358.148072:0:31911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788361358.149328:0:31925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788361358.149337:0:31925:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788361358.149345:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361358.149347:0:31925:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788361358.149361:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361358.149375:0:31925:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a8ab74619c0) 00000020:00000080:1.0:1788361358.149398:0:31925:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788361358.149404:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788361358.149475:0:31925:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8ac05c5800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788361358.149483:0:31925:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788361358.149491:0:31925:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d6613945 00010000:00010000:1.0:1788361358.152687:0:31925:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788361358.153276:0:31925:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 21474836486 00080000:10000000:1.0:1788361358.155008:0:31925:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00000020:00000080:0.0:1788361358.156641:0:31925:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788361358.156653:0:31925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361358.156660:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.156662:0:31925:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788361358.156666:0:31925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788361358.156669:0:31925:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788361358.156671:0:31925:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361358.156679:0:31925:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788361358.156680:0:31925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788361358.156683:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.156684:0:31925:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788361358.156687:0:31925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361358.156690:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.156692:0:31925:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788361358.156695:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788361358.156697:0:31925:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788361358.156699:0:31925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361358.156701:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.156702:0:31925:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788361358.156704:0:31925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361358.156706:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.156708:0:31925:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788361358.156711:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788361358.156768:0:31925:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361358.156772:0:31925:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.156774:0:31925:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788361358.156777:0:31925:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000020:01000000:2.0:1788361358.160268:0:31911:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788361358.160304:0:31911:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788361358.160320:0:31911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.160334:0:31911:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361358.160348:0:31911:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8ac05c5800 from 1 10000000:01000000:2.0:1788361358.160350:0:31911:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788361358.160378:0:31911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.160383:0:31911:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.160391:0:31911:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361358.160409:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361358.160465:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361358.160516:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144162816 00000100:00100000:2.0:1788361358.160522:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361358.160903:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144162816 00000100:00100000:1.0:1788361358.160967:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788361358.160977:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+14:31911:x1875232144162816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361358.160991:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361358.161006:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987622000/0xf6a94c97d6613953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661394c expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.161031:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987622000/0xf6a94c97d6613953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661394c expref: 15 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.161042:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987622000/0xf6a94c97d6613953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661394c expref: 15 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.161050:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622000, rc 0) 00000100:00100000:1.0:1788361358.161113:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144162816:12345-0@lo:101:mount.lustre.0 Request processed in 138us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361358.161121:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788361358.161175:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361358.161191:0:31911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361358.161202:0:31911:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361358.161750:0:31911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000040:00080000:3.0:1788361358.162621:0:31911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361358.162864:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:3.0:1788361358.163033:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 112 off8528 00000040:00080000:3.0:1788361358.163117:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 224 off8752 00000040:00080000:3.0:1788361358.163163:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8976 00000040:00080000:3.0:1788361358.163204:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 112 off9088 00000040:00080000:3.0:1788361358.163253:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 224 off9312 00000040:00080000:3.0:1788361358.163290:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 224 off9536 00000040:00080000:3.0:1788361358.163326:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 128 off9664 00000040:00080000:3.0:1788361358.163403:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:3.0:1788361358.163411:0:31911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 9 count 10 00000100:00100000:3.0:1788361358.163485:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361358.164121:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361358.164160:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa0acdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361358.164196:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144162944 00000100:00100000:2.0:1788361358.164204:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144162944 00000100:00100000:2.0:1788361358.164242:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788361358.164250:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144162944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361358.164475:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144162944:12345-0@lo:501:mount.lustre.0 Request processed in 224us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361358.164483:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788361358.165713:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144162944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361358.165759:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361358.165810:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361358.165843:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa0acdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361358.165859:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144163072 00000100:00100000:2.0:1788361358.165865:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144163072 00000100:00100000:2.0:1788361358.165903:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788361358.165910:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144163072:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361358.166219:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144163072:12345-0@lo:503:mount.lustre.0 Request processed in 309us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361358.166238:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788361358.166782:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163072:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788361358.167301:0:31911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361358.167365:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361358.167410:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361358.167446:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8133a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361358.167459:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144163200 00000100:00100000:2.0:1788361358.167465:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144163200 00000100:00100000:2.0:1788361358.167506:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788361358.167514:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144163200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361358.167681:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144163200:12345-0@lo:502:mount.lustre.0 Request processed in 168us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361358.167690:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788361358.169660:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361358.169958:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:3.0:1788361358.170023:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:3.0:1788361358.170077:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:3.0:1788361358.170152:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:3.0:1788361358.170209:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000040:00080000:3.0:1788361358.170276:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:3.0:1788361358.170326:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 224 off9536 00000040:00080000:3.0:1788361358.170375:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 128 off9664 00000100:00100000:3.0:1788361358.170419:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361358.170622:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361358.170666:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa0acdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361358.170748:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144163328 00000100:00100000:2.0:1788361358.170755:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144163328 00000100:00100000:2.0:1788361358.170802:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788361358.170811:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144163328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361358.171012:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144163328:12345-0@lo:502:mount.lustre.0 Request processed in 197us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361358.171020:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788361358.171187:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163328:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361358.171282:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:0.0:1788361358.171293:0:31911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788361358.173732:0:31929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361358.173744:0:31929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.173747:0:31929:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788361358.173754:0:31929:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8ac05c5800 00000020:00000080:0.0:1788361358.173756:0:31929:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361358.173762:0:31929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361358.173765:0:31929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.173766:0:31929:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788361358.173769:0:31929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361358.173771:0:31929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.173773:0:31929:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788361358.173788:0:31929:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8ac05c5800 00000020:00000080:0.0:1788361358.173790:0:31929:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361358.173885:0:31929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361358.173889:0:31929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.173891:0:31929:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788361358.173893:0:31929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788361358.173896:0:31929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.173898:0:31929:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788361358.173901:0:31929:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8ac05c5800 00000020:00000080:0.0:1788361358.173903:0:31929:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788361358.177568:0:31929:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788361358.177579:0:31929:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788361358.177581:0:31929:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788361358.177586:0:31929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000020:01000000:1.0:1788361358.181404:0:31911:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788361358.181449:0:31911:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361358.181480:0:31911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.181493:0:31911:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361358.181543:0:31911:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361358.181546:0:31911:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8ac05c5800 10000000:01000000:1.0:1788361358.181550:0:31911:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8ac05c5800 10000000:01000000:1.0:1788361358.181555:0:31911:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361358.181562:0:31911:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8ac05c5800 from 1 10000000:01000000:1.0:1788361358.181565:0:31911:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361358.181605:0:31911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.181614:0:31911:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.181626:0:31911:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361358.181653:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361358.181728:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361358.181769:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361358.181794:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144163456 00000100:00100000:1.0:1788361358.181800:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144163456 00000100:00100000:1.0:1788361358.181845:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788361358.181854:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144163456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361358.181867:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361358.181880:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987622800/0xf6a94c97d6613961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661395a expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.181938:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987622800/0xf6a94c97d6613961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661395a expref: 16 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.181950:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987622800/0xf6a94c97d6613961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661395a expref: 16 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.181958:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622800, rc 0) 00000100:00100000:1.0:1788361358.181999:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+16:31911:x1875232144163456:12345-0@lo:101:mount.lustre.0 Request processed in 146us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361358.182007:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788361358.182065:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361358.182703:0:31911:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.182715:0:31911:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361358.184433:0:31911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000040:00080000:1.0:1788361358.184796:0:31911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361358.185464:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:1.0:1788361358.185520:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:1.0:1788361358.185570:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:1.0:1788361358.185632:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:1.0:1788361358.185681:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:1.0:1788361358.185749:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:1.0:1788361358.185799:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:1.0:1788361358.185889:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:1.0:1788361358.185967:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:1.0:1788361358.186015:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:1.0:1788361358.186049:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:1.0:1788361358.186211:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:1.0:1788361358.186263:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:1.0:1788361358.186313:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:1.0:1788361358.186384:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:1.0:1788361358.186420:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:1.0:1788361358.186453:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:1.0:1788361358.186502:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:1.0:1788361358.186540:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:1.0:1788361358.186573:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:1.0:1788361358.186619:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:1.0:1788361358.186654:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:1.0:1788361358.186691:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:1.0:1788361358.186750:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:1.0:1788361358.186795:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 128 off12440 00000040:00080000:1.0:1788361358.186966:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12664 00000040:00080000:1.0:1788361358.187035:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12888 00000040:00080000:1.0:1788361358.187178:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off12968 00000040:00080000:1.0:1788361358.187382:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13192 00000040:00080000:1.0:1788361358.187459:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13416 00000040:00080000:1.0:1788361358.187541:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13504 00000040:00080000:1.0:1788361358.187599:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13632 00000040:00080000:1.0:1788361358.187662:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13776 00000040:00080000:1.0:1788361358.187751:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13904 00000040:00080000:1.0:1788361358.187862:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14128 00000040:00080000:1.0:1788361358.188081:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14352 00000040:00080000:1.0:1788361358.188161:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14432 00000040:00080000:1.0:1788361358.188532:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14656 00000040:00080000:1.0:1788361358.188594:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14880 00000040:00080000:1.0:1788361358.188646:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 120 off15000 00000040:00080000:1.0:1788361358.188764:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 224 off15224 00000040:00080000:1.0:1788361358.188773:0:31911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 41 count 42 00000100:00100000:1.0:1788361358.188900:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361358.188974:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361358.189024:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361358.189173:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144163584 00000100:00100000:3.0:1788361358.189181:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144163584 00000100:00100000:3.0:1788361358.189230:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788361358.189239:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+16:31911:x1875232144163584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361358.189503:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+16:31911:x1875232144163584:12345-0@lo:501:mount.lustre.0 Request processed in 265us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361358.189511:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788361358.189556:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163584:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361358.189595:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163712:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361358.189845:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361358.189877:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8138be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361358.189918:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144163712 00000100:00100000:1.0:1788361358.189932:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144163712 00000100:00100000:1.0:1788361358.189971:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788361358.189979:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+16:31911:x1875232144163712:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361358.190186:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+16:31911:x1875232144163712:12345-0@lo:503:mount.lustre.0 Request processed in 206us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361358.190204:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788361358.190226:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163712:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788361358.191671:0:31911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361358.192117:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361358.192179:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361358.192218:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8138be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361358.192269:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144163840 00000100:00100000:3.0:1788361358.192276:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144163840 00000100:00100000:3.0:1788361358.192312:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788361358.192320:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+16:31911:x1875232144163840:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361358.192724:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+16:31911:x1875232144163840:12345-0@lo:502:mount.lustre.0 Request processed in 403us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361358.192732:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361358.192803:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163840:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361358.194734:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:1.0:1788361358.194900:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:1.0:1788361358.194957:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:1.0:1788361358.195008:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:1.0:1788361358.195059:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:1.0:1788361358.195167:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:1.0:1788361358.195232:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:1.0:1788361358.195290:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:1.0:1788361358.195362:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:1.0:1788361358.195410:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:1.0:1788361358.195450:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:1.0:1788361358.195496:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:1.0:1788361358.195531:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:1.0:1788361358.195566:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:1.0:1788361358.195615:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:1.0:1788361358.195650:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:1.0:1788361358.195686:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:1.0:1788361358.195737:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:1.0:1788361358.195786:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:1.0:1788361358.195836:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:1.0:1788361358.195888:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:1.0:1788361358.195937:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:1.0:1788361358.195979:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:1.0:1788361358.196048:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:1.0:1788361358.196108:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 128 off12440 00000040:00080000:1.0:1788361358.196155:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12664 00000040:00080000:1.0:1788361358.196210:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12888 00000040:00080000:1.0:1788361358.196250:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off12968 00000040:00080000:1.0:1788361358.196286:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13192 00000040:00080000:1.0:1788361358.196334:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13416 00000040:00080000:1.0:1788361358.196370:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13504 00000040:00080000:1.0:1788361358.196403:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13632 00000040:00080000:1.0:1788361358.196430:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13776 00000040:00080000:1.0:1788361358.196469:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13904 00000040:00080000:1.0:1788361358.196503:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14128 00000040:00080000:1.0:1788361358.196550:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14352 00000040:00080000:1.0:1788361358.196583:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14432 00000040:00080000:1.0:1788361358.196619:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14656 00000040:00080000:1.0:1788361358.196664:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14880 00000040:00080000:1.0:1788361358.196710:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 120 off15000 00000100:00100000:1.0:1788361358.196759:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163968:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361358.196834:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361358.196883:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361358.197039:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144163968 00000100:00100000:2.0:1788361358.197047:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144163968 00000100:00100000:2.0:1788361358.197116:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788361358.197126:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+16:31911:x1875232144163968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361358.197372:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+16:31911:x1875232144163968:12345-0@lo:502:mount.lustre.0 Request processed in 248us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361358.197381:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788361358.199295:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144163968:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361358.199445:0:31911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 224 off15224 00000040:00080000:2.0:1788361358.199467:0:31911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788361358.202390:0:31934:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788361358.202406:0:31934:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a8ab7463380) 00000020:00000080:1.0:1788361358.202426:0:31934:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788361358.202726:0:31934:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8ac05c5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788361358.202731:0:31934:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8ac05c5800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788361358.202734:0:31934:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8ac05c5800 3 00010000:00080000:1.0:1788361358.202784:0:31934:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8ab745c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1788361358.205903:0:31934:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788361358.206023:0:31934:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788361358.206061:0:31934:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788361358.206082:0:31934:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf6a94c97d661396f 00000100:00080000:1.0:1788361358.206148:0:31934:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361358.206155:0:31934:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8ab745c800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361358.206307:0:31934:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a89859b2680 x1875232144164096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788361358.206332:0:31934:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788361358.206367:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144164096:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361358.206438:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361358.206528:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361358.206533:0:15670:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788361358.206535:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361358.206538:0:15670:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788361358.206602:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361358.206648:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144164096 00000100:00100000:2.0:1788361358.206655:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144164096 00000100:00100000:2.0:1788361358.206690:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361358.206699:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144164096:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788361358.206721:0:31280:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 748 last 0 00000020:00000080:2.0:1788361358.206750:0:31280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf6a94c97d6613976 00000004:00100000:2.0:1788361358.206766:0:31280:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788361358.206799:0:31280:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361358.206857:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875232144164096:12345-0@lo:38:llog_process_th.0 Request processed in 158us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361358.206867:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788361358.206895:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a89859b2680 x1875232144164096/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361358.206906:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361358.206913:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 6 00000100:00080000:1.0:1788361358.206920:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788361358.206935:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788361358.206938:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ab745c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788361358.206945:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144164096:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788361358.207203:0:31934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000020:01000000:1.0:1788361358.208157:0:31911:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788361358.208203:0:31911:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788361358.208222:0:31911:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.208233:0:31911:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788361358.208308:0:31911:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788361358.208311:0:31911:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361358.208313:0:31911:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361358.208315:0:31911:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361358.208317:0:31911:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361358.208318:0:31911:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361358.208319:0:31911:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361358.208321:0:31911:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361358.208323:0:31911:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788361358.208327:0:31911:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788361358.208330:0:31911:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361358.208331:0:31911:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361358.208332:0:31911:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361358.208333:0:31911:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361358.208334:0:31911:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361358.208336:0:31911:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361358.208337:0:31911:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361358.208338:0:31911:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361358.208340:0:31911:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788361358.208360:0:31911:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788361358.208378:0:31911:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144164352:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788361358.208437:0:31911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361358.208470:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144164352 00000100:00100000:1.0:1788361358.208477:0:31911:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86ae36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361358.208478:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144164352 00000100:00100000:3.0:1788361358.208525:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788361358.208539:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+16:31911:x1875232144164352:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788361358.208563:0:31272:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788361358.208575:0:31272:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788361358.210325:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144164224:0@lo:400:kworker.0 00000100:00100000:0.0:1788361358.210384:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361358.210455:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144164224 00000100:00100000:0.0:1788361358.210462:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144164224 00000100:00100000:0.0:1788361358.210498:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361358.210505:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144164224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361358.210557:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144164224:12345-0@lo:400:kworker.0 Request processed in 52us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361358.210564:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788361358.210607:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a898514ce00 x1875232144164224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361358.210621:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144164224:0@lo:400:kworker.0 20000000:01000000:3.0:1788361358.227952:0:31272:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788361358.227974:0:31272:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788361358.228032:0:31295:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361358.228037:0:31295:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361358.228057:0:31295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.228076:0:31295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66138ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66138e3 expref: 16 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.228114:0:31295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.228171:0:31295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66138ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66138e3 expref: 16 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.228187:0:31295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66138ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66138e3 expref: 16 pid: 31274 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361358.228202:0:31295:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31295:1875232144164480:0@lo:104: 00000100:00100000:1.0:1788361358.228261:0:31295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361358.228293:0:31295:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7d540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361358.228424:0:31263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144164480 00000100:00100000:2.0:1788361358.228431:0:31263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144164480 00000100:00100000:1.0:1788361358.228560:0:31262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361358.228569:0:31262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+3:31295:x1875232144164480:12345-0@lo:104: 00010000:00010000:1.0:1788361358.228582:0:31262:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361358.228634:0:31262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361358.228640:0:31262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+3:31295:x1875232144164480:12345-0@lo:104: Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361358.228647:0:31262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361358.228685:0:31295:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31295:1875232144164480:0@lo:104: 00010000:00010000:1.0:1788361358.228703:0:31295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.228750:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361358.228756:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.228764:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361358.228767:0:31268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.228776:0:31268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361358.228795:0:31268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361358.228800:0:31268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361358.228836:0:31268:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.228843:0:31268:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361358.228861:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.228868:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8987622600/0xf6a94c97d66138e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66138ea expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.228884:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361358.228886:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361358.228887:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361358.228902:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144164608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361358.228947:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361358.229009:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144164608 00000100:00100000:2.0:1788361358.229014:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144164608 00010000:00010000:2.0:1788361358.229031:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66138ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66138e3 expref: 17 pid: 31274 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361358.229051:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361358.229057:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a25ae0af-c16d-4164-9502-26eb1af82516+17:3311:x1875232144164608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361358.229068:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361358.229073:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66138ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66138e3 expref: 17 pid: 31274 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229120:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66138ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66138e3 expref: 17 pid: 31274 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229134:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573ee00/0xf6a94c97d66138ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66138e3 expref: 17 pid: 31274 timeout: 848 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229147:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229155:0:31265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361358.229168:0:31265:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001513037s 00010000:00010000:2.0:1788361358.229173:0:31265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229180:0:31265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229187:0:31265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229194:0:31265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229200:0:31265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361358.229203:0:31265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229211:0:31265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229229:0:31265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229238:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361358.229267:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a25ae0af-c16d-4164-9502-26eb1af82516+16:3311:x1875232144164608:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361358.229275:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361358.229302:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144164608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361358.229330:0:31295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229338:0:31295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361358.229344:0:31295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987623c00/0xf6a94c97d661397d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361358.242887:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+15:31911:x1875232144164352:12345-0@lo:253:mount.lustre.0 Request processed in 34342us (34443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361358.242902:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788361358.243029:0:31911:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:31911:1875232144164352:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788361358.243044:0:31911:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788361358.243047:0:31911:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361358.243049:0:31911:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361358.243050:0:31911:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361358.243065:0:31911:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361358.243066:0:31911:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361358.243067:0:31911:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361358.243069:0:31911:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361358.243071:0:31911:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361358.243072:0:31911:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788361358.243103:0:31911:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788361358.243527:0:31911:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361358.243686:0:31911:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788361358.243843:0:31911:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361358.244017:0:31911:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788361358.244224:0:31911:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361358.244401:0:31911:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788361358.245331:0:31911:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803776 00002000:00080000:2.0:1788361358.292819:0:31911:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788361358.292827:0:31911:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788361358.292930:0:31911:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788361358.292986:0:31911:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788361358.293005:0:31911:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788361358.293033:0:31911:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788361358.432455:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361359.264162:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361349/real 1788361349] req@ffff9a8a8926e680 x1875232144158336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361359.264184:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8a8926e680 x1875232144158336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361359.264198:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361349/real 1788361349] req@ffff9a8a8926f100 x1875232144158208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361359.264205:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8a8926f100 x1875232144158208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361359.264218:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361359.264237:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788361359.264241:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144158336:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788361359.264246:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361359.264251:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788361359.264262:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144158208:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788361359.264361:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361359.264365:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788361359.264368:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361359.264372:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 739 00000100:00080000:2.0:1788361359.264377:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788361359.264390:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8a89249000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361359.264413:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a898514c700 x1875232144164864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361359.264432:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788361359.264436:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788361359.264438:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788361359.264441:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 739 00000100:00080000:2.0:1788361359.264444:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788361359.264451:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a89879b4800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361359.264464:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a898514f100 x1875232144164992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361359.264589:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144165248:0@lo:400:kworker.0 00000100:00100000:1.0:1788361359.264650:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361359.264686:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144164736:0@lo:400:kworker.0 00000100:00100000:1.0:1788361359.264710:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361359.264720:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144165120:0@lo:400:kworker.0 00000100:00100000:0.0:1788361359.264730:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361359.264759:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361359.264788:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144164736 00000100:00100000:1.0:1788361359.264796:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144164864:0@lo:8:kworker.0 00000100:00100000:0.0:1788361359.264796:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144164736 00000100:00100000:1.0:1788361359.264833:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361359.264847:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788361359.264855:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144164992:0@lo:8:kworker.0 00000100:00100000:0.0:1788361359.264860:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+15:3312:x1875232144164736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361359.264884:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361359.264934:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+15:3312:x1875232144164736:12345-0@lo:400:kworker.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361359.264942:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788361359.264946:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144164864 00000100:00100000:1.0:1788361359.264952:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144164864 00000100:00100000:1.0:1788361359.264970:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144164992 00000100:00100000:1.0:1788361359.264972:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144164992 00000100:00100000:1.0:1788361359.264984:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361359.264989:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144164864:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788361359.265012:0:31912:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 749 last 0 00000020:00000080:1.0:1788361359.265044:0:31912:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6613984 00000100:00100000:0.0:1788361359.265048:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144165248 00000100:00100000:0.0:1788361359.265054:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144165248 00002000:00100000:1.0:1788361359.265058:0:31912:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a8abf243000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788361359.265064:0:31912:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788361359.265067:0:31912:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788361359.265109:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144165120 00000100:00100000:0.0:1788361359.265113:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144165120 00000100:00100000:0.0:1788361359.265135:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361359.265150:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144165248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361359.265196:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144165248:12345-0@lo:400:kworker.0 Request processed in 48us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361359.265210:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361359.265229:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361359.265236:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144165120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361359.265269:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144165120:12345-0@lo:400:kworker.0 Request processed in 34us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361359.265275:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361359.265321:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144164736:0@lo:400:kworker.0 00010000:00080000:0.0:1788361359.265366:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a898514ce00 x1875232144165120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361359.265378:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144165120:0@lo:400:kworker.0 00010000:00080000:0.0:1788361359.265391:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a898514e680 x1875232144165248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361359.265400:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144165248:0@lo:400:kworker.0 00002000:00080000:1.0:1788361359.265473:0:31912:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788361359.265494:0:31912:0:(import.c:65:import_set_state_nolock()) ffff9a8abf244800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361359.265541:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144164864:12345-0@lo:8:kworker.0 Request processed in 551us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361359.265549:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361359.265569:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361359.265573:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144164992:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788361359.265584:0:31912:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788361359.265697:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a898514c700 x1875232144164864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361359.265706:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788361359.265713:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 6 00000100:00080000:0.0:1788361359.265719:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788361359.265724:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788361359.265726:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788361359.265740:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788361359.265750:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144164864:0@lo:8:kworker.0 00000004:00080000:0.0:1788361359.265792:0:31302:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x82:0x0] 00000100:00100000:0.0:1788361359.265809:0:31302:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31302:1875232144165504:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788361359.265834:0:31302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361359.265845:0:31302:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90c9be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361359.265854:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361359.265862:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144165376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361359.265884:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361359.266801:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788361359.266968:0:31301:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788361359.267158:0:31914:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788361359.267168:0:31914:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788361359.267186:0:31913:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788361359.267196:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144165504 00000100:00100000:0.0:1788361359.267202:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144165504 00000100:00080000:0.0:1788361359.267319:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788361359.267379:0:31301:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 749282292602ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788361359.267483:0:31916:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144165376 00000100:00100000:3.0:1788361359.267488:0:31916:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144165376 00000100:00100000:3.0:1788361359.267556:0:31916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361359.267565:0:31916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144165376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361359.267584:0:31916:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361359.267648:0:31916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144165376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361359.267655:0:31916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361359.267769:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361359.267777:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:31302:x1875232144165504:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788361359.272395:0:32018:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788361359.272406:0:32018:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -31 00002000:02000040:0.0:1788361359.272412:0:32018:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:131 to 0x240000400:161) 00010000:00080000:3.0:1788361359.273146:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a84640e00 x1875232144165376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361359.273173:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84640e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144165376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361359.278200:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144164992:12345-0@lo:8:kworker.0 Request processed in 12601us (13292us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788361359.278217:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788361359.279553:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361359.279561:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361359.279566:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144164992:0@lo:8:kworker.0 00002000:00010000:0.0:1788361359.285688:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.285700:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d661398b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.285716:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa1:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.285721:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.285728:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d661398b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.285756:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d661398b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.285766:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d661398b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.285773:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d661398b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.285792:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361359.285806:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361359.285812:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d661398b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.285819:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.285823:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d661398b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.285832:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d661398b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.285846:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d661398b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.285853:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d661398b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.285877:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.285879:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.285880:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.286459:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.286466:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba78ea90/0xf6a94c97d6613992 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.286475:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa0:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.286478:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.286483:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba78ea90/0xf6a94c97d6613992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.286492:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba78ea90/0xf6a94c97d6613992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.286500:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba78ea90/0xf6a94c97d6613992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.286507:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba78ea90/0xf6a94c97d6613992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.286523:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361359.286532:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361359.286536:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba78ea90/0xf6a94c97d6613992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.286555:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.286558:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba78ea90/0xf6a94c97d6613992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.286565:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba78ea90/0xf6a94c97d6613992 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.286576:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba78ea90/0xf6a94c97d6613992 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.286583:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba78ea90/0xf6a94c97d6613992 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.286595:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.286597:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.286598:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.286988:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.286995:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d6613999 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287003:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9f:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.287006:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.287010:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d6613999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287060:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d6613999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287076:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d6613999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287141:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d6613999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287171:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361359.287180:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361359.287275:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d6613999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287283:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.287287:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d6613999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287295:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d6613999 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287307:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d6613999 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287315:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005638d9be/0xf6a94c97d6613999 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287335:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.287343:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.287346:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.287760:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.287766:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d66139a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287775:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9e:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.287778:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.287782:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d66139a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287792:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d66139a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287799:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d66139a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287806:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d66139a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.287831:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361359.288311:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.288317:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b99228eb/0xf6a94c97d66139a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288325:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9d:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.288328:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.288332:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b99228eb/0xf6a94c97d66139a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288349:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b99228eb/0xf6a94c97d66139a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288357:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b99228eb/0xf6a94c97d66139a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288364:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b99228eb/0xf6a94c97d66139a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288378:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361359.288388:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361359.288392:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d66139a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288400:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.288404:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d66139a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288411:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d66139a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288423:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d66139a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288430:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061b95aee/0xf6a94c97d66139a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288452:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361359.288456:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b99228eb/0xf6a94c97d66139a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288462:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.288465:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b99228eb/0xf6a94c97d66139a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288473:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b99228eb/0xf6a94c97d66139a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288482:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b99228eb/0xf6a94c97d66139a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288490:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b99228eb/0xf6a94c97d66139a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288500:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.288502:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.288504:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.288870:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.288876:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec90f2ea/0xf6a94c97d66139ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288884:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9c:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.288893:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.288897:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec90f2ea/0xf6a94c97d66139ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288906:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec90f2ea/0xf6a94c97d66139ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.288914:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec90f2ea/0xf6a94c97d66139ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361359.288976:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.289012:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec90f2ea/0xf6a94c97d66139ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.289028:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361359.289037:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361359.289041:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec90f2ea/0xf6a94c97d66139ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.289049:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.289052:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec90f2ea/0xf6a94c97d66139ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.289061:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec90f2ea/0xf6a94c97d66139ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.289073:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec90f2ea/0xf6a94c97d66139ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.289328:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec90f2ea/0xf6a94c97d66139ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.289342:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.289344:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.289345:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.289747:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.289753:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099b66c91/0xf6a94c97d66139b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.289762:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9b:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.289766:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.289770:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099b66c91/0xf6a94c97d66139b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.289780:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099b66c91/0xf6a94c97d66139b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.289788:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099b66c91/0xf6a94c97d66139b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.289795:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099b66c91/0xf6a94c97d66139b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.290277:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.290286:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099b66c91/0xf6a94c97d66139b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.290296:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.290302:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099b66c91/0xf6a94c97d66139b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.290312:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099b66c91/0xf6a94c97d66139b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.290333:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099b66c91/0xf6a94c97d66139b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.290355:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.290358:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.290362:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.291269:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361359.291276:0:32018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099b66c91/0xf6a94c97d66139b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361359.291794:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.291801:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec784060/0xf6a94c97d66139bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.291813:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9a:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.291817:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.291823:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec784060/0xf6a94c97d66139bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.291834:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec784060/0xf6a94c97d66139bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.291843:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec784060/0xf6a94c97d66139bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.291850:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec784060/0xf6a94c97d66139bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.291876:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.291953:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.291961:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec784060/0xf6a94c97d66139bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.291970:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.291974:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec784060/0xf6a94c97d66139bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.291984:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec784060/0xf6a94c97d66139bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.292000:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec784060/0xf6a94c97d66139bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.292008:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec784060/0xf6a94c97d66139bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.292032:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.292035:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.292037:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.294131:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.294144:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66139c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294156:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x99:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.294161:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.294173:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66139c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294257:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66139c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294269:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66139c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294281:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66139c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294301:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361359.294313:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361359.294322:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66139c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294330:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.294334:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66139c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294343:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66139c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294357:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66139c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294376:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ed158db/0xf6a94c97d66139c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294396:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.294398:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.294401:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.294871:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.294877:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d66139ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294885:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x98:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.294888:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.294892:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d66139ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294901:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d66139ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294908:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d66139ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294914:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d66139ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.294946:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.295262:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.295269:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d66139ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.295288:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.295292:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d66139ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.295299:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d66139ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.295311:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d66139ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.295317:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b6075e4/0xf6a94c97d66139ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.295332:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.295335:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.295337:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.295404:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.295415:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000961bece4/0xf6a94c97d66139d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.295423:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x97:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.295426:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.295430:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000961bece4/0xf6a94c97d66139d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.295440:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000961bece4/0xf6a94c97d66139d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.295448:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000961bece4/0xf6a94c97d66139d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.295455:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000961bece4/0xf6a94c97d66139d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.295474:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.295789:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.295795:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000961bece4/0xf6a94c97d66139d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.295803:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.295807:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000961bece4/0xf6a94c97d66139d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.295816:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000961bece4/0xf6a94c97d66139d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.295837:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000961bece4/0xf6a94c97d66139d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.295844:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000961bece4/0xf6a94c97d66139d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.295858:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.295860:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.295862:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.296756:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.296765:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d66139d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.296775:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x96:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.296778:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.296783:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d66139d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.296793:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d66139d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.296808:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d66139d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.296816:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d66139d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.296837:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.296878:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.296884:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d66139d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.296891:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.296896:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d66139d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.296904:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d66139d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.296925:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d66139d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.296933:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d260cc0/0xf6a94c97d66139d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.296961:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.296964:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.296967:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.297322:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.297329:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d66139df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.297337:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x95:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.297341:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.297345:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d66139df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.297355:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d66139df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.297364:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d66139df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.297371:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d66139df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.297402:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.297515:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.297522:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d66139df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.297694:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.297700:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d66139df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.297711:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d66139df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.297724:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d66139df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.297732:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000916e402f/0xf6a94c97d66139df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.297757:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.297760:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.297763:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.297810:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.297817:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1ccde01/0xf6a94c97d66139e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.297826:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x94:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.297828:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.297833:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ccde01/0xf6a94c97d66139e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.297842:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1ccde01/0xf6a94c97d66139e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.297850:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1ccde01/0xf6a94c97d66139e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.297857:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1ccde01/0xf6a94c97d66139e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.297876:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.297945:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.297950:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1ccde01/0xf6a94c97d66139e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.297970:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.297974:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ccde01/0xf6a94c97d66139e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.297982:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1ccde01/0xf6a94c97d66139e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.297995:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1ccde01/0xf6a94c97d66139e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.298002:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1ccde01/0xf6a94c97d66139e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.298018:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.298021:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.298023:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.298310:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.298317:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d66139ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.298325:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x93:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.298334:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.298339:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d66139ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.298349:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d66139ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.298356:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d66139ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.298363:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d66139ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.298378:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.298521:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.298536:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d66139ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.298544:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.298656:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d66139ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.298668:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d66139ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.298690:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d66139ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.298699:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2658fe8/0xf6a94c97d66139ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.298716:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.298719:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.298721:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.298784:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.298790:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d66139f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.298799:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x92:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.298802:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.298806:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d66139f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.298816:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d66139f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.298824:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d66139f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.298838:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d66139f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.298860:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361359.299435:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.299442:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d66139fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299451:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x91:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.299455:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.299459:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d66139fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299469:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d66139fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299477:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d66139fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299484:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d66139fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299501:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361359.299512:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361359.299517:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d66139f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299533:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.299537:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d66139f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299546:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d66139f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299559:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d66139f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299567:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d66139f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299581:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361359.299584:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d66139fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299592:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.299595:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d66139fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299603:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d66139fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299613:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d66139fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299627:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d66139fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.299640:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.299642:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.299643:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361359.299881:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.301411:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.301422:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6613a02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.301435:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x90:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.301440:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.301445:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6613a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.301455:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6613a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.301463:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6613a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.301470:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6613a02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.301533:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361359.301942:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.301952:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.301959:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8f:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.301962:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.301966:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.301975:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.301982:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.301989:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.302023:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361359.302030:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6613a02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.302037:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361359.302045:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6613a02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.302052:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6613a02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.302067:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6613a02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.302073:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0c03a6f/0xf6a94c97d6613a02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.302104:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361359.302107:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.302112:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361359.302114:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.302120:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.302126:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.302132:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361359.302137:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361359.302139:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.302340:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361359.302345:0:32018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.303296:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.303618:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.303625:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6613a10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.303636:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8e:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.303640:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.303651:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6613a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.303663:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6613a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.303672:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6613a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.303679:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6613a10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.303694:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361359.303789:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361359.303795:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6613a10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.303803:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361359.303807:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6613a10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.303815:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6613a10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.303829:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6613a10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.303837:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9033318/0xf6a94c97d6613a10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.303855:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361359.303857:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361359.303859:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.304172:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.304179:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613a17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.304187:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8d:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.304191:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.304195:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.304207:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.304215:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.304235:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.304252:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.304365:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.304372:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.304382:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.304386:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.304395:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613a17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.304410:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613a17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.304417:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613a17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.304451:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.304454:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.304456:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.304904:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.304911:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6613a1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.304930:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8c:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.304933:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.304938:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6613a1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.304947:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6613a1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.304955:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6613a1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.304962:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6613a1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.304993:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.305415:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.305421:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6613a1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.305430:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.305450:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6613a1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.305459:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6613a1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.305473:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6613a1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.305481:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cce3e1d3/0xf6a94c97d6613a1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.305511:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.305512:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361359.305514:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.305519:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.305521:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613a25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.305536:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8b:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.305539:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.305544:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613a25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.305554:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613a25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.305562:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613a25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.305569:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613a25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.305594:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.305669:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.305675:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613a25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.305695:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.305699:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613a25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.305708:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613a25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.305719:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613a25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.305726:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613a25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.305744:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.305746:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.305749:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.306169:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.306175:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306183:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8a:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.306187:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.306192:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306201:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306220:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306228:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306241:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361359.306249:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361359.306253:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306259:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.306263:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306271:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306282:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306289:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306303:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.306311:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.306313:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.306731:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.306736:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6613a33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306742:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x89:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.306744:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.306747:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6613a33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306754:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6613a33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306758:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6613a33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306763:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6613a33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.306947:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788361359.307592:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.307599:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.307608:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x88:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.307611:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.307615:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.307631:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.307640:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.307647:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.307750:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788361359.308176:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.308182:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.308191:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x87:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.308194:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.308198:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.308207:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.308215:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.308233:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308633:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788361359.308640:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6613a33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308649:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.308664:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6613a33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308674:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6613a33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308695:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6613a33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308702:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b54247/0xf6a94c97d6613a33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308719:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361359.308722:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308729:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.308732:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308740:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308748:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308755:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b3d20c/0xf6a94c97d6613a3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308766:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.308769:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308781:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.308784:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308792:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308802:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.308810:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.308811:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.308813:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.309201:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788361359.309207:0:32018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361359.310576:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.310576:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.311208:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.311217:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d6613a48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.311232:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x86:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.311236:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.311242:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d6613a48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.311254:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d6613a48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.311264:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d6613a48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.311271:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d6613a48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.311304:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.311695:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.311702:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d6613a48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.311711:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.311716:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d6613a48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.311724:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d6613a48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.311741:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d6613a48 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.311757:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4681dbf/0xf6a94c97d6613a48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.311779:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.311782:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.311784:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.312344:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.312351:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f5f6355/0xf6a94c97d6613a4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.312361:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x85:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.312365:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.312370:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f5f6355/0xf6a94c97d6613a4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.312380:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f5f6355/0xf6a94c97d6613a4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.312388:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f5f6355/0xf6a94c97d6613a4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.312394:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f5f6355/0xf6a94c97d6613a4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.312408:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361359.312417:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361359.312421:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f5f6355/0xf6a94c97d6613a4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.312427:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361359.312516:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f5f6355/0xf6a94c97d6613a4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.312524:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f5f6355/0xf6a94c97d6613a4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.312677:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f5f6355/0xf6a94c97d6613a4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.312685:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f5f6355/0xf6a94c97d6613a4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.312701:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.312703:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361359.312705:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.313391:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.313397:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.313404:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x84:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.313407:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.313410:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.313419:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.313425:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.313446:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.313458:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1788361359.313657:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788361359.313779:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.313786:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.313795:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.313800:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.313808:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.313822:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.313830:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000996e7b37/0xf6a94c97d6613a56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.313846:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.313848:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.313850:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788361359.314205:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361359.314212:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a5d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.314220:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x83:0x0].0x0 since=749s v=(0 0) 00010000:00010000:0.0:1788361359.314224:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361359.314227:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.314236:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.314244:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a5d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.314251:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.314272:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361359.314364:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361359.314435:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.314443:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361359.314447:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.314455:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.314468:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a5d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.314476:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070e40149/0xf6a94c97d6613a5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361359.314494:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.314496:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361359.314498:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788361359.314508:0:32018:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:130 00000100:00100000:0.0:1788361359.314724:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:31302:x1875232144165504:12345-0@lo:5:osp-pre-0-0.0 Request processed in 46945us (48885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361359.314760:0:31302:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31302:1875232144165504:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788361359.314774:0:31302:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0xa1:0x0] from OST, last_created [0x240000400:0xa1:0x0]last_used is [0x240000400:0x82:0x0] 00000100:00100000:2.0:1788361359.314818:0:31302:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31302:1875232144165632:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788361359.314819:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361359.314861:0:31302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361359.314945:0:31302:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8987ae6d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361359.314983:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144165632 00000100:00100000:1.0:1788361359.314990:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144165632 00000100:00100000:1.0:1788361359.315065:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361359.315075:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:31302:x1875232144165632:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788361359.315192:0:31913:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 162 00000100:00100000:1.0:1788361359.320497:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:31302:x1875232144165632:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5417us (5629us total) trans 25769803777 rc 0/0 00000100:00100000:1.0:1788361359.320511:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361359.320580:0:31302:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:31302:1875232144165632:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788361359.320595:0:31302:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xa1:0x0]-[0x240000400:0xc1:0x0] 00010000:00010000:3.0:1788361359.461380:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788361359.584257:0:31276:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788361359.584264:0:31276:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8986533800 from 19 10000000:01000000:1.0:1788361359.584269:0:31276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788361359.584315:0:31276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361359.584326:0:31276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361359.584336:0:31276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361359.584361:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144165760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788361359.584449:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361359.584568:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361359.587238:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144165760 00000100:00100000:0.0:1788361359.587253:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144165760 00000100:00100000:0.0:1788361359.587325:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788361359.587335:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+15:31276:x1875232144165760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361359.587351:0:31272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361359.587370:0:31272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964200/0xf6a94c97d6613a6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613a64 expref: -99 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.587395:0:31272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964200/0xf6a94c97d6613a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613a64 expref: 16 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.587405:0:31272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964200/0xf6a94c97d6613a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613a64 expref: 16 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361359.587414:0:31272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964200, rc 0) 00000100:00100000:0.0:1788361359.587485:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+16:31276:x1875232144165760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (3036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361359.587491:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788361359.587639:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144165760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361359.587657:0:31276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361359.587666:0:31276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361359.587736:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144165888:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788361359.587789:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361359.587826:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361359.589125:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144165888 00000100:00100000:0.0:1788361359.589135:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144165888 00000100:00100000:0.0:1788361359.589193:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361359.589201:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+16:31276:x1875232144165888:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788361359.589223:0:31274:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788361359.589247:0:31274:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788361359.589250:0:31274:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 19 00000100:00100000:0.0:1788361359.589349:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+16:31276:x1875232144165888:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 148us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361359.589356:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788361359.589699:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144165888:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788361359.589777:0:31276:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361359.589787:0:31276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361359.589797:0:31276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361360.480256:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361361.504213:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361361.760276:0:31311:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:2.0:1788361361.760287:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361361.760326:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 3 00000040:00080000:2.0:1788361361.760331:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000001:02000400:2.0:1788361362.290416:0:32279:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788361362.536889:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361363.552366:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788361363.684860:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803777 is committed 00000001:00100000:1.0:1788361363.684924:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788361364.576245:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788361364.641351:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361364.641357:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788361364.641361:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361364.641369:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 749 00000100:00080000:0.0:1788361364.641373:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788361364.641381:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a89879b4800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361364.641402:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a84641880 x1875232144166272/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361364.641447:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144166144:0@lo:400:kworker.0 00000100:00100000:0.0:1788361364.641508:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361364.641562:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144166016:0@lo:400:kworker.0 00000100:00100000:0.0:1788361364.641565:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361364.641573:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144166400:0@lo:400:kworker.0 00000100:00100000:3.0:1788361364.641609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361364.641614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361364.641650:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144166400 00000100:00100000:0.0:1788361364.641657:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144166400 00000100:00100000:0.0:1788361364.641698:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361364.641707:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144166400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361364.641755:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144166400:12345-0@lo:400:kworker.0 Request processed in 49us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361364.641762:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788361364.641815:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a84641c00 x1875232144166400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361364.641827:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144166400:0@lo:400:kworker.0 00000100:00100000:3.0:1788361364.641850:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361364.641857:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144166528:0@lo:400:kworker.0 00000100:00100000:0.0:1788361364.641867:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144166144 00000100:00100000:0.0:1788361364.641871:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144166144 00000100:00100000:3.0:1788361364.641896:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361364.641923:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361364.641931:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144166144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361364.641941:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144166272:0@lo:8:kworker.0 00000100:00100000:0.0:1788361364.641975:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144166144:12345-0@lo:400:kworker.0 Request processed in 45us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361364.641983:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361364.641988:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361364.642003:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144166272 00000100:00100000:0.0:1788361364.642006:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144166272 00000100:00100000:0.0:1788361364.642027:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361364.642032:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144166272:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788361364.642047:0:31912:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361364.642071:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144166016 00000100:00100000:3.0:1788361364.642075:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144166016 00000100:00100000:0.0:1788361364.642112:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144166272:12345-0@lo:8:kworker.0 Request processed in 51us (106us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788361364.642120:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361364.642131:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788361364.642140:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361364.642141:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+16:3312:x1875232144166016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361364.642162:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803777 gen 2 00000100:00100000:0.0:1788361364.642187:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144166144:0@lo:400:kworker.0 00000100:00100000:3.0:1788361364.642246:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+16:3312:x1875232144166016:12345-0@lo:400:kworker.0 Request processed in 107us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361364.642253:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361364.642288:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144166528 00000100:00100000:3.0:1788361364.642292:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144166528 00000100:00100000:3.0:1788361364.642339:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361364.642348:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144166528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361364.642380:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144166528:12345-0@lo:400:kworker.0 Request processed in 34us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361364.642386:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361364.642677:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361364.642689:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144166656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361364.642719:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361364.642752:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144166656 00000100:00100000:3.0:1788361364.642756:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144166656 00000100:00100000:3.0:1788361364.642783:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361364.642867:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144166656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361364.642912:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361364.642949:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144166656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361364.642956:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788361364.642977:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361364.643326:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144166656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788361364.643361:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788361364.643367:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788361364.643371:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144166272:0@lo:8:kworker.0 00010000:00080000:3.0:1788361364.643912:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a84642a00 x1875232144166528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361364.643925:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144166528:0@lo:400:kworker.0 00000100:00100000:3.0:1788361364.643967:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84642680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144166016:0@lo:400:kworker.0 00010000:00010000:2.0:1788361365.600531:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361366.404935:0:32581:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788361366.404938:0:32581:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788361366.405041:0:32581:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8a8a10e800 00000020:01000004:0.0:1788361366.405054:0:32581:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788361366.405065:0:32581:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788361366.405077:0:32581:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a8a90bf3380) 00000020:00000080:0.0:1788361366.405219:0:32581:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788361366.422068:0:32581:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788361366.422635:0:32581:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788361366.423512:0:32581:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788361366.423739:0:32581:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788361366.424062:0:32581:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xe:0x0] (8/32) 00100000:10000000:0.0:1788361366.424596:0:32581:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 589: rc = 0 00100000:10000000:0.0:1788361366.424693:0:32581:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 589: rc = 0 00100000:10000000:0.0:1788361366.424786:0:32581:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 589: rc = 0 00100000:10000000:0.0:1788361366.425473:0:32581:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 776: rc = 0 00100000:10000000:0.0:1788361366.425708:0:32581:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 776: rc = 0 00100000:10000000:0.0:1788361366.426036:0:32581:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 776: rc = 0 00100000:10000000:1.0:1788361366.426725:0:32581:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 776: rc = 0 00100000:10000000:1.0:1788361366.427010:0:32581:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 776: rc = 0 00100000:10000000:1.0:1788361366.427454:0:32581:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 776: rc = 0 00000020:00000080:1.0:1788361366.428072:0:32581:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788361366.428264:0:32581:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788361366.428283:0:32581:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d6613a79 00000020:01000004:1.0:1788361366.428291:0:32581:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788361366.428312:0:32581:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788361366.428316:0:32581:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788361366.428322:0:32581:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788361366.428342:0:32581:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788361366.428346:0:32581:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788361366.437572:0:32581:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788361366.437621:0:32581:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.160@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788361366.437626:0:32581:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788361366.437627:0:32581:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788361366.437629:0:32581:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361366.437630:0:32581:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361366.437631:0:32581:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361366.437633:0:32581:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361366.437634:0:32581:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361366.437636:0:32581:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361366.437637:0:32581:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361366.437641:0:32581:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788361366.437643:0:32581:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361366.437644:0:32581:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788361366.437645:0:32581:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361366.437646:0:32581:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361366.437647:0:32581:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361366.437648:0:32581:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361366.437649:0:32581:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361366.437651:0:32581:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361366.437652:0:32581:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361366.437676:0:32581:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788361366.437697:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144166784:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788361366.437762:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361366.437938:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361366.437982:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144166784 00000100:00100000:0.0:1788361366.437990:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144166784 00000100:00100000:0.0:1788361366.438108:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788361366.438118:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+16:32581:x1875232144166784:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361366.438164:0:31274:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788361366.438168:0:31274:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788361366.438172:0:31274:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788361366.443998:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+16:32581:x1875232144166784:12345-0@lo:253:mount.lustre.0 Request processed in 5873us (6227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361366.444011:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788361366.444181:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144166784:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788361366.444196:0:32581:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788361366.444199:0:32581:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788361366.444201:0:32581:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788361366.444202:0:32581:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361366.444203:0:32581:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361366.444204:0:32581:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361366.444206:0:32581:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361366.444207:0:32581:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361366.444209:0:32581:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361366.444210:0:32581:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788361366.444230:0:32581:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8a8a10e800 from lustre-OST0001 10000000:01000000:2.0:1788361366.444254:0:32581:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788361366.444256:0:32581:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788361366.444264:0:32581:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8a90bf19c0 local copy 00010000:00010000:2.0:1788361366.444273:0:32581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361366.444448:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144166912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361366.444479:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361366.444546:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361366.444663:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144166912 00000100:00100000:3.0:1788361366.444669:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144166912 00000100:00100000:3.0:1788361366.444731:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361366.444739:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+16:32581:x1875232144166912:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361366.445039:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+16:32581:x1875232144166912:12345-0@lo:501:mount.lustre.0 Request processed in 299us (558us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361366.445047:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788361366.445115:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144166912:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788361366.445128:0:32581:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788361366.445277:0:32581:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788361366.445289:0:32581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.445299:0:32581:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361366.445324:0:32581:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8a8a10e800 10000000:01000000:2.0:1788361366.445328:0:32581:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788361366.445334:0:32581:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788361366.445336:0:32581:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788361366.445341:0:32581:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788361366.445344:0:32581:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788361366.445366:0:32581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.445374:0:32581:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.445383:0:32581:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361366.445395:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788361366.445421:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361366.445705:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361366.445756:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144167040 00000100:00100000:0.0:1788361366.445760:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144167040 00000100:00100000:1.0:1788361366.445805:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788361366.445815:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+16:32581:x1875232144167040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361366.445826:0:31274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361366.445838:0:31274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987622200/0xf6a94c97d6613a87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613a80 expref: -99 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361366.445860:0:31274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987622200/0xf6a94c97d6613a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613a80 expref: 17 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361366.445882:0:31274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987622200/0xf6a94c97d6613a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613a80 expref: 17 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361366.445891:0:31274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622200, rc 0) 00000100:00100000:1.0:1788361366.445931:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+17:32581:x1875232144167040:12345-0@lo:101:mount.lustre.0 Request processed in 118us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361366.445938:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788361366.446065:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361366.446078:0:32581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.446102:0:32581:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361366.446673:0:32581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 11 count 11 00000040:00080000:2.0:1788361366.447543:0:32581:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361366.447770:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:2.0:1788361366.447813:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 128 off8544 00000040:00080000:2.0:1788361366.447846:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 112 off8656 00000040:00080000:2.0:1788361366.447912:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8880 00000040:00080000:2.0:1788361366.447952:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 224 off9104 00000040:00080000:2.0:1788361366.447986:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 80 off9184 00000040:00080000:2.0:1788361366.448036:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9408 00000040:00080000:2.0:1788361366.448073:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 224 off9632 00000040:00080000:2.0:1788361366.448148:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 120 off9752 00000040:00080000:2.0:1788361366.448203:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off9976 00000040:00080000:2.0:1788361366.448211:0:32581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 10 count 11 00000100:00100000:2.0:1788361366.448286:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361366.448343:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361366.448382:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361366.448599:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144167168 00000100:00100000:3.0:1788361366.448606:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144167168 00000100:00100000:3.0:1788361366.448646:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788361366.448654:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+17:32581:x1875232144167168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361366.449079:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+17:32581:x1875232144167168:12345-0@lo:501:mount.lustre.0 Request processed in 424us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361366.449109:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788361366.449473:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361366.449512:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361366.449553:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361366.449620:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361366.449706:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144167296 00000100:00100000:0.0:1788361366.449712:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144167296 00000100:00100000:0.0:1788361366.449772:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361366.449781:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+17:32581:x1875232144167296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361366.450120:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+17:32581:x1875232144167296:12345-0@lo:503:mount.lustre.0 Request processed in 340us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361366.450301:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167296:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788361366.450879:0:32581:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361366.450939:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361366.450987:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361366.451007:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8a0a3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361366.451114:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361366.451155:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144167424 00000100:00100000:0.0:1788361366.451160:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144167424 00000100:00100000:0.0:1788361366.451180:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788361366.451187:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+17:32581:x1875232144167424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361366.451351:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+17:32581:x1875232144167424:12345-0@lo:502:mount.lustre.0 Request processed in 163us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361366.451359:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788361366.451558:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361366.451762:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:2.0:1788361366.451820:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 128 off8544 00000040:00080000:2.0:1788361366.451856:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 112 off8656 00000040:00080000:2.0:1788361366.451917:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8880 00000040:00080000:2.0:1788361366.451954:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 224 off9104 00000040:00080000:2.0:1788361366.451988:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 80 off9184 00000040:00080000:2.0:1788361366.452033:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9408 00000040:00080000:2.0:1788361366.452069:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 224 off9632 00000040:00080000:2.0:1788361366.452331:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 120 off9752 00000100:00100000:2.0:1788361366.452360:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361366.452405:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361366.452426:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361366.452479:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144167552 00000100:00100000:0.0:1788361366.452484:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144167552 00000100:00100000:0.0:1788361366.452517:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788361366.452524:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+17:32581:x1875232144167552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361366.452669:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+17:32581:x1875232144167552:12345-0@lo:502:mount.lustre.0 Request processed in 145us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361366.452677:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788361366.452775:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361366.452848:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off9976 00000040:00080000:2.0:1788361366.452858:0:32581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788361366.453895:0:32582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788361366.453904:0:32582:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788361366.453910:0:32582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361366.453913:0:32582:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788361366.453920:0:32582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361366.453932:0:32582:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a8ab7464d40) 00000020:00000080:1.0:1788361366.453953:0:32582:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788361366.453958:0:32582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788361366.454013:0:32582:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a8a10e800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788361366.454020:0:32582:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788361366.454027:0:32582:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d6613a95 00010000:00010000:1.0:1788361366.458486:0:32582:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788361366.459000:0:32582:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 21474836481 00080000:10000000:1.0:1788361366.460826:0:32582:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xf:0x0] (8/8/4) registered 00000020:00000080:1.0:1788361366.463262:0:32582:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788361366.463275:0:32582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361366.463282:0:32582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361366.463285:0:32582:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788361366.463288:0:32582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361366.463292:0:32582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361366.463294:0:32582:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788361366.463297:0:32582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788361366.463298:0:32582:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788361366.463301:0:32582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361366.463303:0:32582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361366.463305:0:32582:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788361366.463307:0:32582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361366.463310:0:32582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361366.463311:0:32582:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788361366.463314:0:32582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788361366.463368:0:32582:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361366.463371:0:32582:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361366.463373:0:32582:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788361366.463376:0:32582:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 11 count 11 00000020:01000000:0.0:1788361366.463532:0:32581:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788361366.463563:0:32581:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788361366.463584:0:32581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.463595:0:32581:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361366.463603:0:32581:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a8a10e800 from 1 10000000:01000000:0.0:1788361366.463606:0:32581:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361366.463641:0:32581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.463660:0:32581:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.463673:0:32581:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361366.463698:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84642d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361366.463765:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361366.463909:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144167680 00000100:00100000:0.0:1788361366.463917:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144167680 00000100:00100000:0.0:1788361366.463960:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361366.463969:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+17:32581:x1875232144167680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361366.463983:0:31272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361366.463995:0:31272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965800/0xf6a94c97d6613aa3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613a9c expref: -99 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.464016:0:31272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965800/0xf6a94c97d6613aa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613a9c expref: 18 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.464027:0:31272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965800/0xf6a94c97d6613aa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613a9c expref: 18 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.464035:0:31272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965800, rc 0) 00000100:00100000:0.0:1788361366.464066:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144167680:12345-0@lo:101:mount.lustre.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361366.464073:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361366.464874:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8512eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361366.464905:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84642d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361366.464923:0:32581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.464933:0:32581:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361366.465647:0:32581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 10 count 10 00000040:00080000:0.0:1788361366.466604:0:32581:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361366.466905:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:0.0:1788361366.466941:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 112 off8528 00000040:00080000:0.0:1788361366.466978:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 224 off8752 00000040:00080000:0.0:1788361366.467004:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8976 00000040:00080000:0.0:1788361366.467027:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 112 off9088 00000040:00080000:0.0:1788361366.467061:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 224 off9312 00000040:00080000:0.0:1788361366.467113:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 224 off9536 00000040:00080000:0.0:1788361366.467142:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 128 off9664 00000040:00080000:0.0:1788361366.467194:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:0.0:1788361366.467201:0:32581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 9 count 10 00000100:00100000:0.0:1788361366.467279:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84642d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361366.467339:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361366.467375:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8512eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361366.467575:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144167808 00000100:00100000:3.0:1788361366.467583:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144167808 00000100:00100000:3.0:1788361366.467629:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788361366.467637:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144167808:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361366.467835:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144167808:12345-0@lo:501:mount.lustre.0 Request processed in 198us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361366.467842:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788361366.468022:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84642d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361366.468053:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167936:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361366.468117:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361366.468142:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361366.468258:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144167936 00000100:00100000:0.0:1788361366.468264:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144167936 00000100:00100000:0.0:1788361366.468294:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788361366.468300:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144167936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361366.468541:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144167936:12345-0@lo:503:mount.lustre.0 Request processed in 240us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361366.468546:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788361366.468643:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144167936:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361366.469119:0:32581:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361366.469237:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361366.469279:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361366.469298:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361366.469367:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144168064 00000100:00100000:0.0:1788361366.469372:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144168064 00000100:00100000:0.0:1788361366.469401:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788361366.469407:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144168064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361366.469549:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144168064:12345-0@lo:502:mount.lustre.0 Request processed in 141us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361366.469554:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788361366.469623:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361366.469791:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:3.0:1788361366.469904:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 112 off8528 00000040:00080000:3.0:1788361366.469942:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 224 off8752 00000040:00080000:3.0:1788361366.469969:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8976 00000040:00080000:3.0:1788361366.469993:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 112 off9088 00000040:00080000:3.0:1788361366.470025:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 224 off9312 00000040:00080000:3.0:1788361366.470051:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 224 off9536 00000040:00080000:3.0:1788361366.470074:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 128 off9664 00000100:00100000:3.0:1788361366.470114:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361366.470214:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361366.470237:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361366.470304:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144168192 00000100:00100000:1.0:1788361366.470315:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144168192 00000100:00100000:1.0:1788361366.470341:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788361366.470347:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144168192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361366.470565:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144168192:12345-0@lo:502:mount.lustre.0 Request processed in 217us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361366.470574:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788361366.474316:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168192:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361366.474479:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:3.0:1788361366.474495:0:32581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788361366.476768:0:32586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361366.476779:0:32586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361366.476782:0:32586:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788361366.476788:0:32586:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a8a10e800 00000020:00000080:2.0:1788361366.476791:0:32586:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788361366.476875:0:32586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361366.476880:0:32586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361366.476881:0:32586:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788361366.476884:0:32586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361366.476887:0:32586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361366.476888:0:32586:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788361366.476892:0:32586:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a8a10e800 00000020:00000080:2.0:1788361366.476894:0:32586:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788361366.476947:0:32586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361366.476951:0:32586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361366.476960:0:32586:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788361366.476963:0:32586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361366.476966:0:32586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361366.476968:0:32586:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788361366.476971:0:32586:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8a8a10e800 00000020:00000080:2.0:1788361366.476973:0:32586:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788361366.477011:0:32586:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361366.477015:0:32586:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361366.477017:0:32586:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788361366.477019:0:32586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000020:01000000:3.0:1788361366.477956:0:32581:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788361366.477991:0:32581:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361366.478014:0:32581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361366.478026:0:32581:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361366.478071:0:32581:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788361366.478074:0:32581:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a8a10e800 10000000:01000000:3.0:1788361366.478077:0:32581:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a8a10e800 10000000:01000000:3.0:1788361366.478081:0:32581:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361366.478113:0:32581:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a8a10e800 from 1 10000000:01000000:3.0:1788361366.478116:0:32581:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788361366.478262:0:32581:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361366.478272:0:32581:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361366.478284:0:32581:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361366.478307:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361366.478369:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361366.478443:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361366.481569:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144168320 00000100:00100000:1.0:1788361366.481582:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144168320 00000100:00100000:1.0:1788361366.481637:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788361366.481647:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144168320:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361366.481662:0:31272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361366.481678:0:31272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987623c00/0xf6a94c97d6613ab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613aaa expref: -99 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361366.481704:0:31272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987623c00/0xf6a94c97d6613ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613aaa expref: 19 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361366.481714:0:31272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987623c00/0xf6a94c97d6613ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613aaa expref: 19 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361366.481721:0:31272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623c00, rc 0) 00000100:00100000:1.0:1788361366.481790:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:32581:x1875232144168320:12345-0@lo:101:mount.lustre.0 Request processed in 146us (3421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361366.481806:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788361366.482265:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361366.482284:0:32581:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361366.482293:0:32581:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361366.482854:0:32581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 42 count 42 00000040:00080000:3.0:1788361366.483453:0:32581:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788361366.483684:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:3.0:1788361366.483728:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 120 off8536 00000040:00080000:3.0:1788361366.483764:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 168 off8704 00000040:00080000:3.0:1788361366.483899:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8928 00000040:00080000:3.0:1788361366.483941:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 224 off9152 00000040:00080000:3.0:1788361366.483991:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 120 off9272 00000040:00080000:3.0:1788361366.484027:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 168 off9440 00000040:00080000:3.0:1788361366.484059:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 224 off9664 00000040:00080000:3.0:1788361366.484131:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:3.0:1788361366.485298:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 120 off10008 00000040:00080000:3.0:1788361366.485338:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 224 off10232 00000040:00080000:3.0:1788361366.485395:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10456 00000040:00080000:3.0:1788361366.485432:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].13, 88 off10544 00000040:00080000:3.0:1788361366.485464:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].14, 128 off10672 00000040:00080000:3.0:1788361366.485508:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].15, 144 off10816 00000040:00080000:3.0:1788361366.485543:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].16, 160 off10976 00000040:00080000:3.0:1788361366.485574:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].17, 224 off11200 00000040:00080000:3.0:1788361366.485646:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].18, 224 off11424 00000040:00080000:3.0:1788361366.485682:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].19, 80 off11504 00000040:00080000:3.0:1788361366.485718:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].20, 224 off11728 00000040:00080000:3.0:1788361366.485764:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].21, 224 off11952 00000040:00080000:3.0:1788361366.486916:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].22, 88 off12040 00000040:00080000:3.0:1788361366.486985:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].23, 128 off12168 00000040:00080000:3.0:1788361366.487045:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].24, 144 off12312 00000040:00080000:3.0:1788361366.487081:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].25, 128 off12440 00000040:00080000:3.0:1788361366.487465:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].26, 224 off12664 00000040:00080000:3.0:1788361366.487520:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].27, 224 off12888 00000040:00080000:3.0:1788361366.487557:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].28, 80 off12968 00000040:00080000:3.0:1788361366.487603:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].29, 224 off13192 00000040:00080000:3.0:1788361366.487667:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].30, 224 off13416 00000040:00080000:3.0:1788361366.487703:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].31, 88 off13504 00000040:00080000:3.0:1788361366.487735:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].32, 128 off13632 00000040:00080000:3.0:1788361366.487766:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].33, 144 off13776 00000040:00080000:3.0:1788361366.488348:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].34, 128 off13904 00000040:00080000:3.0:1788361366.488390:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].35, 224 off14128 00000040:00080000:3.0:1788361366.488438:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].36, 224 off14352 00000040:00080000:3.0:1788361366.488472:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].37, 80 off14432 00000040:00080000:3.0:1788361366.488504:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].38, 224 off14656 00000040:00080000:3.0:1788361366.488549:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].39, 224 off14880 00000040:00080000:3.0:1788361366.488583:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].40, 120 off15000 00000040:00080000:3.0:1788361366.488674:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].41, 224 off15224 00000040:00080000:3.0:1788361366.488682:0:32581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 41 count 42 00000100:00100000:3.0:1788361366.488781:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361366.488858:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361366.488908:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361366.492946:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144168448 00000100:00100000:1.0:1788361366.492961:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144168448 00000100:00100000:1.0:1788361366.493062:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788361366.493073:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+19:32581:x1875232144168448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361366.493411:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+19:32581:x1875232144168448:12345-0@lo:501:mount.lustre.0 Request processed in 339us (4551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361366.493421:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788361366.493526:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361366.493574:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361366.493623:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361366.494257:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361366.495057:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144168576 00000100:00100000:2.0:1788361366.495065:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144168576 00000100:00100000:2.0:1788361366.495123:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788361366.495364:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:32581:x1875232144168576:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361366.496588:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:32581:x1875232144168576:12345-0@lo:503:mount.lustre.0 Request processed in 1453us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361366.496599:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788361366.496831:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168576:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788361366.498002:0:32581:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361366.498235:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361366.498288:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361366.498350:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361366.502941:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144168704 00000100:00100000:2.0:1788361366.502953:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144168704 00000100:00100000:2.0:1788361366.503098:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788361366.503109:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:32581:x1875232144168704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361366.504610:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:32581:x1875232144168704:12345-0@lo:502:mount.lustre.0 Request processed in 1497us (6315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361366.504621:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788361366.504643:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361366.504947:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:0.0:1788361366.505012:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 120 off8536 00000040:00080000:0.0:1788361366.505073:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 168 off8704 00000040:00080000:0.0:1788361366.505151:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8928 00000040:00080000:0.0:1788361366.505190:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 224 off9152 00000040:00080000:0.0:1788361366.505243:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 120 off9272 00000040:00080000:0.0:1788361366.505285:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 168 off9440 00000040:00080000:0.0:1788361366.505328:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 224 off9664 00000040:00080000:0.0:1788361366.505385:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:0.0:1788361366.505422:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 120 off10008 00000040:00080000:0.0:1788361366.505472:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 224 off10232 00000040:00080000:0.0:1788361366.505624:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10456 00000040:00080000:0.0:1788361366.505670:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].13, 88 off10544 00000040:00080000:0.0:1788361366.505717:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].14, 128 off10672 00000040:00080000:0.0:1788361366.505803:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].15, 144 off10816 00000040:00080000:2.0:1788361366.507459:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].16, 160 off10976 00000040:00080000:2.0:1788361366.507544:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].17, 224 off11200 00000040:00080000:2.0:1788361366.507613:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].18, 224 off11424 00000040:00080000:2.0:1788361366.507652:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].19, 80 off11504 00000040:00080000:2.0:1788361366.507688:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].20, 224 off11728 00000040:00080000:2.0:1788361366.507735:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].21, 224 off11952 00000040:00080000:2.0:1788361366.507911:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].22, 88 off12040 00000040:00080000:2.0:1788361366.507947:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].23, 128 off12168 00000040:00080000:2.0:1788361366.507995:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].24, 144 off12312 00000040:00080000:2.0:1788361366.508031:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].25, 128 off12440 00000040:00080000:2.0:1788361366.508064:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].26, 224 off12664 00000040:00080000:0.0:1788361366.508646:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].27, 224 off12888 00000040:00080000:0.0:1788361366.508694:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].28, 80 off12968 00000040:00080000:0.0:1788361366.508727:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].29, 224 off13192 00000040:00080000:0.0:1788361366.508810:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].30, 224 off13416 00000040:00080000:0.0:1788361366.508847:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].31, 88 off13504 00000040:00080000:0.0:1788361366.508893:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].32, 128 off13632 00000040:00080000:0.0:1788361366.508928:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].33, 144 off13776 00000040:00080000:0.0:1788361366.508987:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].34, 128 off13904 00000040:00080000:0.0:1788361366.509027:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].35, 224 off14128 00000040:00080000:0.0:1788361366.509074:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].36, 224 off14352 00000040:00080000:0.0:1788361366.509965:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].37, 80 off14432 00000040:00080000:0.0:1788361366.510027:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].38, 224 off14656 00000040:00080000:1.0:1788361366.510730:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].39, 224 off14880 00000040:00080000:1.0:1788361366.510857:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].40, 120 off15000 00000100:00100000:1.0:1788361366.510923:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168832:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361366.510993:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361366.511034:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab74459c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361366.511296:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144168832 00000100:00100000:0.0:1788361366.511304:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144168832 00000100:00100000:0.0:1788361366.511353:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788361366.511361:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+19:32581:x1875232144168832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361366.511589:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+19:32581:x1875232144168832:12345-0@lo:502:mount.lustre.0 Request processed in 228us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361366.511598:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788361366.511725:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144168832:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361366.511907:0:32581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].41, 224 off15224 00000040:00080000:1.0:1788361366.511928:0:32581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788361366.515446:0:32591:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788361366.515463:0:32591:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a8984a599c0) 00000020:00000080:3.0:1788361366.515496:0:32591:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788361366.515660:0:32591:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a8a10e800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788361366.515664:0:32591:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a8a10e800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788361366.515666:0:32591:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8a10e800 3 00010000:00080000:3.0:1788361366.515697:0:32591:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a856ee000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361366.519531:0:32591:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788361366.519658:0:32591:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788361366.519696:0:32591:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788361366.519708:0:32591:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf6a94c97d6613abf 00000100:00080000:3.0:1788361366.519719:0:32591:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361366.519725:0:32591:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a8a856ee000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361366.519756:0:32591:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a8926df80 x1875232144168960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361366.519834:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144168960:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361366.519914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361366.519977:0:32591:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788361366.520003:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144168960 00000100:00100000:2.0:1788361366.520021:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144168960 00000100:00080000:3.0:1788361366.520030:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361366.520036:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788361366.520039:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361366.520043:0:15670:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 754 00000100:00080000:3.0:1788361366.520048:0:15670:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788361366.520054:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a89879b4800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361366.520062:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361366.520069:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a8926d180 x1875232144169216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361366.520072:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144168960:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788361366.520124:0:31280:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 756 last 0 00000020:00000080:2.0:1788361366.520151:0:31280:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf6a94c97d6613ac6 00000004:00100000:2.0:1788361366.520163:0:31280:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788361366.520190:0:31280:0:(import.c:65:import_set_state_nolock()) ffff9a89852f5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361366.522190:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144169216:0@lo:8:kworker.0 00000100:00100000:0.0:1788361366.522256:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361366.522354:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144169216 00000100:00100000:1.0:1788361366.522361:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144169216 00000100:00100000:1.0:1788361366.522399:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361366.522405:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144169216:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788361366.522467:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144169216:12345-0@lo:8:kworker.0 Request processed in 59us (209us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788361366.522478:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361366.524967:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875232144168960:12345-0@lo:38:llog_process_th.0 Request processed in 4886us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361366.524981:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788361366.525546:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a8926df80 x1875232144168960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361366.525559:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788361366.525569:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 6 00000100:00080000:0.0:1788361366.525577:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788361366.525582:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788361366.525586:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a856ee000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788361366.525593:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144168960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788361366.525632:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788361366.525636:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788361366.525640:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788361366.525643:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144169216:0@lo:8:kworker.0 00000100:00100000:0.0:1788361366.526148:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144169088:0@lo:400:kworker.0 00000100:00100000:0.0:1788361366.526205:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361366.526520:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144169088 00000100:00100000:2.0:1788361366.526527:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144169088 00000100:00100000:2.0:1788361366.526575:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361366.526583:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144169088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361366.526637:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84640e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144169088:12345-0@lo:400:kworker.0 Request processed in 55us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361366.526643:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361366.526675:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144169088:0@lo:400:kworker.0 00000040:00080000:1.0:1788361366.528581:0:32591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000020:01000000:0.0:1788361366.528841:0:32581:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788361366.528887:0:32581:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788361366.528911:0:32581:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.528920:0:32581:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788361366.528962:0:32581:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788361366.528964:0:32581:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361366.528965:0:32581:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361366.528966:0:32581:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361366.528968:0:32581:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361366.528969:0:32581:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361366.528971:0:32581:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361366.528973:0:32581:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361366.528974:0:32581:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361366.528977:0:32581:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788361366.528980:0:32581:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788361366.528981:0:32581:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361366.528982:0:32581:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361366.528983:0:32581:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361366.528984:0:32581:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361366.528985:0:32581:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361366.528986:0:32581:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361366.528987:0:32581:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361366.528988:0:32581:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788361366.529011:0:32581:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788361366.529030:0:32581:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144169344:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788361366.529122:0:32581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361366.529159:0:32581:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83f11300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361366.529172:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144169344 00000100:00100000:2.0:1788361366.529181:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144169344 00000100:00100000:2.0:1788361366.529228:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788361366.529235:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:32581:x1875232144169344:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361366.529266:0:31272:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788361366.529278:0:31272:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1788361366.530262:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361366.530567:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361366.530584:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144169472:0@lo:400:kworker.0 00000100:00100000:2.0:1788361366.530637:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361366.531190:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144169472 00000100:00100000:0.0:1788361366.531205:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144169472 00000100:00100000:3.0:1788361366.531513:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144169600:0@lo:400:kworker.0 00000100:00100000:3.0:1788361366.531635:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361366.531700:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144169600 00000100:00100000:3.0:1788361366.531705:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144169600 00000100:00100000:3.0:1788361366.531830:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361366.531836:0:31281:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788361366.531841:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144169600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361366.531848:0:31281:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788361366.531911:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144169600:12345-0@lo:400:kworker.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361366.531918:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361366.532016:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361366.532024:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144169472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361366.532067:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144169472:12345-0@lo:400:kworker.0 Request processed in 44us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361366.532074:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788361366.532124:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788361366.532155:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a8926c700 x1875232144169600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361366.532171:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144169600:0@lo:400:kworker.0 00010000:00080000:3.0:1788361366.532210:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a8926ce00 x1875232144169472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361366.532219:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144169472:0@lo:400:kworker.0 20000000:01000000:3.0:1788361366.569612:0:31272:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788361366.569634:0:31272:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788361366.569661:0:31295:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788361366.569667:0:31295:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788361366.569688:0:31295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.569708:0:31295:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985964200/0xf6a94c97d6613a6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613a64 expref: 19 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.569715:0:31295:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.569754:0:31295:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985964200/0xf6a94c97d6613a6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6613a64 expref: 19 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.569767:0:31295:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985964200/0xf6a94c97d6613a6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6613a64 expref: 19 pid: 31272 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361366.569781:0:31295:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31295:1875232144169728:0@lo:104: 00000100:00100000:2.0:1788361366.569843:0:31295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361366.570458:0:31295:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa0acd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361366.570615:0:31263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144169728 00000100:00100000:3.0:1788361366.570622:0:31263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144169728 00000100:00100000:3.0:1788361366.570673:0:31263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361366.570682:0:31263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a25ae0af-c16d-4164-9502-26eb1af82516+3:31295:x1875232144169728:12345-0@lo:104: 00010000:00010000:3.0:1788361366.570696:0:31263:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361366.570777:0:31263:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788361366.570785:0:31263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a25ae0af-c16d-4164-9502-26eb1af82516+3:31295:x1875232144169728:12345-0@lo:104: Request processed in 104us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361366.570792:0:31263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788361366.571153:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361366.571161:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571169:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623600 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361366.571174:0:31267:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571183:0:31267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361366.571192:0:31267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361366.571198:0:31267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788361366.571245:0:31267:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571254:0:31267:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361366.571357:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571366:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8987623600/0xf6a94c97d6613a64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613a6b expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571391:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361366.571394:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361366.571395:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361366.571410:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144169856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361366.571457:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361366.571510:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144169856 00000100:00100000:0.0:1788361366.571515:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144169856 00010000:00010000:0.0:1788361366.571547:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985964200/0xf6a94c97d6613a6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613a64 expref: 20 pid: 31272 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361366.571568:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361366.571574:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a25ae0af-c16d-4164-9502-26eb1af82516+20:3312:x1875232144169856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361366.571584:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361366.571589:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985964200/0xf6a94c97d6613a6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613a64 expref: 20 pid: 31272 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571599:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985964200/0xf6a94c97d6613a6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6613a64 expref: 20 pid: 31272 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571616:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571626:0:31265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788361366.571639:0:31265:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001973089s 00010000:00010000:0.0:1788361366.571643:0:31265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571650:0:31265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571657:0:31265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571673:0:31265:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571680:0:31265:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361366.571684:0:31265:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571693:0:31265:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571702:0:31265:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361366.571712:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361366.571746:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a25ae0af-c16d-4164-9502-26eb1af82516+20:3312:x1875232144169856:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361366.571753:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361366.571786:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84643b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144169856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361366.571861:0:31295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964200/0xf6a94c97d6613a6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6613a64 expref: 19 pid: 31272 timeout: 856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361366.571880:0:31295:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:31295:1875232144169728:0@lo:104: 00010000:00010000:2.0:1788361366.571894:0:31295:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.571909:0:31295:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.571917:0:31295:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361366.571923:0:31295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b9e00/0xf6a94c97d6613acd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 31295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361366.579059:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+18:32581:x1875232144169344:12345-0@lo:253:mount.lustre.0 Request processed in 49814us (49928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361366.579073:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788361366.579211:0:32581:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a25ae0af-c16d-4164-9502-26eb1af82516:32581:1875232144169344:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788361366.579228:0:32581:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788361366.579232:0:32581:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788361366.579233:0:32581:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788361366.579234:0:32581:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788361366.579235:0:32581:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788361366.579237:0:32581:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788361366.579238:0:32581:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788361366.579240:0:32581:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788361366.579242:0:32581:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788361366.579243:0:32581:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788361366.579258:0:32581:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788361366.581028:0:32581:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361366.581452:0:32581:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361366.581694:0:32581:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361366.581849:0:32581:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788361366.582022:0:32581:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788361366.583745:0:32581:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788361366.585849:0:32581:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803776 00010000:00010000:2.0:1788361366.624599:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788361366.633300:0:32581:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788361366.633309:0:32581:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788361366.633339:0:32581:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788361366.633389:0:32581:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788361366.633401:0:32581:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788361366.633427:0:32581:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788361367.648630:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788361367.649574:0:31276:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788361367.649579:0:31276:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a8986533800 from 20 10000000:01000000:3.0:1788361367.649584:0:31276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788361367.649631:0:31276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361367.649644:0:31276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361367.649655:0:31276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361367.649682:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144169984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361367.649748:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361367.649852:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361367.649889:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144169984 00000100:00100000:0.0:1788361367.649897:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144169984 00000100:00100000:0.0:1788361367.649946:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788361367.650479:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+18:31276:x1875232144169984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361367.650494:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361367.650508:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965c00/0xf6a94c97d6613adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613ad4 expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361367.650530:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965c00/0xf6a94c97d6613adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613ad4 expref: 19 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361367.650541:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965c00/0xf6a94c97d6613adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613ad4 expref: 19 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361367.650550:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965c00, rc 0) 00000100:00100000:3.0:1788361367.650638:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144169984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361367.650653:0:31276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361367.650663:0:31276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361367.650727:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144170112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788361367.650761:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361367.650764:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+19:31276:x1875232144169984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 649us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361367.650781:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788361367.651151:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361367.651167:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144170112 00000100:00100000:0.0:1788361367.651174:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144170112 00000100:00100000:0.0:1788361367.651385:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788361367.651394:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+19:31276:x1875232144170112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788361367.651411:0:31271:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788361367.651426:0:31271:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788361367.651429:0:31271:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 20 00000100:00100000:0.0:1788361367.651518:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+19:31276:x1875232144170112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361367.651526:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788361367.651661:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144170112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361367.651716:0:31276:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361367.651723:0:31276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361367.651731:0:31276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361368.672374:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361369.696221:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361369.761302:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361369.761329:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144170240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361369.761450:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361369.761561:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144170240 00000100:00100000:0.0:1788361369.761570:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144170240 00000100:00100000:0.0:1788361369.761629:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361369.761639:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144170240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361369.761673:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361369.761715:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144170240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361369.761723:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361369.762232:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144170240:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788361369.762256:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788361370.421516:0:32939:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788361370.723124:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361371.728529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361371.728627:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130593920 00000100:00100000:2.0:1788361371.728637:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130593920 00000100:00100000:2.0:1788361371.728683:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:2.0:1788361371.728691:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1875232130593920:12345-192.168.203.60@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788361371.728722:0:31272:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 76414060-9cd0-4e10-991c-7eaed84bf288@192.168.203.60@tcp t0 exp 0000000000000000 cur 761 last 0 00000020:00000080:2.0:1788361371.728750:0:31272:0:(genops.c:1406:class_connect()) connect: client 76414060-9cd0-4e10-991c-7eaed84bf288, cookie 0xf6a94c97d6613ae2 00000100:00080000:2.0:1788361371.728900:0:31272:0:(import.c:65:import_set_state_nolock()) ffff9a89852f2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361371.729123:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+5:2348:x1875232130593920:12345-192.168.203.60@tcp:250:mount.lustre.0 Request processed in 394us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361371.729133:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:3.0:1788361371.739348:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361371.739452:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130594048 00000100:00100000:1.0:1788361371.739461:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130594048 00000100:00100000:1.0:1788361371.739505:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:1.0:1788361371.739514:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+5:27066:x1875232130594048:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788361371.739544:0:31274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361371.739560:0:31274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987623400/0xf6a94c97d6613ae9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eea8 expref: -99 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.739588:0:31274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987623400/0xf6a94c97d6613ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eea8 expref: 6 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.739600:0:31274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987623400/0xf6a94c97d6613ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eea8 expref: 6 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.739610:0:31274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623400, rc 0) 00000100:00100000:1.0:1788361371.739675:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+6:27066:x1875232130594048:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 162us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361371.739683:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:1.0:1788361371.741363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361371.741690:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130594176 00000100:00100000:2.0:1788361371.741846:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130594176 00000100:00100000:2.0:1788361371.741894:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788361371.741903:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+6:27066:x1875232130594176:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788361371.742291:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+6:27066:x1875232130594176:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 388us (932us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361371.742306:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00010000:00010000:0.0:1788361371.744224:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361371.745463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361371.745888:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130594304 00000100:00100000:1.0:1788361371.745898:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130594304 00000100:00100000:1.0:1788361371.745959:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:1.0:1788361371.745969:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+6:27066:x1875232130594304:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788361371.745985:0:31274:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361371.746001:0:31274:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987622e00/0xf6a94c97d6613af0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eeaf expref: -99 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.746029:0:31274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987622e00/0xf6a94c97d6613af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eeaf expref: 7 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.746041:0:31274:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987622e00/0xf6a94c97d6613af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eeaf expref: 7 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.746067:0:31274:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622e00, rc 0) 00000100:00100000:1.0:1788361371.746272:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+7:27066:x1875232130594304:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 303us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361371.746279:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1788361371.749349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361371.749446:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130594432 00000100:00100000:2.0:1788361371.749456:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130594432 00000100:00100000:2.0:1788361371.749511:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:2.0:1788361371.749520:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+7:27066:x1875232130594432:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788361371.749792:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+8:27066:x1875232130594432:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 272us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361371.749801:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:2.0:1788361371.751439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361371.751532:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130594560 00000100:00100000:0.0:1788361371.751541:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130594560 00000100:00100000:0.0:1788361371.751590:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:0.0:1788361371.751599:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+8:27066:x1875232130594560:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788361371.751799:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+8:27066:x1875232130594560:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 200us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361371.751813:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:0.0:1788361371.755011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361371.755114:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130594688 00000100:00100000:2.0:1788361371.755125:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130594688 00000100:00100000:2.0:1788361371.755204:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:2.0:1788361371.755213:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+8:27084:x1875232130594688:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361371.755462:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+8:27084:x1875232130594688:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 250us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361371.755469:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:3.0:1788361371.764258:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361371.764948:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130594816 00000100:00100000:1.0:1788361371.764959:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130594816 00000100:00100000:1.0:1788361371.765072:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:1.0:1788361371.765082:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+8:27084:x1875232130594816:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361371.765395:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+8:27084:x1875232130594816:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 313us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361371.765403:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:1.0:1788361371.770561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361371.770681:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130594944 00000100:00100000:2.0:1788361371.770692:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130594944 00000100:00100000:2.0:1788361371.770792:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1788361371.770802:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+8:27066:x1875232130594944:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788361371.770842:0:31272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361371.770862:0:31272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8400/0xf6a94c97d6613af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eed9 expref: -99 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.770920:0:31272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8400/0xf6a94c97d6613af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eed9 expref: 9 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.770932:0:31272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b8400/0xf6a94c97d6613af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eed9 expref: 9 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.770941:0:31272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8400, rc 0) 00000100:00100000:2.0:1788361371.770994:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+9:27066:x1875232130594944:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 193us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361371.771001:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1788361371.778341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361371.778680:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130595072 00000100:00100000:1.0:1788361371.778690:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130595072 00000100:00100000:1.0:1788361371.778748:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1788361371.778757:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+9:27066:x1875232130595072:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788361371.778780:0:31274:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788361371.778802:0:31274:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788361371.778806:0:31274:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788361371.778810:0:31274:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788361371.778812:0:31274:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 20 00000100:00100000:1.0:1788361371.780309:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+9:27066:x1875232130595072:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 1546us (1970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361371.780322:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788361371.783965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361371.784250:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130595200 00000100:00100000:3.0:1788361371.784264:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130595200 00000100:00100000:3.0:1788361371.784315:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788361371.784324:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+9:27066:x1875232130595200:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361371.784341:0:31272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361371.784358:0:31272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6613afe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eee0 expref: -99 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.784400:0:31272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6613afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eee0 expref: 10 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.784412:0:31272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6613afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eee0 expref: 10 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.784421:0:31272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca800, rc 0) 00000100:00100000:3.0:1788361371.784484:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+10:27066:x1875232130595200:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 160us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361371.784492:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:2.0:1788361371.787160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361371.787641:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130595328 00000100:00100000:1.0:1788361371.787674:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130595328 00000100:00100000:1.0:1788361371.787730:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:1.0:1788361371.787739:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+10:27066:x1875232130595328:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788361371.788034:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+10:27066:x1875232130595328:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 289us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361371.788040:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:0.0:1788361371.791066:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361371.791434:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130595456 00000100:00100000:3.0:1788361371.791445:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130595456 00000100:00100000:3.0:1788361371.791571:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1788361371.791581:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+10:27066:x1875232130595456:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788361371.791800:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+10:27066:x1875232130595456:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 220us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361371.791809:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:2.0:1788361371.794142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361371.794226:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130595584 00000100:00100000:1.0:1788361371.794234:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130595584 00000100:00100000:1.0:1788361371.794341:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1788361371.794352:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+10:27088:x1875232130595584:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361371.794551:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+10:27088:x1875232130595584:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 201us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361371.794560:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:2.0:1788361371.802131:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361371.802224:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130595712 00000100:00100000:3.0:1788361371.802234:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130595712 00000100:00100000:3.0:1788361371.802301:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788361371.802312:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+10:27088:x1875232130595712:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788361371.802584:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+10:27088:x1875232130595712:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 273us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361371.802592:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:0.0:1788361371.808038:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00080000:1.0:1788361371.809425:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788361371.809431:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788361371.809434:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361371.809446:0:15670:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a89879b4800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361371.809469:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a89859b3b80 x1875232144170624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361371.809473:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144170496:0@lo:400:kworker.0 00000100:00100000:0.0:1788361371.809533:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361371.809594:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144170496 00000100:00100000:1.0:1788361371.809602:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144170496 00000100:00100000:3.0:1788361371.809634:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130595840 00000100:00100000:3.0:1788361371.809651:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130595840 00000100:00100000:3.0:1788361371.809691:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25ae0af-c16d-4164-9502-26eb1af82516:3314:1875232144170368:0@lo:400:kworker.0 00000100:00100000:3.0:1788361371.809728:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361371.810066:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144170624:0@lo:8:kworker.0 00000100:00100000:1.0:1788361371.810068:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361371.810123:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361371.810124:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361371.810157:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144170624 00000100:00100000:0.0:1788361371.810162:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144170624 00000100:00100000:2.0:1788361371.810176:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361371.810183:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1875232130595840:12345-192.168.203.60@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788361371.810190:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361371.810196:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144170624:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788361371.810209:0:31280:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp t0 exp 0000000000000000 cur 761 last 0 00010000:00080000:0.0:1788361371.810217:0:31913:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 761 last 0 00000020:00000080:0.0:1788361371.810252:0:31913:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6613b05 00000020:00000080:2.0:1788361371.810259:0:31280:0:(genops.c:1406:class_connect()) connect: client 7b6b2b85-840a-4c64-a4e4-54d135f64238, cookie 0xf6a94c97d6613b0c 00002000:00100000:0.0:1788361371.810269:0:31913:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a8a89868000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788361371.810274:0:31913:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788361371.810277:0:31913:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000004:00100000:2.0:1788361371.810287:0:31280:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788361371.810293:0:31280:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803776 00000100:00100000:1.0:1788361371.810518:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144170496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361371.810596:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144170496:12345-0@lo:400:kworker.0 Request processed in 515us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361371.810614:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00080000:0.0:1788361371.810619:0:31913:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788361371.810653:0:31913:0:(import.c:65:import_set_state_nolock()) ffff9a8a8986a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361371.810697:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144170624:12345-0@lo:8:kworker.0 Request processed in 499us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361371.810704:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788361371.810754:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a89859b3b80 x1875232144170624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361371.810770:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 6 00000100:00100000:1.0:1788361371.810779:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144170752:0@lo:400:kworker.0 00000100:00080000:0.0:1788361371.810784:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788361371.810790:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788361371.810793:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788361371.810808:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788361371.810814:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144170624:0@lo:8:kworker.0 00000100:00100000:0.0:1788361371.810858:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144170880:0@lo:400:kworker.0 00000100:00100000:0.0:1788361371.810886:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361371.810906:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361371.810912:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144171008:0@lo:400:kworker.0 00000100:00100000:0.0:1788361371.810933:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361371.810969:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144170368 00000100:00100000:1.0:1788361371.810974:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361371.810975:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144170368 00000100:00100000:0.0:1788361371.811007:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000004:00080000:1.0:1788361371.811009:0:31303:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788361371.811016:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+19:3314:x1875232144170368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361371.811052:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+19:3314:x1875232144170368:12345-0@lo:400:kworker.0 Request processed in 37us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361371.811059:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788361371.811133:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144170880 00000100:00100000:0.0:1788361371.811138:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144170880 00000100:00100000:0.0:1788361371.811162:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144171008 00000100:00100000:0.0:1788361371.811164:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144171008 00000100:00100000:0.0:1788361371.811176:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144170752 00000100:00100000:0.0:1788361371.811178:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144170752 00000100:00100000:0.0:1788361371.811191:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788361371.811198:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144170880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361371.811237:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144170880:12345-0@lo:400:kworker.0 Request processed in 40us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361371.811254:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788361371.811271:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361371.811278:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144171008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361371.811311:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144171008:12345-0@lo:400:kworker.0 Request processed in 34us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361371.811316:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361371.811329:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361371.811335:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144170752:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361371.811365:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361371.811366:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144170752:12345-0@lo:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361371.811375:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361371.811396:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144170496:0@lo:400:kworker.0 00010000:00080000:0.0:1788361371.811415:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a89859b2a00 x1875232144170752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361371.811427:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144170752:0@lo:400:kworker.0 00010000:00080000:0.0:1788361371.811460:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a89859b3100 x1875232144171008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361371.811469:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144171008:0@lo:400:kworker.0 00010000:00080000:0.0:1788361371.811480:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a89859b1f80 x1875232144170880/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788361371.811481:0:31303:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 761826394007ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788361371.811494:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144170880:0@lo:400:kworker.0 00000004:00080000:1.0:1788361371.811642:0:31304:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x62:0x0] 00000100:00100000:3.0:1788361371.811700:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25ae0af-c16d-4164-9502-26eb1af82516:3314:1875232144170368:0@lo:400:kworker.0 00000100:00100000:0.0:1788361371.811783:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361371.811793:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144171136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361371.811825:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361371.811871:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144171136 00000100:00100000:0.0:1788361371.811875:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144171136 00000100:00100000:0.0:1788361371.811908:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361371.811915:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144171136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361371.811967:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00080000:2.0:1788361371.811991:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361371.812009:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144171136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361371.812016:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788361371.812045:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a89859b2300 x1875232144171136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361371.812059:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144171136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361371.812624:0:31304:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:31304:1875232144171264:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788361371.812660:0:31304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361371.812691:0:31304:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8987026a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361371.812811:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144171264 00000100:00100000:2.0:1788361371.812817:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144171264 00000100:00100000:2.0:1788361371.812924:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361371.812961:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:31304:x1875232144171264:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788361371.816762:0:32018:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788361371.816772:0:32018:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 161 -> diff = -63 00002000:02000040:2.0:1788361371.816776:0:32018:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:99 to 0x280000400:161) 00002000:00010000:2.0:1788361371.829174:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.829187:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.829206:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa1:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.829211:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.829218:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.829235:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.829246:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.829254:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.829272:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361371.829724:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.829738:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.829748:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa0:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.829752:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.829756:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.829766:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.829774:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.829782:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.830227:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788361371.830653:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.830659:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.830669:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9f:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.830672:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.830677:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.830687:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.830703:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.830711:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830846:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361371.830855:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830865:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.830869:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830880:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830899:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830908:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830937:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361371.830941:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830947:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.830950:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830959:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830969:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830977:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830989:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361371.830992:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.830998:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.831001:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.831021:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b21 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.831032:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b21 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.831039:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.831041:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.831043:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361371.834420:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.834779:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361371.834790:0:32018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.835182:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.835626:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.835634:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.835649:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9e:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.835653:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.835660:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.835674:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.835685:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.835705:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.835719:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361371.836211:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361371.836219:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.836228:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361371.836233:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.836243:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.836263:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.836281:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.836298:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361371.836300:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361371.836302:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.837718:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.837733:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.837749:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9d:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.837754:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.837761:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.837786:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.837797:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.837806:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.837826:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361371.837851:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361371.837857:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.837876:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361371.837881:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.837890:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.837904:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.837909:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.837923:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.837924:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.837925:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.838544:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.838551:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.838560:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9c:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.838564:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.838569:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.838580:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.838595:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.838606:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.838623:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361371.838861:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361371.838869:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.838878:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361371.838883:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.838892:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.838905:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.838912:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.838929:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361371.838930:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361371.838932:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.839377:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.839384:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6613b3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.839394:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9b:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.839398:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.839403:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6613b3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.839414:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6613b3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.839422:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6613b3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.839430:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6613b3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.839509:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361371.839953:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.839959:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088552a12/0xf6a94c97d6613b44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.839968:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9a:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.839971:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.839975:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088552a12/0xf6a94c97d6613b44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.839984:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088552a12/0xf6a94c97d6613b44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.839991:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088552a12/0xf6a94c97d6613b44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.839998:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088552a12/0xf6a94c97d6613b44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.840029:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361371.840036:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6613b3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.840044:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361371.840049:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6613b3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.840058:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6613b3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.840071:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6613b3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.840078:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6613b3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.840117:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361371.840121:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088552a12/0xf6a94c97d6613b44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.840127:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361371.840131:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088552a12/0xf6a94c97d6613b44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.840138:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088552a12/0xf6a94c97d6613b44 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.840162:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088552a12/0xf6a94c97d6613b44 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.840171:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361371.840173:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361371.840175:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.840247:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361371.840252:0:32018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088552a12/0xf6a94c97d6613b44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361371.840677:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x99:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.840683:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.840698:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x99:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.840701:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x99:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.840707:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.840718:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.840726:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.840735:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.840757:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361371.840760:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361371.840768:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.840769:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.840781:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361371.840786:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.840795:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.840812:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.840819:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613b4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x99:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.840855:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.840858:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.840861:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.841239:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x98:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.841245:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d6613b52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841254:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x98:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.841257:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x98:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.841262:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d6613b52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841272:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d6613b52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841287:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d6613b52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841294:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d6613b52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841309:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361371.841319:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361371.841323:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d6613b52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841331:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361371.841334:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d6613b52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841342:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d6613b52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841354:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d6613b52 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841361:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d6613b52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841375:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.841383:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.841385:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.841812:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x97:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.841819:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613b59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841827:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x97:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.841842:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x97:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.841847:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613b59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841857:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613b59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841865:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613b59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841872:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613b59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.841884:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361371.842336:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x96:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.842341:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.842347:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x96:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.842350:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x96:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.842354:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.842373:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.842381:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.842388:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.842413:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361371.842610:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361371.842618:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613b59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842639:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361371.842644:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613b59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842653:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613b59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842667:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613b59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842674:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613b59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842693:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361371.842696:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842703:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361371.842707:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842714:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842722:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842734:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613b60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842746:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.842748:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.842750:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.842784:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x95:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.842789:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.842795:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x95:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.842797:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x95:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.842799:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.842805:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.842810:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.842824:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.842849:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361371.842934:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361371.842940:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842948:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361371.842952:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842960:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842972:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b67 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842979:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b58f8900/0xf6a94c97d6613b67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.842997:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.843000:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.843002:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.843321:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x94:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.843327:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.843338:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x94:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.843341:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x94:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.843345:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.843354:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.843362:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.843369:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.843384:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361371.843443:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361371.843449:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.843457:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361371.843461:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.843470:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.843482:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.843491:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6613b6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.843508:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.843510:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.843512:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.843796:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x93:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.843802:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.843817:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x93:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.843820:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x93:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.843824:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.843845:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.843853:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.843860:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.843871:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361371.843880:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361371.843888:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.843896:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361371.843900:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.843913:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.843926:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b75 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.843934:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079fb94c3/0xf6a94c97d6613b75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.843949:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361371.843951:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361371.843952:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.844349:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x92:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.844356:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.844364:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x92:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.844367:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x92:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.844370:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.844378:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.844396:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.844402:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.844421:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361371.844489:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361371.844496:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.844504:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361371.844507:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.844529:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.844543:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.844551:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa506186/0xf6a94c97d6613b7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x92:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.844570:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.844573:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.844574:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.844712:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.844864:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x91:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.844870:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d6613b83 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.844878:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x91:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.844881:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x91:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.844885:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d6613b83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.844894:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d6613b83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.844901:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d6613b83 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.844908:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d6613b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.844944:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361371.845361:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x90:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.845366:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d6613b8a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.845374:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x90:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.845377:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x90:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.845381:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d6613b8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.845390:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d6613b8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.845398:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d6613b8a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.845406:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d6613b8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.845425:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788361371.845786:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.845793:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d6613b91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.845800:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8f:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.845809:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.845814:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d6613b91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.845824:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d6613b91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.845896:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361371.845904:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d6613b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.845911:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cee00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.845915:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d6613b83 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.845922:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d6613b83 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.845938:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d6613b83 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.845945:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d6613b83 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x91:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.845976:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361371.845979:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d6613b8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.845985:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.845988:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d6613b8a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.845995:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d6613b8a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846005:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d6613b8a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846012:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d6613b8a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x90:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846026:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.846027:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.846028:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.846052:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d6613b91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.846057:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d6613b91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.846106:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361371.846522:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.846528:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d6613b98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.846537:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8e:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.846540:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.846544:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d6613b98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.846554:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d6613b98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.846561:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d6613b98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.846575:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d6613b98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846636:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361371.846641:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d6613b91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846648:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.846657:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d6613b91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846665:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d6613b91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846675:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d6613b91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846683:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d6613b91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846698:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361371.846701:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d6613b98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846706:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.846709:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d6613b98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846715:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d6613b98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846724:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d6613b98 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.846732:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.846738:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.846740:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.847204:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361371.847211:0:32018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d6613b98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.847222:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.847734:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.847741:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c7cde27/0xf6a94c97d6613b9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.847752:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8d:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.847755:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.847759:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c7cde27/0xf6a94c97d6613b9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.847768:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c7cde27/0xf6a94c97d6613b9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.847776:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c7cde27/0xf6a94c97d6613b9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.847783:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c7cde27/0xf6a94c97d6613b9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.847824:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361371.847829:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c7cde27/0xf6a94c97d6613b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.847846:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.847850:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c7cde27/0xf6a94c97d6613b9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.847858:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c7cde27/0xf6a94c97d6613b9f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.847871:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c7cde27/0xf6a94c97d6613b9f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.847879:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.847881:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.847882:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.847913:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361371.847918:0:32018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c7cde27/0xf6a94c97d6613b9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.847938:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.848422:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.848429:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6613ba6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.848438:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8c:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.848442:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.848446:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6613ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.848455:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6613ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.848463:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6613ba6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.848471:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6613ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.848522:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361371.848954:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.848960:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d6613bad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.848978:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8b:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.848980:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.848984:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d6613bad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.848993:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d6613bad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.849000:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d6613bad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.849008:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d6613bad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.849035:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361371.849043:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6613ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.849052:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.849061:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6613ba6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.849071:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6613ba6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.849074:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361371.849119:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6613ba6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.849129:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6613ba6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.849233:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361371.849241:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d6613bad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.849250:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361371.849254:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d6613bad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.849264:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d6613bad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.849283:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d6613bad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.849303:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d6613bad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.849320:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.849324:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.849326:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.849904:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.849912:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d6613bb4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.849927:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8a:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.849931:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.849936:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d6613bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.849941:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.849943:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.849945:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.849947:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d6613bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.849967:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d6613bb4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.849975:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d6613bb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.849994:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361371.850049:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361371.850057:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d6613bb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.850066:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361371.850070:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d6613bb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.850079:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d6613bb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361371.850598:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x89:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.850603:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6613bbb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.850611:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x89:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.850613:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x89:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.850617:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6613bbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.850625:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6613bbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.850630:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6613bbb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.850635:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6613bbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.850656:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361371.850679:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361371.850850:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.850859:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6613bbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.850868:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.850873:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6613bbb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.850882:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6613bbb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.850900:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6613bbb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.850907:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d6613bbb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x89:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.850944:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.850947:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.850950:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.850957:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.850960:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.851440:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x88:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.851446:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d6613bc2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.851453:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x88:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.851456:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x88:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.851459:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d6613bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.851467:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d6613bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.851472:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d6613bc2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.851478:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d6613bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.851492:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361371.851516:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361371.851522:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d6613bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.851531:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.851535:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d6613bc2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.851544:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d6613bc2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.851557:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d6613bc2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.851565:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d6613bc2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x88:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.851590:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.851592:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.851596:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.852263:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x87:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.852271:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6613bc9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.852280:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x87:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.852288:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x87:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.852293:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6613bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.852303:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6613bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.852312:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6613bc9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.852319:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6613bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.852337:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361371.852369:0:33055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361371.852387:0:33055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6613bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.852399:0:33055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.852404:0:33055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6613bc9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.852415:0:33055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6613bc9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.852435:0:33055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6613bc9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.852450:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6613bc9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x87:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.852485:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.852496:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.852502:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.853159:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d6613bb4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.853168:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008234d806/0xf6a94c97d6613bb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.853208:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.853211:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.853214:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.853295:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x86:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.853302:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d6613bd0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.853311:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x86:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.853315:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x86:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.853320:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d6613bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.853330:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d6613bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.853340:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d6613bd0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.853438:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d6613bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361371.853473:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00080000:2.0:1788361371.854047:0:31280:0:(import.c:65:import_set_state_nolock()) ffff9a89852f6800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361371.854153:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2348:x1875232130595840:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 43967us (46122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361371.854163:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00010000:00010000:2.0:1788361371.854310:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361371.855149:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x85:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361371.855151:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361371.855158:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d6613bd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.855162:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d6613bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.855179:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x85:0x0].0x0 since=761s v=(0 0) 00010000:00010000:1.0:1788361371.855180:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.855186:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d6613bd0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.855187:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x85:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.855199:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d6613bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.855215:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d6613bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.855226:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d6613bd0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.855229:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d6613bd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.855249:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d6613bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.855258:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d6613bd0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.855280:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d6613bd0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x86:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.855297:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361371.855306:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361371.855311:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d6613bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.855318:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.855322:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d6613bd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.855330:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d6613bd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.855341:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d6613bd7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.855349:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d6613bd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x85:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.855382:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.855384:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.855386:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.855820:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x84:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.855826:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d6613bde lrc: 3/0,1 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.855845:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.855848:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x84:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.855852:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d6613bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.855862:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d6613bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361371.855863:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361371.855873:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d6613bde lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.855880:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d6613bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.855896:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361371.855939:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361371.855947:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d6613bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.855955:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361371.855959:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d6613bde lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.855968:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d6613bde lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.855983:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d6613bde lrc: 1/0,0 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.855991:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073ffd1c9/0xf6a94c97d6613bde lrc: 0/0,0 mode: --/PW res: [0x280000400:0x84:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.856012:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.856015:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361371.856017:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361371.856343:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x83:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.856349:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d6613be5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.856359:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x83:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.856368:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x83:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.856373:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d6613be5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.856382:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d6613be5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.856391:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d6613be5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.856398:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d6613be5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.856459:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361371.856941:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x82:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361371.856948:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613bec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.856959:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x82:0x0].0x0 since=761s v=(0 0) 00010000:00010000:2.0:1788361371.856962:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x82:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361371.856968:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.856978:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.856987:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613bec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361371.857004:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613bec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.857042:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361371.857050:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d6613be5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.857058:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.857064:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d6613be5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.857075:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d6613be5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361371.857124:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:1.0:1788361371.857126:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d6613be5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.857136:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ec89ebf/0xf6a94c97d6613be5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x83:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.857161:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361371.857165:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.857172:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361371.857182:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.857189:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613bec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.857199:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613bec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361371.857208:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.857210:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361371.857211:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361371.857236:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130595968 00000100:00100000:0.0:1788361371.857247:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130595968 00010000:00010000:2.0:1788361371.857356:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361371.857362:0:32018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6613bec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x82:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361371.857524:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361371.857535:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:0:x1875232130595968:12345-192.168.203.60@tcp:41:mount.lustre.0 00010000:00010000:1.0:1788361371.857573:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000024:0.0:1788361371.857578:0:32594:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1788361371.857680:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:0:x1875232130595968:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 147us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361371.857689:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00080000:3.0:1788361371.857751:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:2.0:1788361371.858920:0:32018:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:98 00000100:00100000:2.0:1788361371.859166:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:31304:x1875232144171264:12345-0@lo:5:osp-pre-1-0.0 Request processed in 46231us (46502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361371.859179:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361371.859240:0:31304:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:31304:1875232144171264:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788361371.859253:0:31304:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0xa1:0x0] from OST, last_created [0x280000400:0xa1:0x0]last_used is [0x280000400:0x62:0x0] 00000100:00100000:1.0:1788361371.859297:0:31304:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:31304:1875232144171392:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788361371.859324:0:31304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361371.859409:0:31304:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab71450c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361371.859450:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144171392 00000100:00100000:0.0:1788361371.859455:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144171392 00000100:00100000:0.0:1788361371.859496:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361371.859503:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:31304:x1875232144171392:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788361371.859611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00002000:00080000:0.0:1788361371.859630:0:31913:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 162 00000100:00100000:1.0:1788361371.859878:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130596096 00000100:00100000:1.0:1788361371.859884:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130596096 00000100:00100000:1.0:1788361371.859920:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361371.859927:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27066:x1875232130596096:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788361371.860159:0:31281:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1788361371.860255:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27066:x1875232130596096:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 328us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361371.860262:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361371.863172:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:31304:x1875232144171392:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3661us (3838us total) trans 25769803777 rc 0/0 00000100:00100000:0.0:1788361371.863187:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361371.863204:0:31304:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:31304:1875232144171392:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788361371.863218:0:31304:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0xa1:0x0]-[0x280000400:0xc1:0x0] 00000100:00100000:1.0:1788361371.863724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361371.863802:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130596224 00000100:00100000:0.0:1788361371.863809:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130596224 00000100:00100000:0.0:1788361371.863876:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361371.863886:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27066:x1875232130596224:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788361371.863960:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27066:x1875232130596224:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361371.863967:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788361371.866861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361371.866909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361371.866982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361371.867106:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130596352 00000100:00100000:1.0:1788361371.867117:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130596352 00000100:00100000:0.0:1788361371.867123:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130596608 00000100:00100000:0.0:1788361371.867138:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130596608 00000100:00100000:1.0:1788361371.867146:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130596480 00000100:00100000:1.0:1788361371.867148:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130596480 00000100:00100000:1.0:1788361371.867164:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361371.867166:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361371.867172:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875232130596352:12345-192.168.203.60@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788361371.867172:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27066:x1875232130596608:12345-192.168.203.60@tcp:33:mount.lustre.0 00010000:00080000:1.0:1788361371.867199:0:32018:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp t0 exp 0000000000000000 cur 761 last 0 00000020:00000080:1.0:1788361371.867226:0:32018:0:(genops.c:1406:class_connect()) connect: client 7b6b2b85-840a-4c64-a4e4-54d135f64238, cookie 0xf6a94c97d6613bf3 00002000:00100000:1.0:1788361371.867236:0:32018:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7b6b2b85-840a-4c64-a4e4-54d135f64238/ffff9a8987bd0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1788361371.867260:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1788361371.867265:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875232130596480:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788361371.867279:0:31913:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp t0 exp 0000000000000000 cur 761 last 0 00000020:00000080:0.0:1788361371.867299:0:31913:0:(genops.c:1406:class_connect()) connect: client 7b6b2b85-840a-4c64-a4e4-54d135f64238, cookie 0xf6a94c97d6613bfa 00002000:00100000:0.0:1788361371.867303:0:31913:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7b6b2b85-840a-4c64-a4e4-54d135f64238/ffff9a8a9808d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788361371.867311:0:31913:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00100000:1.0:1788361371.867344:0:32018:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788361371.867487:0:31913:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788361371.867520:0:31913:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a11f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361371.867588:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2348:x1875232130596480:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 321us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361371.867596:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00002000:00080000:1.0:1788361371.867689:0:32018:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788361371.867705:0:32018:0:(import.c:65:import_set_state_nolock()) ffff9a8987bd0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361371.867741:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2348:x1875232130596352:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 569us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361371.867748:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000004:00080000:1.0:1788361371.868184:0:31282:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 953us 00000004:00200000:1.0:1788361371.877427:0:31282:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788361371.877611:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27066:x1875232130596608:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 10430us (10760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361371.877626:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361371.986710:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361371.987353:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130596736 00000100:00100000:2.0:1788361371.987364:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130596736 00000100:00100000:3.0:1788361371.987626:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361371.987637:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27109:x1875232130596736:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:3.0:1788361371.987659:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361371.987682:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef0a expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.987762:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.987777:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.987791:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361371.987983:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788361371.987987:0:31280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 9 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361371.988081:0:31280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.988126:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef0a expref: 8 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.988142:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef0a expref: 7 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361371.988150:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983f4500) 00010000:00010000:3.0:1788361371.988153:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361371.988157:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcac00, rc 0) 00000100:00100000:3.0:1788361371.988222:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:27109:x1875232130596736:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 587us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361371.988229:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000040:00080000:1.0:1788361372.004147:0:31311:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1788361372.004169:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361372.004530:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 2 00000040:00080000:1.0:1788361372.004536:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00010000:00010000:3.0:1788361372.768357:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361373.714715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361373.715643:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130596864 00000100:00100000:0.0:1788361373.715654:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130596864 00000100:00100000:0.0:1788361373.715734:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361373.715746:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:27162:x1875232130596864:12345-192.168.203.60@tcp:41:lfs.0 00000100:00080000:3.0:1788361373.715788:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788361373.715865:0:31279:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1788361373.715950:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:27162:x1875232130596864:12345-192.168.203.60@tcp:41:lfs.0 Request processed in 207us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.715958:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361373.723830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361373.724230:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130596992 00000100:00100000:0.0:1788361373.724241:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130596992 00000100:00100000:0.0:1788361373.724369:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361373.724391:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27162:x1875232130596992:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:0.0:1788361373.724432:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361373.724512:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27162:x1875232130596992:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 123us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.724520:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00080000:3.0:1788361373.725448:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361373.729056:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361373.729323:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130597120 00000100:00100000:0.0:1788361373.729333:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130597120 00000100:00100000:0.0:1788361373.729409:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361373.729419:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27162:x1875232130597120:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:0.0:1788361373.729460:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361373.729548:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27162:x1875232130597120:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 129us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.729555:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00080000:3.0:1788361373.730523:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788361373.792357:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361373.844504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361373.844608:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130597248 00000100:00100000:0.0:1788361373.844619:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130597248 00000100:00100000:0.0:1788361373.844681:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:0.0:1788361373.844691:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+10:27196:x1875232130597248:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361373.844709:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361373.844726:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964600/0xf6a94c97d6613c0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef11 expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361373.844754:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964600/0xf6a94c97d6613c0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef11 expref: 11 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361373.844765:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964600/0xf6a94c97d6613c0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef11 expref: 11 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361373.844794:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964600, rc 0) 00000100:00100000:0.0:1788361373.844867:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+11:27196:x1875232130597248:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 178us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.844874:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:2.0:1788361373.848200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361373.848331:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130597376 00000100:00100000:3.0:1788361373.848341:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130597376 00000100:00100000:3.0:1788361373.848395:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:3.0:1788361373.848405:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+11:27196:x1875232130597376:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788361373.848741:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c72050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+11:27196:x1875232130597376:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 337us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361373.848749:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:2.0:1788361373.851899:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361373.852301:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130597504 00000100:00100000:1.0:1788361373.852310:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130597504 00000100:00100000:1.0:1788361373.852409:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788361373.852419:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+11:27196:x1875232130597504:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788361373.852750:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+11:27196:x1875232130597504:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 331us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361373.852759:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:2.0:1788361373.858915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361373.858950:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130597632 00000100:00100000:2.0:1788361373.858960:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130597632 00000100:00100000:2.0:1788361373.859446:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788361373.859458:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+11:27201:x1875232130597632:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361373.859719:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1c73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+11:27201:x1875232130597632:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 263us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361373.859736:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:0.0:1788361373.872002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361373.872126:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130597760 00000100:00100000:3.0:1788361373.872135:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130597760 00000100:00100000:3.0:1788361373.872202:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:3.0:1788361373.872211:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+11:27201:x1875232130597760:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788361373.872472:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+11:27201:x1875232130597760:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 261us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361373.872479:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:1.0:1788361373.877337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361373.879384:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130597888 00000100:00100000:2.0:1788361373.879395:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130597888 00000100:00100000:2.0:1788361373.879489:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:2.0:1788361373.879500:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+11:27196:x1875232130597888:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788361373.879516:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361373.879532:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841b9600/0xf6a94c97d6613c16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef3b expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361373.879562:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b9600/0xf6a94c97d6613c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef3b expref: 12 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361373.879575:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841b9600/0xf6a94c97d6613c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef3b expref: 12 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361373.879584:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361373.879653:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+12:27196:x1875232130597888:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 154us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361373.879662:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:2.0:1788361373.882354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361373.882385:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130598016 00000100:00100000:2.0:1788361373.882393:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130598016 00000100:00100000:2.0:1788361373.882436:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:2.0:1788361373.882446:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+12:27196:x1875232130598016:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788361373.882479:0:31272:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788361373.882497:0:31272:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788361373.882502:0:31272:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788361373.882506:0:31272:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788361373.882508:0:31272:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 20 00000100:00100000:3.0:1788361373.884678:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+12:27196:x1875232130598016:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 2223us (2327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361373.884693:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000001:00100000:3.0:1788361373.886156:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b6b2b85-840a-4c64-a4e4-54d135f64238 00000100:00100000:2.0:1788361373.890318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361373.890413:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130598144 00000100:00100000:0.0:1788361373.890423:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130598144 00000100:00100000:0.0:1788361373.890480:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:0.0:1788361373.890488:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+12:27196:x1875232130598144:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361373.890504:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361373.890520:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6613c1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef42 expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361373.890552:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6613c1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef42 expref: 13 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361373.890563:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6613c1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef42 expref: 13 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361373.890572:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965e00, rc 0) 00000100:00100000:0.0:1788361373.890628:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+13:27196:x1875232130598144:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 140us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.890635:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:2.0:1788361373.895384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361373.895556:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130598272 00000100:00100000:3.0:1788361373.895566:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130598272 00000100:00100000:3.0:1788361373.895616:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:3.0:1788361373.895626:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+13:27196:x1875232130598272:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788361373.896070:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+13:27196:x1875232130598272:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 445us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361373.896161:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:2.0:1788361373.897703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361373.897789:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130598400 00000100:00100000:0.0:1788361373.897795:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130598400 00000100:00100000:0.0:1788361373.897936:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:0.0:1788361373.897957:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+13:27196:x1875232130598400:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788361373.898283:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+13:27196:x1875232130598400:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 327us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.898291:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:2.0:1788361373.901667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361373.901790:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130598528 00000100:00100000:3.0:1788361373.901798:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130598528 00000100:00100000:3.0:1788361373.901857:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:3.0:1788361373.901866:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+13:27205:x1875232130598528:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361373.902660:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+13:27205:x1875232130598528:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 794us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.902668:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:2.0:1788361373.904605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361373.904690:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130598656 00000100:00100000:0.0:1788361373.904699:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130598656 00000100:00100000:0.0:1788361373.904747:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:0.0:1788361373.904757:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+13:27205:x1875232130598656:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361373.904994:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+13:27205:x1875232130598656:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 238us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.905001:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:2.0:1788361373.908634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361373.908734:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130598784 00000100:00100000:1.0:1788361373.908743:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130598784 00000100:00100000:1.0:1788361373.908784:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361373.908791:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1875232130598784:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788361373.908829:0:31281:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp t0 exp 0000000000000000 cur 763 last 0 00000020:00000080:1.0:1788361373.908878:0:31281:0:(genops.c:1406:class_connect()) connect: client a3538730-0385-4711-b11c-bb6af99a7674, cookie 0xf6a94c97d6613c24 00000004:00100000:1.0:1788361373.908916:0:31281:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788361373.909041:0:31281:0:(import.c:65:import_set_state_nolock()) ffff9a8a8377b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361373.909250:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3538730-0385-4711-b11c-bb6af99a7674+6:2348:x1875232130598784:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 457us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361373.909258:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1788361373.912340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361373.912429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361373.913740:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130598912 00000100:00100000:0.0:1788361373.913751:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130598912 00000100:00100000:0.0:1788361373.913831:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130599040 00000100:00100000:0.0:1788361373.913843:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130599040 00000100:00100000:0.0:1788361373.913871:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361373.913880:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+7:0:x1875232130598912:12345-192.168.203.60@tcp:41:mount.lustre.0 00000100:00080000:2.0:1788361373.913955:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788361373.914010:0:32594:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1788361373.914027:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361373.914040:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+7:27196:x1875232130599040:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788361373.914073:0:31280:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1788361373.914109:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+7:0:x1875232130598912:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 229us (1776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.914117:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361373.914126:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+7:27196:x1875232130599040:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 88us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361373.914134:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361373.919867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361373.920699:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130599168 00000100:00100000:0.0:1788361373.920727:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130599168 00000100:00100000:0.0:1788361373.920783:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1788361373.920792:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+6:27196:x1875232130599168:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788361373.920902:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+6:27196:x1875232130599168:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 110us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.920909:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361373.925583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361373.925689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361373.925829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361373.925918:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130599552 00000100:00100000:0.0:1788361373.925928:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130599552 00000100:00100000:0.0:1788361373.925978:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1788361373.925988:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:27196:x1875232130599552:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788361373.926244:0:31283:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788361373.926621:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:27196:x1875232130599552:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 633us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361373.926629:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361373.927173:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130599296 00000100:00100000:3.0:1788361373.927179:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130599296 00000100:00100000:2.0:1788361373.927362:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130599424 00000100:00100000:2.0:1788361373.927367:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130599424 00000100:00100000:2.0:1788361373.927388:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788361373.927395:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875232130599296:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788361373.927419:0:31913:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp t0 exp 0000000000000000 cur 763 last 0 00000020:00000080:2.0:1788361373.927444:0:31913:0:(genops.c:1406:class_connect()) connect: client a3538730-0385-4711-b11c-bb6af99a7674, cookie 0xf6a94c97d6613c2b 00002000:00100000:2.0:1788361373.927454:0:31913:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a3538730-0385-4711-b11c-bb6af99a7674/ffff9a8a9efde000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788361373.927463:0:31913:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788361373.927641:0:31913:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788361373.927675:0:31913:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efda000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361373.927726:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:2348:x1875232130599296:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 330us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361373.927733:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788361373.927748:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788361373.927752:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875232130599424:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788361373.927766:0:31913:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp t0 exp 0000000000000000 cur 763 last 0 00000020:00000080:2.0:1788361373.927786:0:31913:0:(genops.c:1406:class_connect()) connect: client a3538730-0385-4711-b11c-bb6af99a7674, cookie 0xf6a94c97d6613c32 00002000:00100000:2.0:1788361373.927792:0:31913:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a3538730-0385-4711-b11c-bb6af99a7674/ffff9a8a9efdf800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788361373.927798:0:31913:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788361373.927862:0:31913:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788361373.927889:0:31913:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efdc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361373.927925:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:2348:x1875232130599424:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 170us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361373.927932:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788361374.048039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361374.048516:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130599680 00000100:00100000:1.0:1788361374.048527:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130599680 00000100:00100000:1.0:1788361374.048625:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361374.048634:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:27226:x1875232130599680:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:1.0:1788361374.048655:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361374.048676:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613c39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef6c expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361374.048742:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361374.048756:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361374.048770:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361374.048979:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788361374.048983:0:31280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 9 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361374.049063:0:31280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361374.049115:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613c39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef6c expref: 8 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361374.049144:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef6c expref: 7 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361374.049152:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983f4500) 00010000:00010000:1.0:1788361374.049155:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361374.049159:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622400, rc 0) 00000100:00100000:1.0:1788361374.049223:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+7:27226:x1875232130599680:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 589us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361374.049230:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:1.0:1788361374.818045:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361374.881483:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144171520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361374.881540:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361374.881576:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144171520 00000100:00100000:3.0:1788361374.881864:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144171520 00000100:00100000:3.0:1788361374.882184:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361374.882195:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144171520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361374.882216:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361374.882264:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144171520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361374.882271:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788361374.882290:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361374.882322:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144171520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361375.843419:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361375.920182:0:33143:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788361376.865331:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361376.929364:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144171648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361376.929436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361376.931417:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25ae0af-c16d-4164-9502-26eb1af82516:3314:1875232144171776:0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.931479:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361376.931512:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144172288:0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.931541:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361376.931568:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361376.931574:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144172160:0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.931595:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361376.931638:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144171648 00000100:00100000:3.0:1788361376.931646:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144171648 00000100:00100000:3.0:1788361376.931706:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361376.931716:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144171648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361376.931749:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361376.931787:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144171648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (2352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361376.931793:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361376.931849:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144171648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361376.931874:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144171904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.931900:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361376.931919:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361376.931924:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144172032:0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.931945:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361376.931969:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144171776 00000100:00100000:3.0:1788361376.931973:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144171776 00000100:00100000:3.0:1788361376.931998:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788361376.932004:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:3314:x1875232144171776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.932039:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:3314:x1875232144171776:12345-0@lo:400:kworker.0 Request processed in 34us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361376.932044:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788361376.932070:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144172288 00000100:00100000:3.0:1788361376.932073:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144172288 00000100:00100000:3.0:1788361376.932126:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144172160 00000100:00100000:3.0:1788361376.932129:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144172160 00000100:00100000:3.0:1788361376.932143:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144172032 00000100:00100000:3.0:1788361376.932144:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144172032 00000100:00100000:3.0:1788361376.932166:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361376.932171:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144172288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.932204:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144172288:12345-0@lo:400:kworker.0 Request processed in 33us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361376.932210:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361376.932222:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361376.932228:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144172160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.932253:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144172160:12345-0@lo:400:kworker.0 Request processed in 26us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361376.932258:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361376.932275:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361376.932280:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144172032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.932309:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144172032:12345-0@lo:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361376.932314:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788361376.932333:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361376.932337:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361376.932349:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144171904 00000100:00100000:3.0:1788361376.932352:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144171904 00000100:00100000:3.0:1788361376.932382:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361376.932388:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144171904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.932418:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144171904:12345-0@lo:400:kworker.0 Request processed in 30us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361376.932424:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788361376.932448:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361376.932469:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144172032:0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.932489:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144171904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.932515:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144172160:0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.932524:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25ae0af-c16d-4164-9502-26eb1af82516:3314:1875232144171776:0@lo:400:kworker.0 00000100:00100000:3.0:1788361376.932532:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144172288:0@lo:400:kworker.0 00000001:00100000:3.0:1788361376.973660:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a3538730-0385-4711-b11c-bb6af99a7674 00000001:00100000:3.0:1788361376.973692:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7b6b2b85-840a-4c64-a4e4-54d135f64238 00000001:00100000:2.0:1788361377.006977:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7b6b2b85-840a-4c64-a4e4-54d135f64238 00000001:00080000:2.0:1788361377.006995:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803777 is committed 00000001:00100000:2.0:1788361377.007004:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788361377.007011:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3538730-0385-4711-b11c-bb6af99a7674 00010000:00010000:1.0:1788361377.889843:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788361378.164450:0:33291:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff159d4220 20000000:00000080:1.0:1788361378.164470:0:33291:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8a9f42e000 uarg=0000000000000000 20000000:01000000:1.0:1788361378.164507:0:33291:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788361378.164512:0:33291:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788361378.164516:0:33291:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788361378.165453:0:33292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788361378.165594:0:33291:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788361378.165601:0:33291:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788361378.165620:0:33291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.165649:0:33291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a841b9400/0xf6a94c97d6613906 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66138ff expref: 18 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.165656:0:33291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8987622000/0xf6a94c97d6613953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661394c expref: 18 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.165664:0:33291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985965800/0xf6a94c97d6613aa3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613a9c expref: 18 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.165673:0:33291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6613afe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eee0 expref: 12 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.165679:0:33291:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6613c1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef42 expref: 12 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.165687:0:33291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.165728:0:33291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6613c1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef42 expref: 12 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.165747:0:33291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6613c1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef42 expref: 12 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361378.165765:0:33291:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84854a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33291:1875232144172416:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361378.165892:0:33291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6613afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eee0 expref: 12 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.165902:0:33291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6613afe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eee0 expref: 12 pid: 31272 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361378.165921:0:33291:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84854380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33291:1875232144172544:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361378.165957:0:33291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985965800/0xf6a94c97d6613aa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6613a9c expref: 18 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.165965:0:33291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985965800/0xf6a94c97d6613aa3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6613a9c expref: 18 pid: 31272 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361378.165976:0:33291:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33291:1875232144172672:0@lo:104: 00000100:00100000:2.0:1788361378.166025:0:33291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361378.166060:0:33291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8987622000/0xf6a94c97d6613953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661394c expref: 18 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.166069:0:33291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8987622000/0xf6a94c97d6613953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661394c expref: 18 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361378.166077:0:33291:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33291:1875232144172800:0@lo:104: 00000100:00100000:2.0:1788361378.166132:0:33291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361378.166173:0:33291:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a841b9400/0xf6a94c97d6613906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66138ff expref: 18 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.166182:0:33291:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a841b9400/0xf6a94c97d6613906 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66138ff expref: 18 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361378.166190:0:33291:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33291:1875232144172928:0@lo:104: 00000100:00100000:2.0:1788361378.166216:0:33291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361378.166227:0:33291:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361378.166342:0:31262:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788361378.166356:0:31262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144172672 00000100:00100000:0.0:1788361378.166361:0:31262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144172672 00000100:00100000:0.0:1788361378.166396:0:31262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144172800 00000100:00100000:0.0:1788361378.166400:0:31262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144172800 00000100:00100000:0.0:1788361378.166411:0:31262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144172928 00000100:00100000:0.0:1788361378.166413:0:31262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144172928 00000100:00100000:0.0:1788361378.166427:0:31262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361378.166436:0:31262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+5:33291:x1875232144172672:12345-0@lo:104: 00010000:00010000:0.0:1788361378.166451:0:31262:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166512:0:31262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361378.166549:0:31262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+5:33291:x1875232144172672:12345-0@lo:104: Request processed in 92us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361378.166560:0:31262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361378.166583:0:31262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361378.166588:0:31262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+4:33291:x1875232144172800:12345-0@lo:104: 00010000:00010000:0.0:1788361378.166596:0:31262:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166634:0:31262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788361378.166640:0:31262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+4:33291:x1875232144172800:12345-0@lo:104: Request processed in 52us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361378.166645:0:31262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361378.166656:0:31262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361378.166662:0:31262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87088850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+3:33291:x1875232144172928:12345-0@lo:104: 00010000:00010000:0.0:1788361378.166669:0:31262:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166701:0:31262:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788361378.166706:0:31262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87088850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a25ae0af-c16d-4164-9502-26eb1af82516+3:33291:x1875232144172928:12345-0@lo:104: Request processed in 45us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361378.166721:0:31262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788361378.166770:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788361378.166777:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166796:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361378.166801:0:31268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166820:0:31268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361378.166827:0:31268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361378.166832:0:31268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361378.166859:0:31268:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166864:0:31268:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361378.166880:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166886:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d6613a9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613aa3 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166897:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361378.166900:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166905:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9c00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361378.166908:0:31268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166913:0:31268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361378.166918:0:31268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361378.166929:0:31268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361378.166943:0:31268:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166949:0:31268:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361378.166954:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166960:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9c00/0xf6a94c97d661394c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613953 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166968:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361378.166970:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166975:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361378.166978:0:31268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.166984:0:31268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361378.166996:0:31268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361378.167000:0:31268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361378.167013:0:31268:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.167019:0:31268:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361378.167041:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361378.167046:0:33291:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33291:1875232144172672:0@lo:104: 00010000:00010000:0.0:1788361378.167051:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573fa00/0xf6a94c97d66138ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6613906 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361378.167059:0:33291:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33291:1875232144172800:0@lo:104: 00010000:00010000:0.0:1788361378.167067:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361378.167070:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361378.167075:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361378.167104:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361378.167108:0:33291:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33291:1875232144172928:0@lo:104: 00010000:00010000:1.0:1788361378.167266:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361378.167268:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144173056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361378.167295:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898514dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25ae0af-c16d-4164-9502-26eb1af82516:3313:1875232144173312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361378.167336:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361378.167380:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144173184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361378.167403:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361378.167438:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361378.167467:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144173312 00000100:00100000:1.0:1788361378.167473:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144173312 00010000:00010000:1.0:1788361378.167494:0:31266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a841b9400/0xf6a94c97d6613906 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66138ff expref: 19 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361378.167512:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144173184 00000100:00100000:1.0:1788361378.167515:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144173184 00010000:00010000:1.0:1788361378.167527:0:31266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8987622000/0xf6a94c97d6613953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661394c expref: 20 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361378.167679:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144173056 00000100:00100000:3.0:1788361378.167684:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144173056 00010000:00010000:3.0:1788361378.167699:0:31266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985965800/0xf6a94c97d6613aa3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613a9c expref: 21 pid: 31272 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361378.167715:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361378.167721:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a25ae0af-c16d-4164-9502-26eb1af82516+21:3313:x1875232144173312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361378.167730:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361378.167736:0:31266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a841b9400/0xf6a94c97d6613906 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66138ff expref: 21 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.167745:0:31266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a841b9400/0xf6a94c97d6613906 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66138ff expref: 21 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.167757:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b9400/0xf6a94c97d6613906 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66138ff expref: 21 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.167770:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361378.167827:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a25ae0af-c16d-4164-9502-26eb1af82516+20:3313:x1875232144173312:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361378.167834:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361378.167848:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361378.167854:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a25ae0af-c16d-4164-9502-26eb1af82516+19:3312:x1875232144173184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361378.167861:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361378.167865:0:31266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8987622000/0xf6a94c97d6613953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661394c expref: 19 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.167873:0:31266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8987622000/0xf6a94c97d6613953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661394c expref: 19 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.167883:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987622000/0xf6a94c97d6613953 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661394c expref: 19 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.167891:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361378.167922:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a25ae0af-c16d-4164-9502-26eb1af82516+18:3312:x1875232144173184:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361378.167928:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361378.167944:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361378.167952:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9eabac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a25ae0af-c16d-4164-9502-26eb1af82516+17:3311:x1875232144173056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361378.167961:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361378.167962:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84641880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144173184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361378.167969:0:31266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985965800/0xf6a94c97d6613aa3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6613a9c expref: 17 pid: 31272 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.167979:0:31266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985965800/0xf6a94c97d6613aa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6613a9c expref: 17 pid: 31272 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.167990:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965800/0xf6a94c97d6613aa3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6613a9c expref: 17 pid: 31272 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.168005:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361378.168043:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9eabac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a25ae0af-c16d-4164-9502-26eb1af82516+16:3311:x1875232144173056:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361378.168050:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361378.168236:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898514dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25ae0af-c16d-4164-9502-26eb1af82516:3313:1875232144173312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361378.168311:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144173056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361378.169660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361378.169779:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130599808 00000100:00100000:0.0:1788361378.169798:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130599808 00010000:00010000:0.0:1788361378.169829:0:31266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6613c1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef42 expref: 13 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361378.169869:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361378.169878:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76414060-9cd0-4e10-991c-7eaed84bf288+13:2349:x1875232130599808:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361378.169891:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361378.169897:0:31266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6613c1d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef42 expref: 13 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.169908:0:31266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6613c1d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef42 expref: 13 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.169923:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361378.169988:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76414060-9cd0-4e10-991c-7eaed84bf288+13:2349:x1875232130599808:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361378.169996:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:3.0:1788361378.171026:0:33291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6613c1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef42 expref: 12 pid: 31271 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361378.171030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361378.171041:0:33291:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84854a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33291:1875232144172416:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361378.171052:0:33291:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84854380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:33291:1875232144172544:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361378.171080:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130599936 00000100:00100000:0.0:1788361378.171103:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130599936 00010000:00010000:3.0:1788361378.171136:0:33291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171147:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6613afe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eee0 expref: 12 pid: 31272 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361378.171188:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361378.171196:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76414060-9cd0-4e10-991c-7eaed84bf288+12:2350:x1875232130599936:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361378.171206:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361378.171212:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6613afe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eee0 expref: 12 pid: 31272 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171223:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6613afe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eee0 expref: 12 pid: 31272 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171235:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a89bca800/0xf6a94c97d6613afe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eee0 expref: 12 pid: 31272 timeout: 868 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171248:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171256:0:31264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171271:0:31264:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171278:0:31264:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171284:0:31264:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171291:0:31264:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171303:0:31264:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361378.171307:0:31264:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171315:0:31264:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171331:0:31264:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.171340:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361378.171346:0:33291:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.171353:0:33291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361378.171358:0:33291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8600/0xf6a94c97d6613c47 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 33291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361378.171384:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76414060-9cd0-4e10-991c-7eaed84bf288+11:2350:x1875232130599936:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 188us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361378.171392:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:0.0:1788361378.912296:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361378.954468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361378.954511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361378.954601:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361378.954634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361378.954659:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130600064 00000100:00100000:1.0:1788361378.954669:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130600064 00000100:00100000:3.0:1788361378.954680:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130600192 00000100:00100000:3.0:1788361378.954687:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130600192 00000100:00100000:3.0:1788361378.954745:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361378.954756:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130600192:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361378.954834:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:1.0:1788361378.954844:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+11:2349:x1875232130600064:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361378.954852:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130600192:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 93us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361378.954881:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+11:2349:x1875232130600064:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361378.954882:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361378.954893:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00080000:3.0:1788361378.954974:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361378.957980:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130600448 00000100:00100000:0.0:1788361378.957997:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130600448 00000100:00100000:2.0:1788361378.958045:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361378.958932:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130600320 00000100:00100000:0.0:1788361378.958939:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130600320 00000100:00100000:0.0:1788361378.958972:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130600704 00000100:00100000:2.0:1788361378.958973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361378.958978:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130600704 00000100:00100000:0.0:1788361378.959005:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361378.959021:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361378.959024:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2350:x1875232130600448:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361378.959046:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130600832 00000100:00100000:2.0:1788361378.959052:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130600832 00000100:00100000:2.0:1788361378.959077:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361378.959098:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2349:x1875232130600320:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361378.959169:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2349:x1875232130600320:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 83us (4532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361378.959175:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2350:x1875232130600448:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 158us (4660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361378.959184:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361378.959197:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361378.959213:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361378.959220:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788361378.959226:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:2350:x1875232130600704:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361378.959234:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3538730-0385-4711-b11c-bb6af99a7674+5:2349:x1875232130600832:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361378.959255:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:2350:x1875232130600704:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 31us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361378.959261:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361378.959295:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3538730-0385-4711-b11c-bb6af99a7674+5:2349:x1875232130600832:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 64us (279us total) trans 0 rc 0/0 00000100:00080000:2.0:1788361378.959416:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361378.959427:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361378.959443:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130600576 00000100:00100000:2.0:1788361378.959447:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130600576 00000100:00100000:2.0:1788361378.959484:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361378.959491:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+6:2349:x1875232130600576:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361378.959527:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788361378.959532:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+6:2349:x1875232130600576:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 37us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361378.959541:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00080000:2.0:1788361378.959563:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361378.991116:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361378.991217:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130600960 00000100:00100000:0.0:1788361378.991226:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130600960 00000100:00100000:0.0:1788361378.991280:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1788361378.991290:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27681:x1875232130600960:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361378.991319:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361378.991343:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613c4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef73 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.991413:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613c55 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.991428:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.991441:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.991454:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.991461:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.991468:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.991889:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6613c63 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.991904:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6613c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.991911:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6613c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361378.991987:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788361378.991991:0:32594:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361378.992669:0:32594:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6613c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992683:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613c55 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992690:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613c55 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992697:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613c55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992703:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361378.992707:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613c55 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992715:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613c55 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992729:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983f4500) 00010000:00010000:0.0:1788361378.992732:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361378.992736:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613c55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992751:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613c55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992764:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992770:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992775:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992792:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361378.992795:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992801:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992809:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a8a90b43c00) 00010000:00010000:0.0:1788361378.992811:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361378.992814:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c5c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992820:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992855:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613c4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef73 expref: 8 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992879:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6613c63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef73 expref: 7 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361378.992886:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:0.0:1788361378.992889:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361378.992891:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965200, rc 0) 00000100:00100000:0.0:1788361378.992947:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:27681:x1875232130600960:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1658us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361378.992955:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1788361378.995161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361378.995215:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130601216 00000100:00100000:2.0:1788361378.995225:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130601216 00000100:00100000:2.0:1788361378.995285:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361378.995293:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:27681:x1875232130601216:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361378.995320:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361378.995341:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613c6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef7a expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.995406:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613c71 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.995418:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613c71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.995429:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613c71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.995442:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613c78 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.995458:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613c78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.995465:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613c78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.995923:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6613c7f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.995934:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6613c7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.995941:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6613c7f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361378.995951:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788361378.996202:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613c71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996210:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613c71 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996217:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613c71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996223:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361378.996227:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613c71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996235:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613c71 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996257:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:2.0:1788361378.996260:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361378.996264:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613c71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996271:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613c71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996282:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613c78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996288:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613c78 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996294:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613c78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996299:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361378.996302:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613c78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996307:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613c78 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996315:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8ac20d4e00) 00010000:00010000:2.0:1788361378.996317:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361378.996320:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613c78 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996325:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613c78 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996741:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613c6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef7a expref: 10 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996757:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6613c7f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef7a expref: 9 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361378.996765:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:2.0:1788361378.996767:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361378.996770:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8600, rc 0) 00000100:00100000:2.0:1788361378.996834:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27681:x1875232130601216:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1540us (1681us total) trans 25769803777 rc 0/0 00000100:00100000:2.0:1788361378.996841:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1788361379.002071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361379.002264:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130601344 00000100:00100000:1.0:1788361379.002275:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130601344 00000100:00100000:1.0:1788361379.002378:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361379.002390:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27681:x1875232130601344:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788361379.002495:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27681:x1875232130601344:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 108us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.002504:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000001:00100000:3.0:1788361379.006628:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a3538730-0385-4711-b11c-bb6af99a7674 00000100:00100000:1.0:1788361379.068247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361379.068362:0:31288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130601472 00000100:00100000:0.0:1788361379.068371:0:31288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130601472 00000100:00100000:0.0:1788361379.068429:0:31288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361379.068440:0:31288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27690:x1875232130601472:12345-192.168.203.60@tcp:700:mkdir.0 00000100:00100000:0.0:1788361379.068526:0:31288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27690:x1875232130601472:12345-192.168.203.60@tcp:700:mkdir.0 Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361379.068534:0:31288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361379.071343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361379.071435:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130601728 00000100:00100000:3.0:1788361379.071444:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130601728 00000100:00100000:3.0:1788361379.071578:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361379.071588:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27690:x1875232130601728:12345-192.168.203.60@tcp:36:mkdir.0 00010000:00010000:3.0:1788361379.071641:0:31280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361379.071665:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef0a expref: 9 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.071685:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983f4500) 00010000:00010000:3.0:1788361379.071690:0:31280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361379.071947:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.071962:0:31280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef6c expref: 5 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.071970:0:31280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.072002:0:31280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef6c expref: 5 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.072016:0:31280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef6c expref: 5 pid: 31280 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361379.072041:0:31280:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144173440:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361379.072175:0:31280:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86ae3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361379.075550:0:31280:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144173440:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361379.075580:0:31280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361379.076610:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361379.076675:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130601856 00000100:00100000:0.0:1788361379.076683:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130601856 00010000:00010000:0.0:1788361379.076722:0:31266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef6c expref: 6 pid: 31280 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361379.076763:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361379.076772:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3538730-0385-4711-b11c-bb6af99a7674+6:2350:x1875232130601856:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361379.076801:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361379.076824:0:31266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef6c expref: 6 pid: 31280 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.076837:0:31266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef6c expref: 6 pid: 31280 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.076859:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6613c40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef6c expref: 6 pid: 31280 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.076873:0:31266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983f4500) 00010000:00010000:0.0:1788361379.076878:0:31266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.076887:0:31266:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.076895:0:31266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.076918:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361379.076968:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3538730-0385-4711-b11c-bb6af99a7674+5:2350:x1875232130601856:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 197us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361379.076975:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00010000:00010000:3.0:1788361379.078643:0:31280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.078657:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.078684:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.078696:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.078706:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361379.080577:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788361379.080593:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.080603:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.080610:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.080616:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcba00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361379.080620:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.080635:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.080650:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a983f4500) 00010000:00010000:3.0:1788361379.080653:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361379.080657:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.080663:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613c8d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361379.080683:0:31280:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002919a5c3 reply state 00000000cb143711 transno 25769803778 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361379.080692:0:31280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361379.080779:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+10:27690:x1875232130601728:12345-192.168.203.60@tcp:36:mkdir.0 Request processed in 9189us (9442us total) trans 25769803778 rc 0/0 00000100:00100000:3.0:1788361379.080798:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00010000:00010000:2.0:1788361379.082298:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.082310:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.082317:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.082323:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361379.082327:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.082343:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.082357:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff9a8a983f4300) 00010000:00010000:2.0:1788361379.082360:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361379.082373:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.082380:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613c94 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361379.092504:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361379.092882:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130601984 00000100:00100000:0.0:1788361379.092893:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130601984 00000100:00100000:0.0:1788361379.092947:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788361379.092957:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27691:x1875232130601984:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1788361379.092980:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361379.093001:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef81 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.093112:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613ca2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.093126:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.093137:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361379.093196:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361379.093200:0:32594:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361379.093240:0:32594:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613ca2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.093264:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6613c9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef81 expref: 11 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.093282:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613ca2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef81 expref: 10 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.093290:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:0.0:1788361379.093293:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361379.093297:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964c00, rc 0) 00000100:00100000:0.0:1788361379.093747:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+10:27691:x1875232130601984:12345-192.168.203.60@tcp:101:rm.0 Request processed in 790us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361379.093755:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1788361379.099330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.099451:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130602112 00000100:00100000:2.0:1788361379.099462:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130602112 00000100:00100000:2.0:1788361379.099516:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1788361379.099525:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+10:27691:x1875232130602112:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:2.0:1788361379.099545:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361379.099564:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613ca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef88 expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099622:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613cb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099637:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099648:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099661:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613cb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099681:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099689:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099807:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6613cbe lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099816:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6613cbe lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099823:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6613cbe lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361379.099852:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788361379.099855:0:31279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361379.099893:0:31279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6613cbe lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099905:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613cb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099911:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613cb0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099918:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099924:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361379.099927:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613cb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099941:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613cb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099953:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:2.0:1788361379.099956:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361379.099960:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613cb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099967:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613cb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099978:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613cb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099983:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613cb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099989:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.099994:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361379.099996:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613cb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.100001:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613cb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.100007:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff9a8ac20d4e00) 00010000:00010000:2.0:1788361379.100010:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361379.100012:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613cb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.100031:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613cb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.100374:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613ca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef88 expref: 12 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.100389:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6613cbe lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef88 expref: 11 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.100396:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:2.0:1788361379.100399:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788361379.100401:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9c00, rc 0) 00000100:00100000:2.0:1788361379.100459:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:27691:x1875232130602112:12345-192.168.203.60@tcp:101:rm.0 Request processed in 935us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361379.100467:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1788361379.102351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.102416:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130602240 00000100:00100000:2.0:1788361379.102425:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130602240 00000100:00100000:2.0:1788361379.102473:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788361379.102481:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:27691:x1875232130602240:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:2.0:1788361379.102498:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361379.102512:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613cc5 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef8f expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102565:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613ccc lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102578:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613ccc lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102599:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613ccc lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102613:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cd3 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102619:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cd3 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102626:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cd3 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102688:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613ccc lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102695:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613ccc lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102702:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613ccc lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102708:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361379.102711:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613ccc lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102718:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613ccc lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102730:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:2.0:1788361379.102733:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361379.102737:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613ccc lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102748:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613ccc lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102760:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cd3 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102766:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cd3 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102771:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cd3 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102776:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361379.102779:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cd3 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102801:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cd3 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102808:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff9a8ac20d4500) 00010000:00010000:2.0:1788361379.102811:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361379.102813:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cd3 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102819:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cd3 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102848:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613cc5 lrc: 1/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef8f expref: 12 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102868:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:2.0:1788361379.102870:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361379.102874:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613cc5 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef8f expref: 12 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.102882:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9400, rc 0) 00000100:00100000:2.0:1788361379.102935:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:27691:x1875232130602240:12345-192.168.203.60@tcp:101:rm.0 Request processed in 454us (591us total) trans 0 rc 301/301 00000100:00100000:2.0:1788361379.102942:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361379.106677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361379.106754:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130602368 00000100:00100000:3.0:1788361379.106763:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130602368 00000100:00100000:3.0:1788361379.106901:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361379.106910:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:27691:x1875232130602368:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:3.0:1788361379.106929:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361379.106955:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613cda lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef96 expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107017:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613ce1 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107043:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613ce1 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107064:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613ce1 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107080:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6613ce8 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107122:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6613ce8 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107129:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6613ce8 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107201:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613ce1 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107209:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613ce1 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107215:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613ce1 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107222:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361379.107226:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613ce1 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107235:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613ce1 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107246:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:3.0:1788361379.107255:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361379.107260:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613ce1 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107268:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613ce1 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107281:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6613ce8 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107287:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6613ce8 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107294:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6613ce8 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107299:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361379.107301:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6613ce8 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107683:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6613ce8 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107692:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff9a8a983f4500) 00010000:00010000:3.0:1788361379.107695:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361379.107698:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6613ce8 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107704:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6613ce8 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107738:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613cda lrc: 1/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef96 expref: 12 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107754:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:3.0:1788361379.107756:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361379.107760:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6613cda lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef96 expref: 12 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.107768:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcba00, rc 0) 00000100:00100000:3.0:1788361379.108072:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:27691:x1875232130602368:12345-192.168.203.60@tcp:101:rm.0 Request processed in 1161us (1403us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361379.108081:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788361379.150572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.150648:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130602624 00000100:00100000:2.0:1788361379.150659:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130602624 00000100:00100000:2.0:1788361379.150768:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788361379.150778:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:27697:x1875232130602624:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361379.150812:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361379.150831:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613cef lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86ef9d expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.150958:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cf6 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.150972:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cf6 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.150984:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cf6 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.150997:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.151015:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.151022:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361379.151945:0:31281:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x63:0x0], count =63 00000004:00080000:2.0:1788361379.151953:0:31281:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x63:0x0]+63 in llog 00000004:00080000:2.0:1788361379.152014:0:31281:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa2:0x0], index 1: 0 00010000:00010000:2.0:1788361379.152470:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152482:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152491:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152532:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cf6 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152540:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cf6 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152546:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cf6 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152552:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361379.152555:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cf6 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152574:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cf6 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152586:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:2.0:1788361379.152589:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361379.152593:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cf6 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152599:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613cf6 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361379.152611:0:31281:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073d11eb5 reply state 0000000076b32b80 transno 25769803779 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361379.152620:0:31281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361379.152653:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613cef lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef9d expref: 14 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152667:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef9d expref: 13 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.152675:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8ac20d4e00) 00010000:00010000:2.0:1788361379.152677:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361379.152679:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8c00, rc 0) 00000100:00100000:2.0:1788361379.152879:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+14:27697:x1875232130602624:12345-192.168.203.60@tcp:101:bash.0 Request processed in 2101us (2317us total) trans 25769803779 rc 0/0 00000100:00100000:2.0:1788361379.152887:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00010000:00010000:3.0:1788361379.155768:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.155794:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.155801:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.155807:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361379.155811:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.155819:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.155834:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff9a8ac20d4500) 00010000:00010000:3.0:1788361379.155837:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361379.155841:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.155859:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6613cfd lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361379.158073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.158434:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130602752 00000100:00100000:2.0:1788361379.158458:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130602752 00000100:00100000:2.0:1788361379.158562:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361379.158572:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2349:x1875232130602752:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361379.158590:0:31913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361379.158609:0:31913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6613d12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efa4 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361379.158634:0:31913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361379.158651:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=769s v=(0 0) 00010000:00010000:2.0:1788361379.158656:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361379.158665:0:31913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6613d12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efa4 expref: 6 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.158683:0:31913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6613d12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efa4 expref: 6 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.158696:0:31913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9400, rc 0) 00000100:00100000:2.0:1788361379.158755:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2349:x1875232130602752:12345-192.168.203.60@tcp:101:bash.0 Request processed in 185us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361379.158762:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1788361379.161694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361379.161793:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130602880 00000100:00100000:1.0:1788361379.161803:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130602880 00000100:00100000:1.0:1788361379.161887:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361379.161898:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27697:x1875232130602880:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788361379.161914:0:32018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361379.161931:0:32018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efab expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.161960:0:32018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6613d12 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efa4 expref: 7 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.161969:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361379.161974:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361379.161979:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 7 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.162011:0:32018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6613d12 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efa4 expref: 7 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.162026:0:32018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6613d12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efa4 expref: 7 pid: 31913 timeout: 869 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361379.162060:0:32018:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:32018:1875232144173568:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361379.162202:0:32018:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361379.166978:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361379.167811:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130603008 00000100:00100000:0.0:1788361379.167835:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130603008 00010000:00010000:0.0:1788361379.167874:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6613d12 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efa4 expref: 8 pid: 31913 timeout: 869 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361379.167922:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1788361379.167932:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2350:x1875232130603008:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361379.167947:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361379.167970:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6613d12 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efa4 expref: 8 pid: 31913 timeout: 869 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.167985:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6613d12 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efa4 expref: 8 pid: 31913 timeout: 869 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.168009:0:31264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361379.168014:0:31264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361379.168023:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 8 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.168034:0:31264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 8 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.168122:0:31264:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 8 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361379.168139:0:31264:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f26a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:31264:1875232144173696:192.168.203.60@tcp:105: 00000100:00100000:0.0:1788361379.168218:0:31264:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361379.170808:0:31264:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f26a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:31264:1875232144173696:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361379.170832:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361379.170894:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2350:x1875232130603008:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 2963us (3923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.170905:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00010000:00010000:2.0:1788361379.173667:0:32018:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6613d12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efa4 expref: 7 pid: 31913 timeout: 869 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361379.173694:0:32018:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:32018:1875232144173568:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361379.173727:0:32018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 6 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.173769:0:32018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622000, rc 0) 00000100:00100000:2.0:1788361379.173844:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27697:x1875232130602880:12345-192.168.203.60@tcp:101:bash.0 Request processed in 11947us (12159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361379.173853:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000040:00080000:1.0:1788361379.176275:0:31311:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1788361379.176284:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1788361379.176982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.177075:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130603264 00000100:00100000:2.0:1788361379.177101:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130603264 00000100:00100000:2.0:1788361379.177154:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1788361379.177164:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+13:27697:x1875232130603264:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1788361379.177491:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+14:27697:x1875232130603264:12345-192.168.203.60@tcp:35:bash.0 Request processed in 327us (514us total) trans 25769803780 rc 0/0 00000100:00100000:2.0:1788361379.177498:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000040:00080000:1.0:1788361379.177760:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 3 count 2 00000040:00080000:1.0:1788361379.177768:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 2 00000100:00100000:0.0:1788361379.210319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361379.210396:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130603392 00000100:00100000:3.0:1788361379.210407:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130603392 00000100:00100000:3.0:1788361379.210459:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:3.0:1788361379.210469:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+11:27081:x1875232130603392:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361379.210484:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361379.210500:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcba00/0xf6a94c97d6613d20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efb2 expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.210527:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcba00/0xf6a94c97d6613d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efb2 expref: 12 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.210539:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bcba00/0xf6a94c97d6613d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efb2 expref: 12 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.210549:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcba00, rc 0) 00000100:00100000:3.0:1788361379.210598:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+12:27081:x1875232130603392:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 130us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361379.210605:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:3.0:1788361379.214071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361379.214209:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130603520 00000100:00100000:1.0:1788361379.214218:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130603520 00000100:00100000:1.0:1788361379.214265:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:1.0:1788361379.214274:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+12:27081:x1875232130603520:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361379.214540:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+12:27081:x1875232130603520:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 266us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.214548:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:0.0:1788361379.223171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361379.223335:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130603648 00000100:00100000:1.0:1788361379.223345:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130603648 00000100:00100000:1.0:1788361379.223408:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:1.0:1788361379.223421:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+12:27081:x1875232130603648:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361379.223643:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+12:27081:x1875232130603648:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 224us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.223658:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:0.0:1788361379.227552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361379.227672:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130603776 00000100:00100000:3.0:1788361379.227683:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130603776 00000100:00100000:3.0:1788361379.227742:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:3.0:1788361379.227752:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+12:27081:x1875232130603776:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361379.227769:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361379.227808:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcb000/0xf6a94c97d6613d27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efb9 expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.227839:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcb000/0xf6a94c97d6613d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efb9 expref: 13 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.227851:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bcb000/0xf6a94c97d6613d27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efb9 expref: 13 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.227861:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb000, rc 0) 00000100:00100000:3.0:1788361379.227920:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+13:27081:x1875232130603776:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 168us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361379.227927:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:0.0:1788361379.229911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361379.230177:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130603904 00000100:00100000:3.0:1788361379.230187:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130603904 00000100:00100000:3.0:1788361379.230282:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:3.0:1788361379.230291:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+13:27081:x1875232130603904:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361379.230586:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+13:27081:x1875232130603904:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 294us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361379.230594:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:0.0:1788361379.232499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361379.232578:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130604032 00000100:00100000:1.0:1788361379.232587:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130604032 00000100:00100000:1.0:1788361379.232668:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:1.0:1788361379.232678:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8985c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+13:27081:x1875232130604032:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361379.232893:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8985c2fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:76414060-9cd0-4e10-991c-7eaed84bf288+13:27081:x1875232130604032:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 215us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.232901:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:1.0:1788361379.243540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.243613:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130604160 00000100:00100000:2.0:1788361379.243624:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130604160 00000100:00100000:2.0:1788361379.243689:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788361379.243700:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+14:27703:x1875232130604160:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361379.243735:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361379.243755:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efc0 expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.243835:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613d35 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.243849:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613d35 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.243861:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613d35 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361379.243950:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788361379.243954:0:31279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361379.243986:0:31279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613d35 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.244012:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efc0 expref: 16 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.244031:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613d35 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efc0 expref: 15 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.244040:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:2.0:1788361379.244043:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361379.244046:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9e00, rc 0) 00000100:00100000:2.0:1788361379.244153:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:27703:x1875232130604160:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 454us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361379.244161:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:3.0:1788361379.249388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361379.249526:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130604416 00000100:00100000:0.0:1788361379.249536:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130604416 00000100:00100000:0.0:1788361379.249598:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:0.0:1788361379.249607:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:27703:x1875232130604416:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361379.249628:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361379.249647:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613d3c lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efc7 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.249968:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613d43 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.249985:0:32594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef9d expref: 16 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.249992:0:32594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613d43 lrc: 4/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.250025:0:32594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef9d expref: 16 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.250039:0:32594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef9d expref: 16 pid: 31281 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361379.250073:0:32594:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f27100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32594:1875232144173824:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361379.250215:0:32594:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361379.252457:0:32594:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f27100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32594:1875232144173824:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361379.252484:0:32594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613d43 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361379.253407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.253493:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130604544 00000100:00100000:2.0:1788361379.253502:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130604544 00010000:00010000:2.0:1788361379.253538:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef9d expref: 17 pid: 31281 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361379.253580:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788361379.253589:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:2350:x1875232130604544:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361379.253605:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361379.253612:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef9d expref: 17 pid: 31281 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.253641:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef9d expref: 17 pid: 31281 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.253662:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d04 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef9d expref: 17 pid: 31281 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.253678:0:31265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8ac20d4e00) 00010000:00010000:2.0:1788361379.253683:0:31265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613d43 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.253692:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613d43 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.253699:0:31265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613d43 lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.253742:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361379.253874:0:32594:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613d43 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.253882:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613d43 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361379.253901:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:0.0:1788361379.254045:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613d3c lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efc7 expref: 18 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.254062:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613d43 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efc7 expref: 17 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.254069:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8ac20d4e00) 00010000:00010000:0.0:1788361379.254071:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361379.254074:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965800, rc 0) 00000100:00100000:2.0:1788361379.254180:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:2350:x1875232130604544:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 591us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361379.254189:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361379.254511:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:27703:x1875232130604416:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 4904us (5302us total) trans 25769803781 rc 0/0 00000100:00100000:0.0:1788361379.254520:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361379.263865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361379.264164:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130604800 00000100:00100000:3.0:1788361379.264175:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130604800 00000100:00100000:3.0:1788361379.264241:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:3.0:1788361379.264251:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:27703:x1875232130604800:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361379.264292:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361379.264310:0:31280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788361379.264338:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613d43 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efc7 expref: 16 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.264359:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8ac20d4e00) 00010000:00010000:3.0:1788361379.264372:0:31280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361379.264390:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d51 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efce expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.264491:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d58 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.264505:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d58 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.264515:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d58 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361379.264527:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:3.0:1788361379.264653:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d51 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efce expref: 18 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.264667:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d58 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efce expref: 17 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.264673:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4200) 00010000:00010000:3.0:1788361379.264676:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788361379.264678:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca400, rc 0) 00000100:00100000:3.0:1788361379.264747:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:27703:x1875232130604800:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 497us (894us total) trans 25769803782 rc 0/0 00000100:00100000:3.0:1788361379.264765:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:1.0:1788361379.271316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.271541:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130604928 00000100:00100000:2.0:1788361379.271552:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130604928 00000100:00100000:2.0:1788361379.271614:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1788361379.271624:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:27703:x1875232130604928:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361379.271649:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361379.271669:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d66 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efd5 expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.271751:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d66 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efd5 expref: 18 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.271765:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d66 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efd5 expref: 18 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.271795:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4200) 00010000:00010000:2.0:1788361379.271799:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361379.271802:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8c00, rc 0) 00000100:00100000:2.0:1788361379.271866:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:27703:x1875232130604928:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 243us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361379.271873:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788361379.278854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361379.278928:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130605056 00000100:00100000:0.0:1788361379.278948:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130605056 00000100:00100000:0.0:1788361379.278994:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1788361379.279002:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2349:x1875232130605056:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:0.0:1788361379.279039:0:31914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.279057:0:31914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 6 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.279065:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361379.279070:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361379.279074:0:31914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.279154:0:31914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 6 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.279168:0:31914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 6 pid: 32018 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361379.279183:0:31914:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31914:1875232144173952:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361379.279252:0:31914:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361379.280982:0:31914:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f27100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31914:1875232144173952:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361379.281004:0:31914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361379.282383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.282641:0:31918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130605184 00000100:00100000:2.0:1788361379.282650:0:31918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130605184 00002000:00100000:2.0:1788361379.282694:0:31918:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa2:0x0] (0->8) req@ffff9a8a8926e680 x1875232130605184/t0(0) o4->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:440/0 lens 504/0 e 0 to 0 dl 1788361390 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361379.282705:0:31918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926e680 with x1875232130605184 ext(0->8) 00010000:00010000:2.0:1788361379.282724:0:31918:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 7 pid: 32018 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.282739:0:31918:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 7 pid: 32018 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361379.282747:0:31918:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a8a8926e680 00000100:00100000:2.0:1788361379.282778:0:31918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788361379.282806:0:31918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130605184:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:2.0:1788361379.283348:0:31918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:2349:x1875232130605184:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 542us (970us total) trans 25769803778 rc 0/0 00000100:00100000:2.0:1788361379.283356:0:31918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:2.0:1788361379.283364:0:31918:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa2:0x0] (0->8) req@ffff9a8a8926e680 x1875232130605184/t25769803778(0) o4->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:440/0 lens 504/448 e 0 to 0 dl 1788361390 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361379.283372:0:31918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926e680 with x1875232130605184 ext(0->8) 00010000:00010000:2.0:1788361379.283378:0:31918:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 9 pid: 32018 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.283389:0:31918:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 9 pid: 32018 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361379.283395:0:31918:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a8a8926e680 00000100:00100000:1.0:1788361379.288653:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361379.288786:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130605312 00000100:00100000:0.0:1788361379.288799:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130605312 00010000:00010000:0.0:1788361379.288864:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 9 pid: 32018 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361379.288923:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361379.288931:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:2350:x1875232130605312:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361379.288952:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788361379.288971:0:31264:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788361379.288973:0:31264:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb mtime from disk: 0 -> 1788361379 00002000:00010000:0.0:1788361379.288976:0:31264:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb atime from disk: 0 -> 1788361379 00002000:00010000:0.0:1788361379.288978:0:31264:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa2:0x0] updating lvb ctime from disk: 0 -> 1788361379 00010000:00010000:0.0:1788361379.288984:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 9 pid: 32018 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.288997:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 9 pid: 32018 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.289022:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d29a69d/0xf6a94c97d6613d19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efab expref: 9 pid: 32018 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.289038:0:31264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361379.289043:0:31264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361379.289060:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.289550:0:31264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.289583:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361379.289641:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2350:x1875232130605312:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 709us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361379.289649:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00010000:00010000:2.0:1788361379.289861:0:31914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.289871:0:31914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.289896:0:31914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.289905:0:31914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.289925:0:31914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.289932:0:31914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361379.289936:0:31914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.289946:0:31914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.289958:0:31914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.289966:0:31914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000996e7b37/0xf6a94c97d6613d6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361379.290027:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130605056:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 11025us (11182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361379.290035:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:1.0:1788361379.292424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.292515:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130605568 00000100:00100000:2.0:1788361379.292525:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130605568 00000100:00100000:2.0:1788361379.292606:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:2.0:1788361379.292616:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:27703:x1875232130605568:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:2.0:1788361379.292674:0:31282:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b11:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d58 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efce expref: 18 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361379.292983:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803783 00000001:00080000:2.0:1788361379.293030:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803784 00000001:00080000:2.0:1788361379.293998:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803785 00010000:00010000:2.0:1788361379.294060:0:31282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.294077:0:31282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d66 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efd5 expref: 22 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.294108:0:31282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.294143:0:31282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d66 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efd5 expref: 22 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.294158:0:31282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d66 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efd5 expref: 22 pid: 31281 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361379.294174:0:31282:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:31282:1875232144174080:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361379.294495:0:31282:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361379.300507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.300749:0:31282:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:31282:1875232144174080:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361379.300774:0:31282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361379.301417:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130605696 00000100:00100000:3.0:1788361379.301425:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130605696 00010000:00010000:3.0:1788361379.301461:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d66 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efd5 expref: 23 pid: 31281 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361379.301533:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361379.301543:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9eabb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+23:2350:x1875232130605696:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361379.301558:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361379.301565:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d66 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efd5 expref: 23 pid: 31281 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.301577:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d66 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efd5 expref: 23 pid: 31281 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.301598:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6613d66 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efd5 expref: 23 pid: 31281 timeout: 869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.301612:0:31265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4200) 00010000:00010000:3.0:1788361379.301617:0:31265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.301625:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.301649:0:31265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.301677:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361379.301746:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9eabb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+22:2350:x1875232130605696:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 204us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361379.301753:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00010000:00010000:2.0:1788361379.301837:0:31282:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.301845:0:31282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361379.301969:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803786 00000001:00080000:2.0:1788361379.302195:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803787 00000100:00100000:2.0:1788361379.302295:0:31282:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31282:1875232144174208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788361379.302374:0:31282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361379.302401:0:31282:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab74459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361379.302715:0:31284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144174208 00000100:00100000:1.0:1788361379.302721:0:31284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144174208 00000100:00100000:1.0:1788361379.302771:0:31284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361379.302788:0:31284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31282:x1875232144174208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788361379.302854:0:31284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31282:x1875232144174208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.302861:0:31284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788361379.303355:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361379.303383:0:31282:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803777 gen 2 00000100:00100000:2.0:1788361379.303407:0:31282:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31282:1875232144174208:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788361379.304362:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803788 00000100:00100000:2.0:1788361379.304431:0:31282:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31282:1875232144174336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788361379.304483:0:31282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361379.304530:0:31284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144174336 00000100:00100000:2.0:1788361379.304536:0:31284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144174336 00000100:00100000:2.0:1788361379.304571:0:31284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361379.304578:0:31284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31282:x1875232144174336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788361379.304910:0:31284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:31282:x1875232144174336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 331us (425us total) trans 25769803779 rc 0/0 00000100:00100000:2.0:1788361379.304918:0:31284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361379.304941:0:31282:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361379.304963:0:31282:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84857100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31282:1875232144174336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788361379.305007:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803789 00010000:00010000:2.0:1788361379.305043:0:31282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.305066:0:31282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.305080:0:31282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.305107:0:31282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361379.305112:0:31282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.305120:0:31282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.305135:0:31282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4200) 00010000:00010000:2.0:1788361379.305138:0:31282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788361379.305143:0:31282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.305148:0:31282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6613d74 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361379.305407:0:31282:0:(mdd_object.c:4016:mdd_close()) Object [0x200002b11:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788361379.305526:0:31282:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].2, 64 off8320 00000004:00080000:2.0:1788361379.305536:0:31282:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 769320449797ns, next at 770320448062ns, rc = 0 00000001:00080000:2.0:1788361379.305542:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803790 00010000:00010000:2.0:1788361379.305573:0:31282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4200) 00010000:00010000:2.0:1788361379.305576:0:31282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361379.305582:0:31282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d58 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efce expref: 26 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361379.305678:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+25:27703:x1875232130605568:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 13063us (13260us total) trans 25769803791 rc 0/0 00000100:00100000:2.0:1788361379.307544:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000020:00080000:2.0:1788361379.307552:0:31282:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788361379.309549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361379.309590:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130605824 00000100:00100000:3.0:1788361379.309600:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130605824 00000100:00100000:3.0:1788361379.309654:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:3.0:1788361379.309663:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+25:27703:x1875232130605824:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361379.309686:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361379.309707:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d7b lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efdc expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.309768:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d7b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efdc expref: 26 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.309791:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d7b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efdc expref: 26 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.309810:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361379.309813:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361379.309817:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb200, rc 0) 00000100:00100000:3.0:1788361379.309873:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+26:27703:x1875232130605824:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 211us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361379.309879:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361379.317418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361379.317826:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130606080 00000100:00100000:1.0:1788361379.317837:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130606080 00000100:00100000:1.0:1788361379.317922:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361379.317933:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+26:27703:x1875232130606080:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788361379.318277:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+27:27703:x1875232130606080:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 345us (866us total) trans 25769803792 rc 0/0 00000100:00100000:1.0:1788361379.318286:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361379.383700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361379.383933:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130606336 00000100:00100000:3.0:1788361379.383944:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130606336 00000100:00100000:3.0:1788361379.384039:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1788361379.384048:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+27:27715:x1875232130606336:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361379.384082:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361379.384121:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613d82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efe3 expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361379.384231:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788361379.384452:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613d82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efe3 expref: 29 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.384466:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:3.0:1788361379.384469:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361379.384475:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613d82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efe3 expref: 29 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.384489:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcaa00, rc 0) 00000100:00100000:3.0:1788361379.384553:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+28:27715:x1875232130606336:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 506us (862us total) trans 25769803793 rc 301/301 00000100:00100000:3.0:1788361379.384562:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:2.0:1788361379.388716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361379.388819:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130606464 00000100:00100000:3.0:1788361379.388829:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130606464 00000100:00100000:3.0:1788361379.388916:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:3.0:1788361379.388927:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+28:27715:x1875232130606464:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788361379.389001:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613d90 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389032:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613d90 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389044:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613d90 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389058:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6613d97 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389065:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6613d97 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389070:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6613d97 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389190:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389198:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389205:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361379.389243:0:31280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389256:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613d90 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389263:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613d90 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389290:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613d90 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389296:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361379.389300:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613d90 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389308:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613d90 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389319:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:3.0:1788361379.389322:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361379.389326:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613d90 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389343:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613d90 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389356:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6613d97 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389363:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6613d97 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389368:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6613d97 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389373:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361379.389376:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6613d97 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389392:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6613d97 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389401:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff9a8a983f4800) 00010000:00010000:3.0:1788361379.389403:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361379.389406:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6613d97 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389411:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6613d97 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389426:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389432:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389438:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389442:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361379.389445:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389450:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389457:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361379.389459:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361379.389462:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.389477:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6613d9e lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361379.389555:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+28:27715:x1875232130606464:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 629us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361379.389563:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361379.391831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361379.391883:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130606720 00000100:00100000:2.0:1788361379.391892:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130606720 00000100:00100000:2.0:1788361379.391942:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361379.391952:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+28:27715:x1875232130606720:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361379.392633:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+29:27715:x1875232130606720:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 680us (810us total) trans 25769803794 rc 0/0 00000100:00100000:2.0:1788361379.392640:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 10000000:01000000:3.0:1788361379.552158:0:31276:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361379.552166:0:31276:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a8a10e800 from 10 10000000:01000000:3.0:1788361379.552170:0:31276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361379.552213:0:31276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.552225:0:31276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.552237:0:31276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361379.552261:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144174464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361379.552327:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361379.552398:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86ae3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361379.552404:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144174464 00000100:00100000:1.0:1788361379.552423:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144174464 00000100:00100000:1.0:1788361379.552477:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788361379.552488:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+16:31276:x1875232144174464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361379.552501:0:31272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361379.552515:0:31272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987623200/0xf6a94c97d6613dac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613da5 expref: -99 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.552540:0:31272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987623200/0xf6a94c97d6613dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613da5 expref: 17 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.552551:0:31272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987623200/0xf6a94c97d6613dac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613da5 expref: 17 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.552560:0:31272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623200, rc 0) 00000100:00100000:1.0:1788361379.552611:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87182850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+17:31276:x1875232144174464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.552629:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788361379.552727:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144174464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361379.552742:0:31276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.552750:0:31276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361379.552831:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144174592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361379.552858:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361379.552881:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86ae3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361379.552940:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144174592 00000100:00100000:1.0:1788361379.552945:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144174592 00000100:00100000:1.0:1788361379.552978:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788361379.552985:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+17:31276:x1875232144174592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361379.553280:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87182050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+17:31276:x1875232144174592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.553293:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788361379.553481:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144174592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361379.553509:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144174720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361379.553548:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361379.553577:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86ae3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361379.553789:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144174720 00000100:00100000:1.0:1788361379.553794:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144174720 00000100:00100000:1.0:1788361379.553910:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788361379.553918:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+17:31276:x1875232144174720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361379.554315:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87180850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+17:31276:x1875232144174720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 397us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.554323:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788361379.556608:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144174720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361379.558249:0:33304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788361379.559148:0:31276:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788361379.559175:0:31276:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361379.559187:0:31276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.559198:0:31276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361379.559209:0:31276:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361379.559211:0:31276:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8ac05c5800 from 10 10000000:01000000:3.0:1788361379.559214:0:31276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361379.559249:0:31276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.559257:0:31276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361379.559266:0:31276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361379.559307:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144174848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361379.559371:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361379.559409:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86ae3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361379.560339:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144174848 00000100:00100000:0.0:1788361379.560348:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144174848 00000100:00100000:0.0:1788361379.560395:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788361379.560405:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+17:31276:x1875232144174848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361379.560419:0:31271:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361379.560433:0:31271:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613dba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613db3 expref: -99 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.560457:0:31271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613db3 expref: 18 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.560467:0:31271:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613dba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613db3 expref: 18 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.560476:0:31271:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965000, rc 0) 00000100:00100000:0.0:1788361379.560540:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87182450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+18:31276:x1875232144174848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361379.560556:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788361379.561766:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144174848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361379.561798:0:31276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.561809:0:31276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361379.561887:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144174976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361379.561930:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361379.561969:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361379.562003:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144174976 00000100:00100000:1.0:1788361379.562009:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144174976 00000100:00100000:1.0:1788361379.562046:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788361379.562054:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+18:31276:x1875232144174976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361379.562315:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87181050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+18:31276:x1875232144174976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.562323:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788361379.562388:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144174976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361379.562460:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144175104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361379.562505:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361379.562534:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361379.562558:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144175104 00000100:00100000:3.0:1788361379.562563:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144175104 00000100:00100000:3.0:1788361379.562640:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788361379.562648:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+18:31276:x1875232144175104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361379.562809:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87183850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+18:31276:x1875232144175104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361379.562816:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788361379.562897:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144175104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361379.565224:0:33305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788361379.565415:0:31276:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788361379.565439:0:31276:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788361379.565450:0:31276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.565460:0:31276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361379.565470:0:31276:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788361379.565473:0:31276:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8986533800 from 10 10000000:01000000:2.0:1788361379.565475:0:31276:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788361379.565507:0:31276:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.565515:0:31276:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.565524:0:31276:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361379.565545:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144175232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361379.565652:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361379.565693:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361379.566070:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144175232 00000100:00100000:1.0:1788361379.566077:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144175232 00000100:00100000:1.0:1788361379.566156:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788361379.566166:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+18:31276:x1875232144175232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361379.566179:0:31272:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361379.566193:0:31272:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8987622400/0xf6a94c97d6613dc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6613dc1 expref: -99 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.566218:0:31272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8987622400/0xf6a94c97d6613dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6613dc1 expref: 19 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.566245:0:31272:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8987622400/0xf6a94c97d6613dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6613dc1 expref: 19 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.566253:0:31272:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622400, rc 0) 00000100:00100000:1.0:1788361379.566302:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87181450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:31276:x1875232144175232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361379.566309:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788361379.566595:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144175232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361379.566610:0:31276:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361379.566626:0:31276:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361379.566680:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144175360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361379.566709:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361379.566738:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361379.566858:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144175360 00000100:00100000:3.0:1788361379.566863:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144175360 00000100:00100000:3.0:1788361379.566894:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788361379.566902:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+19:31276:x1875232144175360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361379.567169:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87183050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+19:31276:x1875232144175360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361379.567176:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788361379.567694:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144175360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361379.567728:0:31276:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144175488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361379.567769:0:31276:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361379.567854:0:31276:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361379.567905:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144175488 00000100:00100000:3.0:1788361379.567911:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144175488 00000100:00100000:3.0:1788361379.567989:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788361379.567998:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+19:31276:x1875232144175488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361379.568175:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87183c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+19:31276:x1875232144175488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 178us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361379.568182:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788361379.568249:0:31276:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a84855180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a25ae0af-c16d-4164-9502-26eb1af82516:31276:1875232144175488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788361379.569286:0:33306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788361379.571546:0:31276:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788361379.571581:0:31276:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361379.571593:0:31276:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361379.571607:0:31276:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361379.659455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361379.662125:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130606976 00000100:00100000:0.0:1788361379.662139:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130606976 00000100:00100000:1.0:1788361379.664474:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788361379.664488:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+29:27731:x1875232130606976:12345-192.168.203.60@tcp:101:multiop.0 00010000:00010000:1.0:1788361379.664514:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361379.664517:0:32594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361379.664544:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613d35 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efc0 expref: 29 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664563:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:1.0:1788361379.664568:0:32594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361379.664580:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613dcf lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efea expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664723:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613dd6 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664735:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613dd6 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664745:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613dd6 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664771:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613ddd lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664791:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613ddd lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664798:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613ddd lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664871:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664880:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664888:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361379.664897:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:1.0:1788361379.664988:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613dd6 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.664996:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613dd6 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665003:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613dd6 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665009:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361379.665014:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613dd6 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665031:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613dd6 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665041:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:1.0:1788361379.665057:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361379.665061:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613dd6 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665067:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613dd6 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665078:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613ddd lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665120:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613ddd lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665127:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613ddd lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665133:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361379.665135:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613ddd lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665142:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613ddd lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665149:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff9a8984a32000) 00010000:00010000:1.0:1788361379.665151:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361379.665154:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613ddd lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665169:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613ddd lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665223:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613dcf lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efea expref: 31 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665239:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efea expref: 30 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361379.665246:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:1.0:1788361379.665249:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361379.665253:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623e00, rc 0) 00000100:00100000:1.0:1788361379.665324:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+30:27731:x1875232130606976:12345-192.168.203.60@tcp:101:multiop.0 Request processed in 839us (5878us total) trans 25769803795 rc 0/0 00000100:00100000:1.0:1788361379.665332:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00010000:00010000:0.0:1788361379.936240:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361380.000346:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144175616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361380.000426:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361380.000624:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144175616 00000100:00100000:3.0:1788361380.000645:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144175616 00000100:00100000:3.0:1788361380.000720:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361380.000730:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144175616:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788361380.000735:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788361380.000763:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361380.000831:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144175616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361380.000838:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361380.000884:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144175616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361380.960350:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361381.984799:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361382.048366:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144175872:0@lo:400:kworker.0 00000004:00080000:1.0:1788361382.048370:0:31304:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 772063282923ns, next at 773063280533ns, rc = 0 00000100:00100000:3.0:1788361382.048374:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144176000:0@lo:400:kworker.0 00000100:00100000:0.0:1788361382.048430:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144175744:0@lo:400:kworker.0 00000100:00100000:2.0:1788361382.050150:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361382.050213:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144176256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361382.050241:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361382.050291:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361382.050321:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144176512:0@lo:400:kworker.0 00000100:00100000:3.0:1788361382.050351:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361382.050377:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361382.050384:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144176128:0@lo:400:kworker.0 00000100:00100000:3.0:1788361382.050409:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361382.050446:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144176256 00000100:00100000:3.0:1788361382.050454:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144176256 00000100:00100000:3.0:1788361382.050512:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361382.050523:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144176256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361382.050587:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361382.050637:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144176256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361382.050643:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144175872 00000100:00100000:3.0:1788361382.050647:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361382.050650:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144175872 00000100:00100000:3.0:1788361382.050679:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144176512 00000100:00100000:3.0:1788361382.050684:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144176512 00000100:00100000:2.0:1788361382.050686:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144176000 00000100:00100000:2.0:1788361382.050691:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144176000 00000100:00100000:2.0:1788361382.050718:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361382.050724:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144176128 00000100:00100000:2.0:1788361382.050726:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144175872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361382.050730:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144176128 00000100:00100000:3.0:1788361382.050757:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361382.050782:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144175872:12345-0@lo:400:kworker.0 Request processed in 56us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361382.050789:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144176512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361382.050818:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361382.050837:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361382.050838:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144176512:12345-0@lo:400:kworker.0 Request processed in 50us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361382.050848:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361382.050848:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144176000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361382.050890:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144176512:0@lo:400:kworker.0 00000100:00100000:2.0:1788361382.050895:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144176000:12345-0@lo:400:kworker.0 Request processed in 47us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361382.050903:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361382.050920:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144176000:0@lo:400:kworker.0 00000100:00100000:2.0:1788361382.050929:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361382.050939:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144176128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361382.050981:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144176128:12345-0@lo:400:kworker.0 Request processed in 43us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361382.050989:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144175872:0@lo:400:kworker.0 00000100:00100000:2.0:1788361382.050991:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788361382.051014:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144176256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361382.052939:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361382.052984:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144176384:0@lo:400:kworker.0 00000100:00100000:0.0:1788361382.053014:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361382.058150:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361382.058162:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361382.058165:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361382.058282:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144176384 00000100:00100000:0.0:1788361382.058294:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144176384 00000100:00080000:0.0:1788361382.058324:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361382.058369:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361382.058379:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144176384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361382.058480:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144176384:12345-0@lo:400:kworker.0 Request processed in 103us (5464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361382.058488:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361382.058530:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144176384:0@lo:400:kworker.0 00000100:00100000:0.0:1788361382.058645:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144175744 00000100:00100000:0.0:1788361382.058650:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144175744 00000100:00100000:0.0:1788361382.058679:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788361382.058685:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+19:3311:x1875232144175744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361382.058718:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87180050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+19:3311:x1875232144175744:12345-0@lo:400:kworker.0 Request processed in 34us (5783us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361382.058724:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788361382.058753:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144175744:0@lo:400:kworker.0 00000100:00100000:0.0:1788361382.058825:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144176128:0@lo:400:kworker.0 00000001:00080000:3.0:1788361382.094120:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803779 is committed 00000001:00080000:3.0:1788361382.094136:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803778 is committed 00000001:00080000:3.0:1788361382.101437:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803781 is committed 00000004:00080000:3.0:1788361382.101451:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788361382.101463:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803795 is committed 00000004:00080000:3.0:1788361382.101471:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788361382.101479:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a8837d600 refcount 2 committed 0 result 0 batchid 21474836516 00000020:00080000:3.0:1788361382.101483:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8abebaf400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a8837d300 00000020:00080000:3.0:1788361382.101486:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8abebaf600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8aa94e0c00 00000100:00100000:2.0:1788361382.101629:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361382.101651:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144176640:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788361382.101657:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836516 committed batchid 17179869275 00000100:00100000:2.0:1788361382.101718:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361382.101856:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144176640 00000100:00100000:1.0:1788361382.101864:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144176640 00000100:00100000:1.0:1788361382.101913:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361382.101922:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144176640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788361382.101949:0:32018:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:162 count 1 00002000:00010000:1.0:1788361382.101984:0:32018:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa2:0x0] initial LVB size: 9, mtime: 0x6a983aa3, atime: 0x6a983aa3, ctime: 0x6a983aa3, blocks: 0xb 00010000:00010000:1.0:1788361382.101993:0:32018:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6613df2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.102017:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=772s v=(0 0) 00010000:00010000:1.0:1788361382.102021:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361382.102041:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6613df2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.102056:0:32018:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6613df2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.102066:0:32018:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6613df2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.102074:0:32018:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6613df2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.102109:0:32018:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361382.102502:0:33055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361382.102519:0:33055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6613df2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.102529:0:33055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361382.102536:0:33055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6613df2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361382.102536:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144176640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 612us (815us total) trans 25769803780 rc 0/0 00000100:00100000:1.0:1788361382.102554:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788361382.102556:0:33055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6613df2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.102586:0:33055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6613df2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.102594:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6613df2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.102610:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361382.102612:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361382.102614:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361382.102642:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803779 gen 2 00000004:00080000:2.0:1788361382.102647:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803779 committed transno 25769803779 00000100:00100000:2.0:1788361382.102666:0:3313:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8a9f584e00 x1875232144176640/t25769803780(25769803780) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788361398 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788361382.102676:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a9f584e00/2, rc 0, transno 25769803780 00000100:00100000:2.0:1788361382.102680:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144176640:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1788361382.102833:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 17179869275 00000040:00080000:1.0:1788361382.240923:0:31311:0:(llog.c:805:llog_process_thread()) index: 5, lh_last_idx: 5 synced_idx: 5 lgh_last_idx: 5 00000040:00080000:1.0:1788361382.240931:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361382.242876:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x20:0x0] index 2 count 1 00000040:00080000:1.0:1788361382.242979:0:31311:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x20:0x0] at index 5 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361382.243149:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 5 count 1 00000100:00100000:0.0:1788361382.508731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361382.508880:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130607104 00000100:00100000:2.0:1788361382.508888:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130607104 00000100:00100000:2.0:1788361382.508975:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:2.0:1788361382.508982:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+5:25471:x1875232130607104:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361382.508998:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361382.509016:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613df9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eff1 expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.509078:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.509124:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.509134:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361382.509327:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361382.509331:0:31279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361382.509412:0:31279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.509436:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613df9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff1 expref: 7 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.509448:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff1 expref: 6 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.509454:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:2.0:1788361382.509456:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361382.509458:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9800, rc 0) 00000100:00100000:2.0:1788361382.509508:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+6:25471:x1875232130607104:12345-192.168.203.60@tcp:101:bash.0 Request processed in 527us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361382.509513:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00080000:0.0:1788361382.509929:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361382.511921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361382.512006:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130607232 00000100:00100000:1.0:1788361382.512014:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130607232 00000100:00100000:1.0:1788361382.512059:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1788361382.512075:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+6:25471:x1875232130607232:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788361382.512144:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361382.512161:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613e07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86eff8 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512224:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613e0e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512239:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613e0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512250:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613e0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512264:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613e15 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512282:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613e15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512289:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613e15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512687:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef200/0xf6a94c97d6613e1c lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512698:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef200/0xf6a94c97d6613e1c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512706:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef200/0xf6a94c97d6613e1c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361382.512807:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788361382.512811:0:32594:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361382.512882:0:32594:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef200/0xf6a94c97d6613e1c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512895:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613e0e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512902:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613e0e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512909:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613e0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512916:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361382.512921:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613e0e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512928:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613e0e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512940:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:1.0:1788361382.512943:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361382.512947:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613e0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512953:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6613e0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512966:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613e15 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512982:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613e15 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512988:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613e15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.512993:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361382.512997:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613e15 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.513003:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613e15 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.513010:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8a6e1e1a (ffff9a8984a32f00) 00010000:00010000:1.0:1788361382.513013:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361382.513016:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613e15 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.513022:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6613e15 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8a6e1e1a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.513049:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6613e07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff8 expref: 8 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.513062:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef200/0xf6a94c97d6613e1c lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff8 expref: 7 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.513070:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:1.0:1788361382.513072:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788361382.513081:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef200, rc 0) 00000100:00100000:1.0:1788361382.513165:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+7:25471:x1875232130607232:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1089us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361382.513173:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1788361382.514853:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361382.514919:0:31288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130607360 00000100:00100000:0.0:1788361382.514926:0:31288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130607360 00000100:00100000:0.0:1788361382.514965:0:31288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1788361382.514974:0:31288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a3538730-0385-4711-b11c-bb6af99a7674+7:25471:x1875232130607360:12345-192.168.203.60@tcp:700:bash.0 00000100:00100000:0.0:1788361382.515046:0:31288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a3538730-0385-4711-b11c-bb6af99a7674+7:25471:x1875232130607360:12345-192.168.203.60@tcp:700:bash.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361382.515053:0:31288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1788361382.517181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361382.517235:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130607616 00000100:00100000:3.0:1788361382.517243:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130607616 00000100:00100000:3.0:1788361382.517304:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1788361382.517313:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3538730-0385-4711-b11c-bb6af99a7674+7:25471:x1875232130607616:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361382.517332:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361382.517350:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613e23 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86efff expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.517715:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613e2a lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.517730:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613e2a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.517741:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613e2a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.517755:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613e31 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.517773:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613e31 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.517779:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613e31 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.517991:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6613e38 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518001:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6613e38 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518012:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6613e38 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361382.518022:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 9 00010000:00010000:3.0:1788361382.518710:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613e2a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518728:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613e2a lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518735:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613e2a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518740:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcaa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361382.518744:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613e2a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518751:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613e2a lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518773:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:3.0:1788361382.518776:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361382.518780:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613e2a lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518786:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6613e2a lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518797:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613e31 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518802:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613e31 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518807:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613e31 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518812:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361382.518820:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613e31 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518826:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613e31 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518833:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff9a8a983f4300) 00010000:00010000:3.0:1788361382.518835:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361382.518838:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613e31 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518843:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6613e31 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518891:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6613e23 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efff expref: 10 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518906:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6613e38 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efff expref: 9 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.518915:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361382.518917:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361382.518920:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca800, rc 0) 00000100:00100000:3.0:1788361382.519022:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3538730-0385-4711-b11c-bb6af99a7674+9:25471:x1875232130607616:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1710us (1845us total) trans 25769803796 rc 0/0 00000100:00100000:3.0:1788361382.519114:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361382.521843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361382.521950:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130607872 00000100:00100000:3.0:1788361382.521960:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130607872 00000100:00100000:3.0:1788361382.522010:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:3.0:1788361382.522021:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+9:25471:x1875232130607872:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:3.0:1788361382.522110:0:31280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361382.522135:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6613e38 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efff expref: 9 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.522152:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361382.522157:0:31280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361382.522422:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.522436:0:31280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efea expref: 10 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.522445:0:31280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.522475:0:31280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efea expref: 10 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.522488:0:31280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efea expref: 10 pid: 32594 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361382.522502:0:31280:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144176768:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361382.522611:0:31280:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145180 going to sleep for 11 seconds 00000100:00100000:1.0:1788361382.524376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361382.524479:0:31280:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144176768:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361382.524501:0:31280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361382.524936:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130608000 00000100:00100000:0.0:1788361382.524943:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130608000 00010000:00010000:0.0:1788361382.525000:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efea expref: 11 pid: 32594 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361382.525036:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788361382.525045:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:2350:x1875232130608000:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361382.525058:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361382.525065:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efea expref: 11 pid: 32594 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.525077:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efea expref: 11 pid: 32594 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361382.525174:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788361382.525418:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6613de4 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efea expref: 11 pid: 32594 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.525433:0:31264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:0.0:1788361382.525438:0:31264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.525447:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.525454:0:31264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.525486:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361382.525600:0:31280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.525613:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361382.525719:0:31280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803797 00000004:00010000:3.0:1788361382.525775:0:31280:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000001661b0f reply state 0000000075298cfd transno 25769803798 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361382.525785:0:31280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361382.525866:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+10:2350:x1875232130608000:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 821us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361382.525875:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361382.526843:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+11:25471:x1875232130607872:12345-192.168.203.60@tcp:36:bash.0 Request processed in 4821us (5003us total) trans 25769803798 rc 0/0 00000100:00100000:3.0:1788361382.526851:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000020:00080000:3.0:1788361382.526856:0:31280:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361382.528687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361382.528729:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130608128 00000100:00100000:3.0:1788361382.528738:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130608128 00000100:00100000:3.0:1788361382.528798:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1788361382.528808:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+11:25471:x1875232130608128:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361382.528829:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361382.528846:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e4d lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f006 expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.528905:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e4d lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f006 expref: 12 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.528920:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e4d lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f006 expref: 12 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.528940:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361382.528953:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361382.528957:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce400, rc 0) 00000100:00100000:3.0:1788361382.529057:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+12:25471:x1875232130608128:12345-192.168.203.60@tcp:101:bash.0 Request processed in 250us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361382.529064:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00010000:00010000:2.0:1788361382.529244:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.529255:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.529659:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.529666:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361382.529670:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.529678:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.529690:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:2.0:1788361382.529693:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361382.529696:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361382.529702:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d6613e46 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361382.531800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361382.531878:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130608384 00000100:00100000:3.0:1788361382.531887:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130608384 00000100:00100000:3.0:1788361382.531948:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361382.531957:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3538730-0385-4711-b11c-bb6af99a7674+11:25471:x1875232130608384:12345-192.168.203.60@tcp:103:bash.0 00010000:00010000:3.0:1788361382.531970:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361382.531991:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e4d lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f006 expref: 11 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.532009:0:31265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361382.532013:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361382.532074:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3538730-0385-4711-b11c-bb6af99a7674+10:25471:x1875232130608384:12345-192.168.203.60@tcp:103:bash.0 Request processed in 118us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361382.532080:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361382.533786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361382.533990:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130608512 00000100:00100000:0.0:1788361382.533998:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130608512 00000100:00100000:0.0:1788361382.534056:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1788361382.534063:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+10:25471:x1875232130608512:12345-192.168.203.60@tcp:58:bash.0 00010000:00010000:0.0:1788361382.534166:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.534184:0:32594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d7b lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efdc expref: 9 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.534193:0:32594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.534224:0:32594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d7b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efdc expref: 9 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.534237:0:32594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d7b lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efdc expref: 9 pid: 31280 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361382.534251:0:32594:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f26300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32594:1875232144176896:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361382.534315:0:32594:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8512eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361382.537271:0:32594:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f26300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32594:1875232144176896:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361382.537302:0:32594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361382.539055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361382.539129:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130608640 00000100:00100000:0.0:1788361382.539139:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130608640 00010000:00010000:0.0:1788361382.539177:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d7b lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efdc expref: 10 pid: 31280 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361382.539217:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1788361382.539225:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+10:2349:x1875232130608640:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361382.539238:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361382.539243:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d7b lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efdc expref: 10 pid: 31280 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.539253:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d7b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efdc expref: 10 pid: 31280 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.539278:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6613d7b lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efdc expref: 10 pid: 31280 timeout: 872 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.539293:0:31264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:0.0:1788361382.539298:0:31264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.539307:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.539325:0:31264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361382.539348:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361382.539376:0:32594:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361382.539384:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361382.539427:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:2349:x1875232130608640:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 202us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361382.539435:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000040:00080000:1.0:1788361382.540521:0:32594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361382.540584:0:32594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 64 off8576 00000040:00080000:1.0:1788361382.540682:0:32594:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].1, 136 off8328 00000100:00100000:1.0:1788361382.540777:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+10:25471:x1875232130608512:12345-192.168.203.60@tcp:58:bash.0 Request processed in 6711us (6994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361382.540788:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:2.0:1788361382.542779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361382.543859:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130608768 00000100:00100000:3.0:1788361382.543870:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130608768 00000100:00100000:3.0:1788361382.543935:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:3.0:1788361382.543945:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+10:25471:x1875232130608768:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361382.543965:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361382.543985:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e5b lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f00d expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.544040:0:31279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 2/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.547013:0:31279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e5b lrc: 4/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f00d expref: 11 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.547048:0:31279:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.547071:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e5b lrc: 3/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f00d expref: 11 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.547103:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361382.547106:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361382.547112:0:31279:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e5b lrc: 3/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f00d expref: 11 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361382.547120:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce400, rc 0) 00000100:00100000:3.0:1788361382.547332:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+11:25471:x1875232130608768:12345-192.168.203.60@tcp:101:bash.0 Request processed in 3375us (4557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361382.547343:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00010000:00010000:1.0:1788361383.008793:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361383.264714:0:31311:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788361383.264724:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361383.264774:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 2 00000040:00080000:1.0:1788361383.264781:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:1.0:1788361383.264917:0:31311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:31311:1875232144177024:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361383.265030:0:31311:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361383.269049:0:31311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:31311:1875232144177024:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788361383.273636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.274203:0:31290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130608896 00000100:00100000:1.0:1788361383.274214:0:31290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130608896 00000100:00100000:1.0:1788361383.274327:0:31290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1788361383.274338:0:31290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27753:x1875232130608896:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788361383.274442:0:31290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27753:x1875232130608896:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 Request processed in 98us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361383.274449:0:31290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788361383.276471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.276560:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130609024 00000100:00100000:3.0:1788361383.276568:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130609024 00000100:00100000:3.0:1788361383.276619:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:3.0:1788361383.276627:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27753:x1875232130609024:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788361383.276656:0:31280:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200002b11:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788361383.276783:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27753:x1875232130609024:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 155us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361383.276791:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1788361383.281765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.281825:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130609152 00000100:00100000:3.0:1788361383.281836:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130609152 00000100:00100000:3.0:1788361383.281900:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1788361383.281909:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27753:x1875232130609152:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788361383.281981:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613e62 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.281999:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613e62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282010:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613e62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282034:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282041:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282048:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282070:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282079:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282106:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361383.282143:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788361383.282159:0:31279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361383.282175:0:31279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282187:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613e62 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282193:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613e62 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282200:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613e62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282207:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.282211:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613e62 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282218:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613e62 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282230:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361383.282234:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361383.282238:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613e62 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282244:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613e62 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282259:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282264:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e69 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282293:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282299:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.282301:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282308:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e69 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282315:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb72e0cac (ffff9a8a983f4300) 00010000:00010000:3.0:1788361383.282318:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361383.282321:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e69 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282327:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb72e0cac bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282347:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282353:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282359:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282364:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.282367:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282384:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282393:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361383.282395:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361383.282399:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.282404:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e70 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.282479:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27753:x1875232130609152:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 571us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361383.282487:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:2.0:1788361383.286505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.286583:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130609408 00000100:00100000:3.0:1788361383.286592:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130609408 00000100:00100000:3.0:1788361383.286648:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:3.0:1788361383.286658:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:27753:x1875232130609408:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361383.286676:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361383.286705:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613e77 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f014 expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.286805:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613e7e lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.286819:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613e7e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.286830:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613e7e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361383.286855:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788361383.286982:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613e7e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.286994:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613e7e lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.286999:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613e7e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.287006:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.287010:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613e7e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.287018:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613e7e lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.287040:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361383.287043:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361383.287047:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613e7e lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.287053:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613e7e lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.287122:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613e77 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f014 expref: 11 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.287132:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361383.287134:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361383.287146:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613e77 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f014 expref: 11 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.287156:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cea00, rc 0) 00000100:00100000:3.0:1788361383.287215:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+10:27753:x1875232130609408:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 558us (717us total) trans 25769803799 rc 301/301 00000100:00100000:3.0:1788361383.287223:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1788361383.290534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.290662:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130609536 00000100:00100000:3.0:1788361383.290671:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130609536 00000100:00100000:3.0:1788361383.290733:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1788361383.290742:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a84641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+10:27753:x1875232130609536:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788361383.290815:0:31279:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200002b11:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788361383.291055:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a84641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+10:27753:x1875232130609536:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 313us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361383.291063:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:2.0:1788361383.295184:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.295583:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130609792 00000100:00100000:3.0:1788361383.295593:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130609792 00000100:00100000:3.0:1788361383.295678:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1788361383.295687:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+10:27753:x1875232130609792:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361383.295704:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361383.295720:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e8c lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f01b expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361383.296777:0:31280:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x83:0x0], count =31 00000004:00080000:3.0:1788361383.296785:0:31280:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x83:0x0]+31 in llog 00000004:00080000:3.0:1788361383.296829:0:31280:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa2:0x0], index 0: 0 00010000:00010000:3.0:1788361383.297998:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e93 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.298022:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e93 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.298034:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e93 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.298121:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613e8c lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f01b expref: 13 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.298141:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e93 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f01b expref: 12 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.298150:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8a983f4300) 00010000:00010000:3.0:1788361383.298153:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361383.298156:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf000, rc 0) 00000100:00100000:3.0:1788361383.298231:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:27753:x1875232130609792:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2544us (3055us total) trans 25769803800 rc 0/0 00000100:00100000:3.0:1788361383.298240:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:2.0:1788361383.304463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.304555:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130610048 00000100:00100000:1.0:1788361383.304567:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130610048 00000100:00100000:1.0:1788361383.304625:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:1.0:1788361383.304636:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:27753:x1875232130610048:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361383.304690:0:31281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361383.304721:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6613e93 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f01b expref: 12 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.304738:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8a983f4300) 00010000:00010000:1.0:1788361383.304750:0:31281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361383.304777:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef000/0xf6a94c97d6613ea1 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.304790:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef000/0xf6a94c97d6613ea1 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.304798:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef000/0xf6a94c97d6613ea1 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.304818:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efa00/0xf6a94c97d6613ea8 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x1:0x0].0xf62887be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.304836:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efa00/0xf6a94c97d6613ea8 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0xf62887be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.304842:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efa00/0xf6a94c97d6613ea8 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0xf62887be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305134:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef000/0xf6a94c97d6613ea1 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305142:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef000/0xf6a94c97d6613ea1 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305148:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef000/0xf6a94c97d6613ea1 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305153:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ef000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361383.305166:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef000/0xf6a94c97d6613ea1 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305174:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef000/0xf6a94c97d6613ea1 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305182:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:1.0:1788361383.305184:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361383.305187:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef000/0xf6a94c97d6613ea1 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305193:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef000/0xf6a94c97d6613ea1 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305202:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efa00/0xf6a94c97d6613ea8 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x1:0x0].0xf62887be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305212:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efa00/0xf6a94c97d6613ea8 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xf62887be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305217:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efa00/0xf6a94c97d6613ea8 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xf62887be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305221:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841efa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361383.305224:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efa00/0xf6a94c97d6613ea8 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xf62887be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305229:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efa00/0xf6a94c97d6613ea8 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x1:0x0].0xf62887be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305235:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0xf62887be (ffff9a8984a32f00) 00010000:00010000:1.0:1788361383.305236:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361383.305239:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efa00/0xf6a94c97d6613ea8 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0xf62887be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.305243:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efa00/0xf6a94c97d6613ea8 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x1:0x0].0xf62887be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.305319:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:27753:x1875232130610048:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 685us (865us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361383.305326:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:2.0:1788361383.307916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.308024:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130610176 00000100:00100000:1.0:1788361383.308034:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130610176 00000100:00100000:1.0:1788361383.308161:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:1.0:1788361383.308171:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:27753:x1875232130610176:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361383.308191:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361383.308228:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee600/0xf6a94c97d6613eaf lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f022 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.308268:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.308283:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.308295:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.308390:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee600/0xf6a94c97d6613eaf lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f022 expref: 13 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.308408:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f022 expref: 12 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.308418:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:1.0:1788361383.308421:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361383.308424:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841efe00, rc 0) 00000100:00100000:1.0:1788361383.308482:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:27753:x1875232130610176:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 312us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361383.308489:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:2.0:1788361383.313309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.316099:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130610432 00000100:00100000:3.0:1788361383.316114:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130610432 00000100:00100000:3.0:1788361383.316231:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:3.0:1788361383.316242:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:27753:x1875232130610432:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788361383.316387:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.316471:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.316572:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361383.317058:0:31279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].2, 88 off8344 00000004:00080000:3.0:1788361383.317068:0:31279:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 773331981198ns, next at 774331979131ns, rc = 0 00000004:00010000:3.0:1788361383.317184:0:31279:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aad90bcf reply state 00000000feb70983 transno 25769803801 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.317193:0:31279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361383.317376:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+14:27753:x1875232130610432:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1133us (4073us total) trans 25769803801 rc 0/0 00000100:00100000:3.0:1788361383.317385:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:2.0:1788361383.319823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.320264:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130610560 00000100:00100000:0.0:1788361383.320284:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130610560 00000100:00100000:0.0:1788361383.320334:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1788361383.320343:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+14:27753:x1875232130610560:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361383.320368:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361383.320387:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613ec4 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f029 expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.320443:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613ec4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f029 expref: 15 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.320458:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613ec4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f029 expref: 15 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.320477:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:0.0:1788361383.320480:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361383.320484:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965e00, rc 0) 00000100:00100000:0.0:1788361383.320763:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:27753:x1875232130610560:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 411us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361383.320771:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00010000:00010000:3.0:1788361383.320885:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.320893:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.320900:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.320906:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.320910:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.320917:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.320929:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:3.0:1788361383.320931:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788361383.320943:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.320949:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ebd lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361383.328005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.328342:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130610688 00000100:00100000:0.0:1788361383.328352:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130610688 00000100:00100000:0.0:1788361383.328454:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788361383.328464:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2349:x1875232130610688:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788361383.328834:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2349:x1875232130610688:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 371us (838us total) trans 25769803778 rc 0/0 00000100:00100000:0.0:1788361383.328841:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361383.331642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.331787:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130610944 00000100:00100000:0.0:1788361383.331795:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130610944 00000100:00100000:0.0:1788361383.331852:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361383.331862:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+14:27753:x1875232130610944:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361383.332124:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:27753:x1875232130610944:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 263us (489us total) trans 25769803802 rc 0/0 00000100:00100000:0.0:1788361383.332131:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361383.335636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.335725:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130611200 00000100:00100000:1.0:1788361383.335734:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130611200 00000100:00100000:1.0:1788361383.336306:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1788361383.336318:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:27753:x1875232130611200:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788361383.336433:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:27753:x1875232130611200:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 119us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361383.336441:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00080000:2.0:1788361383.337893:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361383.342245:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.342616:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130611328 00000100:00100000:0.0:1788361383.342626:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130611328 00000100:00100000:0.0:1788361383.342694:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:0.0:1788361383.342703:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:27753:x1875232130611328:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361383.342724:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361383.342743:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6613ecb lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f030 expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.342821:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613ed2 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.342835:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613ed2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.342846:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613ed2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361383.342893:0:31280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361383.342910:0:31280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613ed2 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.342935:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d6613ecb lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f030 expref: 17 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.342952:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613ed2 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f030 expref: 16 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.342959:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:0.0:1788361383.342963:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788361383.342966:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964400, rc 0) 00000100:00100000:0.0:1788361383.343037:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:27753:x1875232130611328:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 334us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361383.343043:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:0.0:1788361383.347456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.347536:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130611456 00000100:00100000:2.0:1788361383.347545:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130611456 00000100:00100000:2.0:1788361383.347603:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361383.347613:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2349:x1875232130611456:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361383.347637:0:31913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361383.347657:0:31913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ed9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f037 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361383.347682:0:31913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983aa8, blocks: 0x1 00010000:00010000:2.0:1788361383.347835:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=773s v=(0 0) 00010000:00010000:2.0:1788361383.347840:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361383.347851:0:31913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f037 expref: 7 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.347870:0:31913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f037 expref: 7 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.347884:0:31913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8e00, rc 0) 00000100:00100000:2.0:1788361383.347980:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130611456:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 368us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361383.347988:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361383.350288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.350413:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130611712 00000100:00100000:2.0:1788361383.350421:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130611712 00000100:00100000:2.0:1788361383.350474:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:2.0:1788361383.350483:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:27753:x1875232130611712:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788361383.350598:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:27753:x1875232130611712:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 116us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361383.350606:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:3.0:1788361383.353383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.353452:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130611840 00000100:00100000:0.0:1788361383.353460:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130611840 00000100:00100000:0.0:1788361383.353513:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788361383.353523:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:27753:x1875232130611840:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361383.353541:0:31914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361383.353558:0:31914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f03e expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.353588:0:31914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ed9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f037 expref: 8 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.353607:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361383.353612:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361383.353618:0:31914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 8 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.353650:0:31914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f037 expref: 8 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.353663:0:31914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f037 expref: 8 pid: 31913 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.353677:0:31914:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:31914:1875232144177152:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361383.353795:0:31914:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8512ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361383.356306:0:31914:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f25180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:31914:1875232144177152:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361383.356337:0:31914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 8 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.356357:0:31914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965400, rc 0) 00000100:00100000:0.0:1788361383.356413:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:27753:x1875232130611840:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2892us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361383.356421:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788361383.359830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.359960:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130611968 00000100:00100000:2.0:1788361383.359968:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130611968 00010000:00010000:2.0:1788361383.359999:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f037 expref: 8 pid: 31913 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361383.360034:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361383.360040:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2350:x1875232130611968:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361383.360051:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361383.360073:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ed9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f037 expref: 8 pid: 31913 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.360127:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ed9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f037 expref: 8 pid: 31913 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.360150:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ed9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f037 expref: 8 pid: 31913 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.360166:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361383.360170:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361383.360178:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 7 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.360213:0:31265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 7 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.360252:0:31265:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 7 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361383.360267:0:31265:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:31265:1875232144177280:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361383.360496:0:31265:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361383.362982:0:31265:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:31265:1875232144177280:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361383.363002:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361383.363055:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2350:x1875232130611968:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3013us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361383.363066:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361383.365049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.365180:0:31920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130612096 00000100:00100000:3.0:1788361383.365189:0:31920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130612096 00002000:00100000:3.0:1788361383.365229:0:31920:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa2:0x0] (0->8) req@ffff9a8a89f25180 x1875232130612096/t0(0) o4->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:444/0 lens 504/0 e 0 to 0 dl 1788361394 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361383.365239:0:31920:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f25180 with x1875232130612096 ext(0->8) 00002000:00010000:3.0:1788361383.365245:0:31920:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f25180 00000100:00100000:3.0:1788361383.365389:0:31920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361383.365408:0:31920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2350:x1875232130612096:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361383.366024:0:31920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:2350:x1875232130612096:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 625us (981us total) trans 25769803779 rc 0/0 00000100:00100000:3.0:1788361383.366032:0:31920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:3.0:1788361383.366039:0:31920:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa2:0x0] (0->8) req@ffff9a8a89f25180 x1875232130612096/t25769803779(0) o4->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:444/0 lens 504/448 e 0 to 0 dl 1788361394 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361383.366048:0:31920:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f25180 with x1875232130612096 ext(0->8) 00002000:00010000:3.0:1788361383.366051:0:31920:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f25180 00000100:00100000:3.0:1788361383.367621:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.368648:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130612224 00000100:00100000:2.0:1788361383.368657:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130612224 00000100:00100000:2.0:1788361383.368710:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1788361383.368719:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:27753:x1875232130612224:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788361383.395616:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:27753:x1875232130612224:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 26889us (27992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361383.395629:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000001:00080000:3.0:1788361383.395713:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803802 is committed 00000020:00080000:3.0:1788361383.395724:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836516 batchid updated 00000004:00080000:3.0:1788361383.395760:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788361383.395778:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803798 is committed 00000100:00100000:3.0:1788361383.395890:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144177408:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361383.395940:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361383.395984:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144177408 00000100:00100000:3.0:1788361383.395991:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144177408 00000100:00100000:3.0:1788361383.396039:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361383.396048:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144177408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788361383.396196:0:32018:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788361383.396200:0:32018:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime from disk: 0 -> 1788361384 00002000:00010000:3.0:1788361383.396202:0:32018:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788361383.396204:0:32018:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime from disk: 1788361384 -> 1788361384 00002000:00010000:3.0:1788361383.396206:0:32018:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788361383.396234:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144177408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (294us total) trans 25769803780 rc 0/0 00000100:00100000:3.0:1788361383.396240:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000020:00080000:2.0:1788361383.396389:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836516 00000020:00080000:2.0:1788361383.396399:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836516 00000004:00080000:3.0:1788361383.396428:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a90b2ca80/2, rc 0, transno 25769803780 00000100:00100000:3.0:1788361383.396434:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144177408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788361383.398232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.398322:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130612352 00000100:00100000:1.0:1788361383.398329:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130612352 00000100:00100000:1.0:1788361383.398379:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361383.398388:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:2350:x1875232130612352:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788361383.418709:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:2350:x1875232130612352:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 20289us (20449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361383.418723:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000001:00080000:0.0:1788361383.418831:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803778 is committed 00000001:00080000:0.0:1788361383.418856:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803780 is committed 00000001:00080000:0.0:1788361383.418860:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803779 is committed 00000100:00100000:1.0:1788361383.422153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.422401:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130612608 00000100:00100000:2.0:1788361383.422412:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130612608 00000100:00100000:2.0:1788361383.422468:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:2.0:1788361383.422478:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:27753:x1875232130612608:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361383.422539:0:31279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361383.422566:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d6613ed2 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f030 expref: 12 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.422585:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:2.0:1788361383.422589:0:31279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361383.422616:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.422629:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.422649:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361383.422958:0:31279:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004bd4b345 reply state 0000000044b14b77 transno 25769803803 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361383.422968:0:31279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361383.423060:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+13:27753:x1875232130612608:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 583us (916us total) trans 25769803803 rc 0/0 00000100:00100000:2.0:1788361383.423067:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00010000:00010000:2.0:1788361383.424492:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.424505:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.424513:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.424520:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361383.424533:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.424541:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.424555:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:2.0:1788361383.424558:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361383.424562:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.424569:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6613ee7 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.425789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.425998:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130612736 00000100:00100000:3.0:1788361383.426005:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130612736 00000100:00100000:3.0:1788361383.426052:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361383.426061:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2349:x1875232130612736:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788361383.426386:0:32018:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788361383.426389:0:32018:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime from disk: 1788361384 -> 1788361383 00002000:00010000:3.0:1788361383.426391:0:32018:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb atime from disk: 0 -> 1788361379 00002000:00010000:3.0:1788361383.426402:0:32018:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime from disk: 1788361384 -> 1788361383 00002000:00010000:3.0:1788361383.426404:0:32018:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788361383.426563:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898514c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130612736:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 502us (778us total) trans 25769803781 rc 0/0 00000100:00100000:3.0:1788361383.426572:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361383.428397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.428571:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130612992 00000100:00100000:1.0:1788361383.428578:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130612992 00000100:00100000:1.0:1788361383.428658:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:1.0:1788361383.428672:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:27753:x1875232130612992:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788361383.428804:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.428822:0:31281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f022 expref: 12 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.428892:0:31281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.428921:0:31281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f022 expref: 12 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.428930:0:31281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f022 expref: 12 pid: 32594 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.428954:0:31281:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144177536:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361383.429029:0:31281:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8987026a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361383.431222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.431310:0:31281:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144177536:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361383.431334:0:31281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.431439:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130613120 00000100:00100000:0.0:1788361383.431446:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130613120 00010000:00010000:0.0:1788361383.431605:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f022 expref: 13 pid: 32594 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.431785:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788361383.431795:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+13:2350:x1875232130613120:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361383.431810:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361383.431817:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f022 expref: 13 pid: 32594 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.431828:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f022 expref: 13 pid: 32594 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.431849:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613eb6 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f022 expref: 13 pid: 32594 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.431865:0:31264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:0.0:1788361383.431869:0:31264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.431877:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.431884:0:31264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.431910:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361383.431975:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:2350:x1875232130613120:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 182us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361383.431983:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00010000:00010000:1.0:1788361383.432192:0:31281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.432200:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.432227:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.432233:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.432240:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.432247:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841eee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361383.432251:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.432258:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.432365:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:1.0:1788361383.432374:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788361383.432379:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.432385:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6613eee lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.432426:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:27753:x1875232130612992:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 3760us (4036us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788361383.432434:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:0.0:1788361383.435979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.436065:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130613248 00000100:00100000:2.0:1788361383.436074:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130613248 00000100:00100000:2.0:1788361383.436189:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788361383.436200:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2352:x1875232130613248:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788361383.436243:0:31914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.436280:0:31914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 7 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.436289:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361383.436293:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361383.436297:0:31914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.436330:0:31914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 7 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.436344:0:31914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 7 pid: 31914 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361383.436359:0:31914:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:31914:1875232144177664:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361383.436445:0:31914:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab74459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361383.439331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.439654:0:31914:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:31914:1875232144177664:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361383.439677:0:31914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.439806:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130613376 00000100:00100000:3.0:1788361383.439813:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130613376 00010000:00010000:3.0:1788361383.439847:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 8 pid: 31914 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.439883:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361383.439891:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2349:x1875232130613376:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361383.439904:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361383.439926:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 8 pid: 31914 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.439938:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 8 pid: 31914 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.439960:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a35f64b/0xf6a94c97d6613ee0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f03e expref: 8 pid: 31914 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.439976:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361383.439980:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361383.439985:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.440008:0:31265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.440077:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361383.440159:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130613376:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 268us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361383.440165:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00010000:00010000:2.0:1788361383.440373:0:31914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.440383:0:31914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.440407:0:31914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.440427:0:31914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.440495:0:31914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.440503:0:31914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361383.440508:0:31914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.440517:0:31914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.440529:0:31914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.440541:0:31914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6613ef5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361383.440630:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2352:x1875232130613248:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 4431us (4660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361383.440638:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788361383.442322:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.442369:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130613632 00000100:00100000:0.0:1788361383.442377:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130613632 00000100:00100000:0.0:1788361383.442439:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:0.0:1788361383.442447:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:27753:x1875232130613632:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788361383.442513:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6613efc lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.442529:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6613efc lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.442539:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6613efc lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.442779:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.442792:0:31280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613ec4 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f029 expref: 12 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.442799:0:31280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.442840:0:31280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613ec4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f029 expref: 12 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.442854:0:31280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613ec4 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f029 expref: 12 pid: 31280 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.442869:0:31280:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f24380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144177792:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361383.442932:0:31280:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8512e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361383.445010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.445038:0:31280:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f24380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144177792:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361383.445059:0:31280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.445123:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130613760 00000100:00100000:1.0:1788361383.445129:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130613760 00010000:00010000:1.0:1788361383.445159:0:31266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613ec4 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f029 expref: 13 pid: 31280 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.445197:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1788361383.445206:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9eabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+13:2349:x1875232130613760:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361383.445219:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361383.445226:0:31266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613ec4 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f029 expref: 13 pid: 31280 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.445238:0:31266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613ec4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f029 expref: 13 pid: 31280 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.445259:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6613ec4 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f029 expref: 13 pid: 31280 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.445287:0:31266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:1.0:1788361383.445300:0:31266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.445309:0:31266:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.445316:0:31266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.445338:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361383.445381:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9eabbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:2349:x1875232130613760:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 177us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361383.445390:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00010000:00010000:0.0:1788361383.445893:0:31280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.445901:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361383.446066:0:31280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803804 00000001:00080000:0.0:1788361383.446229:0:31280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803805 00000001:00080000:0.0:1788361383.446260:0:31280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803806 00000100:00100000:0.0:1788361383.446329:0:31280:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f24380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:31280:1875232144177920:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788361383.446365:0:31280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361383.446390:0:31280:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8512e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361383.446401:0:31284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144177920 00000100:00100000:2.0:1788361383.446406:0:31284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144177920 00000100:00100000:2.0:1788361383.446448:0:31284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361383.446455:0:31284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31280:x1875232144177920:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788361383.446596:0:31284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31280:x1875232144177920:12345-0@lo:1000:mdt00_001.0 Request processed in 141us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361383.446603:0:31284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361383.446965:0:31280:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803780 gen 2 00000004:00080000:0.0:1788361383.446970:0:31280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a90b2ca80, transno 25769803780 00000100:00100000:0.0:1788361383.446985:0:31280:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f24380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:31280:1875232144177920:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788361383.447796:0:31280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803807 00000100:00100000:1.0:1788361383.447858:0:31280:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:31280:1875232144178048:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788361383.447902:0:31280:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361383.447930:0:31280:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8987026240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361383.448030:0:31285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144178048 00000100:00100000:2.0:1788361383.448035:0:31285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144178048 00000100:00100000:2.0:1788361383.448064:0:31285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361383.448071:0:31285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:31280:x1875232144178048:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788361383.448255:0:31285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:31280:x1875232144178048:12345-0@lo:1000:mdt00_001.0 Request processed in 183us (352us total) trans 25769803782 rc 0/0 00000100:00100000:2.0:1788361383.448263:0:31285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788361383.448498:0:31280:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:31280:1875232144178048:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788361383.448528:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448537:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448544:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448550:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361383.448554:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448573:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448589:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:1.0:1788361383.448593:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361383.448597:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448604:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6613f03 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448633:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448638:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448641:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448644:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361383.448646:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448649:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448654:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:1.0:1788361383.448655:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361383.448660:0:31280:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e5b lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f00d expref: 7 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448675:0:31280:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e5b lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f00d expref: 7 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448681:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e5b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f00d expref: 7 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.448703:0:31280:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e5b lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f00d expref: 7 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.448713:0:31280:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144178176:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361383.448815:0:31280:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8987026240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361383.451061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.451078:0:31280:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144178176:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361383.451117:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451127:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6613e54 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451156:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6613f0a lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451168:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6613f0a lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.451371:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130613888 00000100:00100000:0.0:1788361383.451378:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130613888 00010000:00010000:1.0:1788361383.451389:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6613f0a lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451401:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6613f0a lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451420:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6613f0a lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451427:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6613f0a lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.451433:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361383.451444:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3538730-0385-4711-b11c-bb6af99a7674+8:25471:x1875232130613888:12345-192.168.203.60@tcp:49:bash.0 00010000:00010000:1.0:1788361383.451499:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ef600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361383.451504:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6613f0a lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451512:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6613f0a lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451525:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:1.0:1788361383.451528:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361383.451532:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6613f0a lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451537:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6613f0a lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451549:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6613efc lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451555:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6613efc lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451561:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6613efc lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451566:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964800 already unused, calling callback (ffffffffc1fc84f0) 00000100:00100000:0.0:1788361383.451571:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3538730-0385-4711-b11c-bb6af99a7674+8:25471:x1875232130613888:12345-192.168.203.60@tcp:49:bash.0 Request processed in 128us (515us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361383.451578:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6613efc lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.451583:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:1.0:1788361383.451591:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6613efc lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451602:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:1.0:1788361383.451605:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361383.451608:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6613efc lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.451615:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6613efc lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.451873:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:27753:x1875232130613632:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 9426us (9555us total) trans 25769803808 rc 0/0 00000100:00100000:1.0:1788361383.451882:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000020:00080000:1.0:1788361383.451886:0:31280:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788361383.453415:0:31311:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788361383.453420:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361383.453452:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 2 00000040:00080000:3.0:1788361383.453457:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788361383.453476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.453565:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130614016 00000100:00100000:0.0:1788361383.453573:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130614016 00000100:00100000:0.0:1788361383.453665:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361383.453673:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+5:25471:x1875232130614016:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788361383.453688:0:31913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361383.453706:0:31913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f045 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361383.453728:0:31913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa2:0x0] initial LVB size: 9, mtime: 0x6a983aa7, atime: 0x6a983aa3, ctime: 0x6a983aa7, blocks: 0xb 00010000:00010000:0.0:1788361383.453749:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=773s v=(0 0) 00010000:00010000:0.0:1788361383.453766:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361383.453773:0:31913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 6 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.453788:0:31913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 6 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.453800:0:31913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964000, rc 0) 00000100:00100000:0.0:1788361383.453858:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:25471:x1875232130614016:12345-192.168.203.60@tcp:101:bash.0 Request processed in 185us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361383.453864:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00080000:2.0:1788361383.455316:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361383.455633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.455725:0:31919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130614144 00000100:00100000:3.0:1788361383.455733:0:31919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130614144 00002000:00010000:3.0:1788361383.455771:0:31919:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/162 (0->18446744073709551615) 00002000:00100000:3.0:1788361383.455776:0:31919:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24380 with x1875232130614144 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361383.455785:0:31919:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24380. 00000100:00100000:3.0:1788361383.455815:0:31919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361383.455823:0:31919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:2352:x1875232130614144:12345-192.168.203.60@tcp:10:bash.0 00002000:00010000:3.0:1788361383.456606:0:31919:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788361383.456610:0:31919:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime from disk: 1788361383 -> 1788361383 00002000:00010000:3.0:1788361383.456612:0:31919:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb atime from disk: 1788361379 -> 1788361379 00002000:00010000:3.0:1788361383.456615:0:31919:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime from disk: 1788361383 -> 1788361383 00002000:00010000:3.0:1788361383.456617:0:31919:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788361383.456674:0:31919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3538730-0385-4711-b11c-bb6af99a7674+7:2352:x1875232130614144:12345-192.168.203.60@tcp:10:bash.0 Request processed in 851us (1043us total) trans 25769803783 rc 0/0 00000100:00100000:3.0:1788361383.456682:0:31919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00002000:00010000:3.0:1788361383.456686:0:31919:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/162 (0->18446744073709551615) 00002000:00100000:3.0:1788361383.456689:0:31919:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24380 with x1875232130614144 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361383.456694:0:31919:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24380. 00000100:00100000:0.0:1788361383.456720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.456761:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130614400 00000100:00100000:3.0:1788361383.456766:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130614400 00000100:00100000:3.0:1788361383.456800:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361383.456807:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:27753:x1875232130614400:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788361383.457503:0:31282:0:(mdd_object.c:4016:mdd_close()) Object [0x200002b11:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788361383.457578:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803809 00010000:00010000:3.0:1788361383.457605:0:31282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.457617:0:31282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.457625:0:31282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.457631:0:31282:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.457635:0:31282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.457638:0:31282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.457659:0:31282:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361383.457690:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361383.457696:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.457702:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361383.457707:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.457714:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.457720:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:27753:x1875232130614400:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 913us (999us total) trans 25769803810 rc 0/0 00010000:00010000:0.0:1788361383.457726:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x5:0x0].0x0 (ffff9a8a983f4200) 00000100:00100000:3.0:1788361383.457727:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:0.0:1788361383.457729:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000020:00080000:3.0:1788361383.457731:0:31282:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788361383.457733:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 1/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.457738:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6613f18 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.457767:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361383.457770:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361383.457772:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361383.458398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.458465:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130614656 00000100:00100000:2.0:1788361383.458470:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130614656 00000100:00100000:2.0:1788361383.458545:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:2.0:1788361383.458553:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+8:25471:x1875232130614656:12345-192.168.203.60@tcp:55:bash.0 00010000:00010000:2.0:1788361383.458586:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f1f lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.458594:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f1f lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.458600:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f1f lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.458720:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f1f lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.458732:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f1f lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.458736:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f1f lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.458739:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361383.458741:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f1f lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.458745:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f1f lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.458765:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:2.0:1788361383.458769:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788361383.458775:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f1f lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.458781:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f1f lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361383.458843:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+9:25471:x1875232130614656:12345-192.168.203.60@tcp:55:bash.0 Request processed in 289us (444us total) trans 25769803811 rc 0/0 00000100:00100000:2.0:1788361383.458851:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1788361383.463326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.463371:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130614912 00000100:00100000:0.0:1788361383.463381:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130614912 00000100:00100000:0.0:1788361383.463439:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361383.463465:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3538730-0385-4711-b11c-bb6af99a7674+9:25471:x1875232130614912:12345-192.168.203.60@tcp:35:bash.0 00000001:00080000:0.0:1788361383.463715:0:31283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803812 00000100:00100000:0.0:1788361383.463845:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3538730-0385-4711-b11c-bb6af99a7674+11:25471:x1875232130614912:12345-192.168.203.60@tcp:35:bash.0 Request processed in 378us (524us total) trans 25769803813 rc 0/0 00000100:00100000:0.0:1788361383.463853:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000020:00080000:0.0:1788361383.463858:0:31283:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788361383.520076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.520181:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130615168 00000100:00100000:2.0:1788361383.520192:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130615168 00000100:00100000:2.0:1788361383.520561:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:2.0:1788361383.520572:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:27763:x1875232130615168:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361383.520600:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361383.520632:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f04c expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361383.520879:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788361383.521044:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f26 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f04c expref: 19 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.521059:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:2.0:1788361383.521062:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361383.521067:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613f26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f04c expref: 19 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.521079:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9200, rc 0) 00000100:00100000:2.0:1788361383.521179:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:27763:x1875232130615168:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 609us (1113us total) trans 25769803814 rc 301/301 00000100:00100000:2.0:1788361383.521186:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:1.0:1788361383.524264:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.525856:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130615296 00000100:00100000:3.0:1788361383.525880:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130615296 00000100:00100000:3.0:1788361383.525947:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:3.0:1788361383.525958:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:27763:x1875232130615296:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788361383.526028:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f34 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526045:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f34 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526057:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f34 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526074:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f3b lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526081:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f3b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526106:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f3b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526681:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526699:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526708:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361383.526747:0:31281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526768:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f34 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526775:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f34 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526781:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f34 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526788:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.526792:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f34 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526800:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f34 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526814:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:3.0:1788361383.526817:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361383.526822:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f34 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526826:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f34 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526845:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f3b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526849:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f3b lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526853:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f3b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526856:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.526859:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f3b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526863:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f3b lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.526992:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff9a8a983f4300) 00010000:00010000:3.0:1788361383.526995:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361383.526998:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f3b lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.527002:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f3b lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.527020:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.527026:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.527032:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.527045:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.527048:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.527055:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.527066:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361383.527069:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361383.527072:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.527078:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f42 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.527436:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:27763:x1875232130615296:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1213us (2912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361383.527445:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:0.0:1788361383.530388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.530474:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130615552 00000100:00100000:1.0:1788361383.530484:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130615552 00000100:00100000:1.0:1788361383.530537:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361383.530546:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:27763:x1875232130615552:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788361383.531390:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+19:27763:x1875232130615552:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 842us (1008us total) trans 25769803815 rc 0/0 00000100:00100000:1.0:1788361383.531398:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361383.597972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.598134:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130615808 00000100:00100000:3.0:1788361383.598144:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130615808 00000100:00100000:3.0:1788361383.598201:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:3.0:1788361383.598211:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+19:27771:x1875232130615808:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1788361383.598237:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361383.598256:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f49 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f053 expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598327:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f50 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598356:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f50 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598367:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f50 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598381:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f57 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598388:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f57 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598394:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f57 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598687:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598697:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598704:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361383.598714:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:3.0:1788361383.598816:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f50 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598825:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f50 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598831:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f50 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598843:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.598848:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f50 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598856:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f50 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598867:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:3.0:1788361383.598870:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361383.598874:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f50 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598880:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f50 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598894:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f57 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598899:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f57 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598905:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f57 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598909:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.598912:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f57 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598917:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f57 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598936:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff9a8a983f4300) 00010000:00010000:3.0:1788361383.598939:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361383.598942:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f57 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.598948:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f57 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.599002:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f49 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f053 expref: 22 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.599310:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f053 expref: 21 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.599322:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361383.599324:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361383.599327:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce200, rc 0) 00000100:00100000:3.0:1788361383.599392:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+21:27771:x1875232130615808:12345-192.168.203.60@tcp:101:cat.0 Request processed in 1181us (1427us total) trans 25769803816 rc 0/0 00000100:00100000:3.0:1788361383.599400:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:0.0:1788361383.607431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.607527:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130615936 00000100:00100000:1.0:1788361383.607549:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130615936 00000100:00100000:1.0:1788361383.607650:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361383.607660:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2352:x1875232130615936:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:1.0:1788361383.607678:0:31912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361383.607698:0:31912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267d7962/0xf6a94c97d6613f6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f05a expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.607765:0:31912:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31912:1875232144178304:192.168.203.60@tcp:106: 00000100:00100000:1.0:1788361383.607863:0:31912:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a89870266c0 going to sleep for 11 seconds 00002000:00010000:2.0:1788361383.612350:0:31912:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size: 0 -> 14 00002000:00010000:2.0:1788361383.612358:0:31912:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime: 1788361383 -> 1788361384 00002000:00010000:2.0:1788361383.612361:0:31912:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime: 1788361383 -> 1788361384 00000100:00100000:2.0:1788361383.612384:0:31912:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:31912:1875232144178304:192.168.203.60@tcp:106: 00010000:00010000:2.0:1788361383.612420:0:31912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000267d7962/0xf6a94c97d6613f6c lrc: 1/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f05a expref: 7 pid: 31912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.612441:0:31912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267d7962/0xf6a94c97d6613f6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f05a expref: 7 pid: 31912 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.612452:0:31912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef600, rc 0) 00000100:00100000:2.0:1788361383.612518:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2352:x1875232130615936:12345-192.168.203.60@tcp:101:cat.0 Request processed in 4859us (5097us total) trans 0 rc 301/301 00000100:00100000:2.0:1788361383.612526:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361383.619052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.619189:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130616064 00000100:00100000:1.0:1788361383.619198:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130616064 00000100:00100000:1.0:1788361383.619245:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:1.0:1788361383.619254:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:27771:x1875232130616064:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:1.0:1788361383.619270:0:32018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361383.619284:0:32018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f061 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.619313:0:32018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 6 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.619322:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xa2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361383.619326:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361383.619331:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 4/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 7 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.619360:0:32018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 6 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.619389:0:32018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 6 pid: 31913 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.619403:0:32018:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:32018:1875232144178432:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361383.619472:0:32018:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8987026b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361383.621668:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.621730:0:31920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130616192 00000100:00100000:3.0:1788361383.621738:0:31920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130616192 00002000:00100000:3.0:1788361383.621787:0:31920:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa2:0x0] (0->13) req@ffff9a8a89f27800 x1875232130616192/t0(0) o4->a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp:444/0 lens 504/0 e 0 to 0 dl 1788361394 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361383.621797:0:31920:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f27800 with x1875232130616192 ext(0->13) 00010000:00010000:3.0:1788361383.621806:0:31920:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 7 pid: 31913 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.621830:0:31920:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 7 pid: 31913 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361383.621838:0:31920:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8a89f27800 00000100:00100000:3.0:1788361383.621871:0:31920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361383.621880:0:31920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3538730-0385-4711-b11c-bb6af99a7674+7:2350:x1875232130616192:12345-192.168.203.60@tcp:4:bash.0 00000100:00100000:3.0:1788361383.622528:0:31920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3538730-0385-4711-b11c-bb6af99a7674+9:2350:x1875232130616192:12345-192.168.203.60@tcp:4:bash.0 Request processed in 647us (863us total) trans 25769803784 rc 0/0 00000100:00100000:3.0:1788361383.622537:0:31920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00002000:00100000:3.0:1788361383.622546:0:31920:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa2:0x0] (0->13) req@ffff9a8a89f27800 x1875232130616192/t25769803784(0) o4->a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp:444/0 lens 504/448 e 0 to 0 dl 1788361394 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361383.622554:0:31920:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f27800 with x1875232130616192 ext(0->13) 00010000:00010000:3.0:1788361383.622560:0:31920:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 9 pid: 31913 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.622572:0:31920:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 9 pid: 31913 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361383.622579:0:31920:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8a89f27800 00000100:00100000:1.0:1788361383.622726:0:32018:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:32018:1875232144178432:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361383.622763:0:32018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 3/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 7 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.622779:0:32018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef800, rc 0) 00000100:00100000:1.0:1788361383.622801:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:27771:x1875232130616064:12345-192.168.203.60@tcp:101:cat.0 Request processed in 3549us (3758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361383.622808:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1788361383.626174:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.626265:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130616320 00000100:00100000:0.0:1788361383.626339:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130616320 00010000:00010000:0.0:1788361383.626379:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 9 pid: 31913 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.626455:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:0.0:1788361383.626464:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3538730-0385-4711-b11c-bb6af99a7674+9:2352:x1875232130616320:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361383.626479:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361383.626500:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 9 pid: 31913 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.626529:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 9 pid: 31913 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.626552:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092887711/0xf6a94c97d6613f11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f045 expref: 9 pid: 31913 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.626587:0:31264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361383.626592:0:31264:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361383.626600:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 6 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.626611:0:31264:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 6 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.626649:0:31264:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 6 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.626663:0:31264:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f26680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:31264:1875232144178560:192.168.203.60@tcp:105: 00000100:00100000:0.0:1788361383.626747:0:31264:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8512ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361383.629801:0:31264:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f26680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:31264:1875232144178560:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361383.629828:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361383.629927:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3538730-0385-4711-b11c-bb6af99a7674+8:2352:x1875232130616320:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3462us (3760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361383.629938:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1788361383.631360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.631812:0:31919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130616448 00000100:00100000:3.0:1788361383.631822:0:31919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130616448 00002000:00100000:3.0:1788361383.631866:0:31919:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa2:0x0] (0->4095) req@ffff9a8986704a80 x1875232130616448/t0(0) o3->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:444/0 lens 488/0 e 0 to 0 dl 1788361394 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361383.631896:0:31919:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986704a80 with x1875232130616448 ext(0->4095) 00002000:00010000:3.0:1788361383.631902:0:31919:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8986704a80 00000100:00100000:3.0:1788361383.631934:0:31919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361383.631942:0:31919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130616448:12345-192.168.203.60@tcp:3:cat.0 00000100:00100000:3.0:1788361383.632154:0:31919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130616448:12345-192.168.203.60@tcp:3:cat.0 Request processed in 211us (799us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788361383.632161:0:31919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00002000:00100000:3.0:1788361383.632168:0:31919:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa2:0x0] (0->4095) req@ffff9a8986704a80 x1875232130616448/t0(0) o3->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:444/0 lens 488/4536 e 0 to 0 dl 1788361394 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361383.632176:0:31919:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986704a80 with x1875232130616448 ext(0->4095) 00002000:00010000:3.0:1788361383.632180:0:31919:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8986704a80 00000100:00100000:2.0:1788361383.636079:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.636240:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130616704 00000100:00100000:3.0:1788361383.636250:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130616704 00000100:00100000:3.0:1788361383.636314:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361383.636324:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+21:27771:x1875232130616704:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:3.0:1788361383.636547:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+22:27771:x1875232130616704:12345-192.168.203.60@tcp:35:cat.0 Request processed in 214us (467us total) trans 25769803817 rc 0/0 00000100:00100000:3.0:1788361383.636556:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361383.726210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.726976:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130616960 00000100:00100000:3.0:1788361383.726986:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130616960 00000100:00100000:3.0:1788361383.727042:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361383.727053:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+22:27731:x1875232130616960:12345-192.168.203.60@tcp:35:multiop.0 00000100:00100000:3.0:1788361383.727317:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+23:27731:x1875232130616960:12345-192.168.203.60@tcp:35:multiop.0 Request processed in 265us (1117us total) trans 25769803818 rc 0/0 00000100:00100000:3.0:1788361383.727337:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361383.763867:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.763957:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130617216 00000100:00100000:1.0:1788361383.763965:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130617216 00000100:00100000:1.0:1788361383.764014:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:1.0:1788361383.764024:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+23:27792:x1875232130617216:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:1.0:1788361383.764049:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361383.764077:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eec00/0xf6a94c97d6613f7a lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f068 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.764284:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613f81 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.764301:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613f81 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.764313:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613f81 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361383.764326:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:1.0:1788361383.764459:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eec00/0xf6a94c97d6613f7a lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f068 expref: 26 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.764478:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613f81 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f068 expref: 25 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.764486:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:1.0:1788361383.764489:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788361383.764492:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841efe00, rc 0) 00000100:00100000:1.0:1788361383.764549:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+25:27792:x1875232130617216:12345-192.168.203.60@tcp:101:cat.0 Request processed in 527us (692us total) trans 25769803819 rc 0/0 00000100:00100000:1.0:1788361383.764556:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:2.0:1788361383.783364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.783469:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130617472 00000100:00100000:3.0:1788361383.783479:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130617472 00000100:00100000:3.0:1788361383.783581:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:3.0:1788361383.783591:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+11:27793:x1875232130617472:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1788361383.783614:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361383.783633:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f8f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f06f expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.783699:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f96 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.783714:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f96 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.783726:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f96 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.783739:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f9d lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.783745:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f9d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.783764:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f9d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784057:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784076:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784109:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361383.784120:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:3.0:1788361383.784203:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f96 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784211:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f96 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784218:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f96 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784224:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.784228:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f96 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784236:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f96 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784246:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:3.0:1788361383.784249:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361383.784253:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f96 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784259:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613f96 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784271:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f9d lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784282:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f9d lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784288:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f9d lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784292:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361383.784295:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f9d lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784301:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f9d lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784308:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x45e4fb06 (ffff9a8a983f4300) 00010000:00010000:3.0:1788361383.784310:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361383.784313:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f9d lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784318:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613f9d lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x45e4fb06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784356:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613f8f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f06f expref: 14 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784368:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f06f expref: 13 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.784375:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361383.784377:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361383.784387:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf600, rc 0) 00000100:00100000:3.0:1788361383.784450:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+13:27793:x1875232130617472:12345-192.168.203.60@tcp:101:cat.0 Request processed in 860us (1094us total) trans 25769803820 rc 0/0 00000100:00100000:3.0:1788361383.784458:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:0.0:1788361383.787453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.787634:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130617600 00000100:00100000:2.0:1788361383.787652:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130617600 00000100:00100000:2.0:1788361383.787742:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1788361383.787761:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3538730-0385-4711-b11c-bb6af99a7674+8:2349:x1875232130617600:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:2.0:1788361383.787780:0:31914:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361383.787797:0:31914:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613fb2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f076 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.787823:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361383.787827:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361383.787836:0:31914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f076 expref: 9 pid: 31914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.787851:0:31914:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f076 expref: 9 pid: 31914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.787864:0:31914:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8c00, rc 0) 00000100:00100000:2.0:1788361383.787923:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3538730-0385-4711-b11c-bb6af99a7674+9:2349:x1875232130617600:12345-192.168.203.60@tcp:101:cat.0 Request processed in 173us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361383.787930:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:0.0:1788361383.792301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.792384:0:31920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130617728 00000100:00100000:3.0:1788361383.792394:0:31920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130617728 00002000:00100000:3.0:1788361383.792449:0:31920:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa2:0x0] (0->4095) req@ffff9a8a89f24a80 x1875232130617728/t0(0) o3->a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp:444/0 lens 488/0 e 0 to 0 dl 1788361394 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361383.792460:0:31920:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24a80 with x1875232130617728 ext(0->4095) 00002000:00010000:3.0:1788361383.792465:0:31920:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24a80 00000100:00100000:3.0:1788361383.792498:0:31920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1788361383.792507:0:31920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3538730-0385-4711-b11c-bb6af99a7674+9:2350:x1875232130617728:12345-192.168.203.60@tcp:3:cat.0 00000100:00100000:3.0:1788361383.792847:0:31920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a3538730-0385-4711-b11c-bb6af99a7674+9:2350:x1875232130617728:12345-192.168.203.60@tcp:3:cat.0 Request processed in 339us (554us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788361383.792855:0:31920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00002000:00100000:3.0:1788361383.792861:0:31920:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa2:0x0] (0->4095) req@ffff9a8a89f24a80 x1875232130617728/t0(0) o3->a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp:444/0 lens 488/4536 e 0 to 0 dl 1788361394 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361383.792870:0:31920:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24a80 with x1875232130617728 ext(0->4095) 00002000:00010000:3.0:1788361383.792874:0:31920:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24a80 00000100:00100000:3.0:1788361383.796352:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.796428:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130617984 00000100:00100000:1.0:1788361383.796438:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130617984 00000100:00100000:1.0:1788361383.796492:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361383.796501:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3538730-0385-4711-b11c-bb6af99a7674+13:27793:x1875232130617984:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:1.0:1788361383.796926:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3538730-0385-4711-b11c-bb6af99a7674+14:27793:x1875232130617984:12345-192.168.203.60@tcp:35:cat.0 Request processed in 425us (581us total) trans 25769803821 rc 0/0 00000100:00100000:1.0:1788361383.796934:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361383.802230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.802509:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130618240 00000100:00100000:3.0:1788361383.802520:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130618240 00000100:00100000:3.0:1788361383.802618:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:3.0:1788361383.802628:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3538730-0385-4711-b11c-bb6af99a7674+14:25471:x1875232130618240:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361383.802652:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361383.802682:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6613fb9 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f07d expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.802791:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.802807:0:31281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f053 expref: 24 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.802815:0:31281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f06f expref: 15 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.802823:0:31281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 5/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.802857:0:31281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f06f expref: 15 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.802871:0:31281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f06f expref: 15 pid: 31279 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.802884:0:31281:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144178688:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361383.802998:0:31281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f053 expref: 24 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.803009:0:31281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f053 expref: 24 pid: 31280 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.803018:0:31281:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144178816:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361383.803052:0:31281:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361383.806650:0:31281:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144178688:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361383.806661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.806673:0:31281:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144178816:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361383.806711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1788361383.806939:0:31281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.807273:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130618496 00000100:00100000:0.0:1788361383.807281:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130618496 00010000:00010000:0.0:1788361383.807320:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f053 expref: 25 pid: 31280 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.807390:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130618368 00000100:00100000:0.0:1788361383.807394:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130618368 00010000:00010000:0.0:1788361383.807407:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f06f expref: 16 pid: 31279 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.807439:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361383.807447:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+25:2350:x1875232130618496:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361383.807463:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361383.807470:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f053 expref: 25 pid: 31280 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807482:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f053 expref: 25 pid: 31280 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807505:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6613f5e lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f053 expref: 25 pid: 31280 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807522:0:31265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:0.0:1788361383.807527:0:31265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807537:0:31265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807543:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361383.807596:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+24:2350:x1875232130618496:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 148us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361383.807603:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361383.807622:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361383.807630:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3538730-0385-4711-b11c-bb6af99a7674+16:2350:x1875232130618368:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361383.807651:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361383.807657:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f06f expref: 16 pid: 31279 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807669:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f06f expref: 16 pid: 31279 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807695:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6613fa4 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f06f expref: 16 pid: 31279 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807707:0:31265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:0.0:1788361383.807710:0:31265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807719:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807728:0:31265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807762:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361383.807781:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3538730-0385-4711-b11c-bb6af99a7674+15:2350:x1875232130618368:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 152us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361383.807788:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00010000:00010000:0.0:1788361383.807809:0:31281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.807816:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361383.807948:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x2:0x0]: returning size 14 00010000:00010000:0.0:1788361383.808119:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6613fb9 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f07d expref: 16 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.808135:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f07d expref: 15 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361383.808143:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:0.0:1788361383.808146:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361383.808149:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cfe00, rc 0) 00000100:00100000:0.0:1788361383.808173:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3538730-0385-4711-b11c-bb6af99a7674+15:25471:x1875232130618240:12345-192.168.203.60@tcp:101:bash.0 Request processed in 5547us (5952us total) trans 25769803822 rc 0/0 00000100:00100000:0.0:1788361383.808192:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:0.0:1788361383.811650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361383.811795:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130618752 00000100:00100000:1.0:1788361383.811804:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130618752 00000100:00100000:1.0:1788361383.811914:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:1.0:1788361383.811923:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+15:25471:x1875232130618752:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:1.0:1788361383.812457:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.812475:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361383.812487:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361383.812541:0:31280:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803823 00000004:00010000:1.0:1788361383.812565:0:31280:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071684877 reply state 0000000014da84a9 transno 25769803824 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361383.812575:0:31280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361383.812671:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+18:25471:x1875232130618752:12345-192.168.203.60@tcp:36:bash.0 Request processed in 748us (1028us total) trans 25769803824 rc 0/0 00000100:00100000:1.0:1788361383.812685:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000020:00080000:1.0:1788361383.812690:0:31280:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788361383.816198:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.816214:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.816221:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.816227:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ee400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361383.816231:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.816239:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.816256:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:2.0:1788361383.816259:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361383.816263:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.816269:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6613fce lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361383.816788:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.816902:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130618880 00000100:00100000:2.0:1788361383.816910:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130618880 00000100:00100000:2.0:1788361383.816966:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:2.0:1788361383.816975:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+9:25471:x1875232130618880:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361383.816991:0:31913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361383.817006:0:31913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d6613fd5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f084 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.817050:0:31913:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 6 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.817059:0:31913:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613fb2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f076 expref: 10 pid: 31914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.817065:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361383.817069:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361383.817074:0:31913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d6613fd5 lrc: 5/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f084 expref: 10 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.817139:0:31913:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f076 expref: 10 pid: 31914 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.817153:0:31913:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613fb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f076 expref: 10 pid: 31914 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361383.817167:0:31913:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31913:1875232144178944:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361383.817238:0:31913:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 6 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.817248:0:31913:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 6 pid: 32018 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361383.817268:0:31913:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31913:1875232144179072:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361383.817294:0:31913:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361383.820593:0:31913:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31913:1875232144178944:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361383.820607:0:31913:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31913:1875232144179072:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361383.820634:0:31913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d6613fd5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f084 expref: 10 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361383.820653:0:31913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:2.0:1788361383.820736:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+10:25471:x1875232130618880:12345-192.168.203.60@tcp:101:bash.0 Request processed in 3761us (3951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361383.820744:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361383.822282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361383.822794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361383.823219:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130619136 00000100:00100000:3.0:1788361383.823228:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130619136 00010000:00010000:3.0:1788361383.823264:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 7 pid: 32018 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.823311:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130619008 00000100:00100000:3.0:1788361383.823315:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130619008 00010000:00010000:3.0:1788361383.823329:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613fb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f076 expref: 10 pid: 31914 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.823345:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788361383.823352:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2350:x1875232130619136:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361383.823365:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361383.823371:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 7 pid: 32018 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.823382:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 7 pid: 32018 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.823406:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050f105ed/0xf6a94c97d6613f73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f061 expref: 7 pid: 32018 timeout: 873 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.823438:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361383.823494:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130619136:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 141us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361383.823502:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788361383.823519:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:3.0:1788361383.823526:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3538730-0385-4711-b11c-bb6af99a7674+10:2349:x1875232130619008:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361383.823535:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361383.823540:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613fb2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f076 expref: 10 pid: 31914 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.823552:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613fb2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f076 expref: 10 pid: 31914 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.823566:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e7ebdf2/0xf6a94c97d6613fb2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f076 expref: 10 pid: 31914 timeout: 873 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.823577:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361383.823581:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361383.823588:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d6613fd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f084 expref: 9 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.823597:0:31265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d6613fd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080080020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f084 expref: 9 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361383.823643:0:31265:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d6613fd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f084 expref: 9 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361383.823656:0:31265:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:31265:1875232144179200:192.168.203.60@tcp:105: 00000100:00100000:3.0:1788361383.823876:0:31265:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7145780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361383.826774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361383.827140:0:31918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130619264 00000100:00100000:2.0:1788361383.827151:0:31918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130619264 00002000:00010000:2.0:1788361383.827187:0:31918:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/162 (0->18446744073709551615) 00002000:00100000:2.0:1788361383.827193:0:31918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a90b2c000 with x1875232130619264 ext(0->18446744073709551615) 00002000:00010000:2.0:1788361383.827204:0:31918:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a90b2c000. 00000100:00100000:2.0:1788361383.827236:0:31918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361383.827244:0:31918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3538730-0385-4711-b11c-bb6af99a7674+10:2350:x1875232130619264:12345-192.168.203.60@tcp:10:bash.0 00000100:00100000:1.0:1788361383.827545:0:31265:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:31265:1875232144179200:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361383.827582:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1788361383.827605:0:31918:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 14 -> 0 00002000:00010000:2.0:1788361383.827609:0:31918:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb mtime from disk: 1788361384 -> 1788361384 00002000:00010000:2.0:1788361383.827612:0:31918:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb atime from disk: 1788361379 -> 1788361379 00002000:00010000:2.0:1788361383.827615:0:31918:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb ctime from disk: 1788361384 -> 1788361384 00002000:00010000:2.0:1788361383.827618:0:31918:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788361383.827691:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3538730-0385-4711-b11c-bb6af99a7674+11:2349:x1875232130619008:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 4156us (4890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361383.827701:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788361383.827715:0:31918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3538730-0385-4711-b11c-bb6af99a7674+10:2350:x1875232130619264:12345-192.168.203.60@tcp:10:bash.0 Request processed in 468us (946us total) trans 25769803785 rc 0/0 00000100:00100000:2.0:1788361383.827723:0:31918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00002000:00010000:2.0:1788361383.827727:0:31918:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/162 (0->18446744073709551615) 00002000:00100000:2.0:1788361383.827730:0:31918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a90b2c000 with x1875232130619264 ext(0->18446744073709551615) 00002000:00010000:2.0:1788361383.827735:0:31918:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a90b2c000. 00010000:00010000:2.0:1788361384.032319:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361384.074082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361384.074221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361384.074252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361384.074387:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130619648 00000100:00100000:1.0:1788361384.074396:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130619648 00000100:00100000:1.0:1788361384.074460:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130619520 00000100:00100000:1.0:1788361384.074463:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130619520 00000100:00100000:1.0:1788361384.074489:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361384.074499:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3538730-0385-4711-b11c-bb6af99a7674+5:2352:x1875232130619648:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361384.074574:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3538730-0385-4711-b11c-bb6af99a7674+5:2352:x1875232130619648:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 76us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361384.074581:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361384.074598:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361384.074605:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2352:x1875232130619520:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361384.074629:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2352:x1875232130619520:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361384.074644:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00080000:0.0:1788361384.074796:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361384.075158:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130619392 00000100:00100000:3.0:1788361384.075162:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130619392 00000100:00100000:3.0:1788361384.075231:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:3.0:1788361384.075239:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+13:2352:x1875232130619392:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361384.075340:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87181850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+13:2352:x1875232130619392:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 101us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361384.075347:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00010000:00010000:1.0:1788361385.058167:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361385.120702:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361385.120722:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144179328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361385.120793:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361385.120865:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144179328 00000100:00100000:1.0:1788361385.120873:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144179328 00000100:00100000:1.0:1788361385.120922:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361385.120931:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144179328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361385.120968:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361385.121008:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144179328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361385.121015:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788361385.121035:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361385.121066:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144179328:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361386.081941:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361386.707979:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361386.708546:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130619776 00000100:00100000:1.0:1788361386.708556:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130619776 00000100:00100000:1.0:1788361386.708634:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:1.0:1788361386.708645:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+24:27681:x1875232130619776:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1788361386.708762:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361386.708764:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+24:27681:x1875232130619776:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 120us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361386.708773:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:1.0:1788361386.712973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361386.713068:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130620032 00000100:00100000:3.0:1788361386.713079:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130620032 00000100:00100000:3.0:1788361386.713165:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361386.713176:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+24:27681:x1875232130620032:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361386.713606:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+25:27681:x1875232130620032:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 431us (643us total) trans 25769803825 rc 0/0 00000100:00100000:3.0:1788361386.713613:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:2.0:1788361387.104526:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361387.168323:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144179840:0@lo:400:kworker.0 00000100:00100000:3.0:1788361387.168332:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144179584:0@lo:400:kworker.0 00000100:00100000:2.0:1788361387.168446:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25ae0af-c16d-4164-9502-26eb1af82516:3313:1875232144179456:0@lo:400:kworker.0 00000100:00100000:1.0:1788361387.169621:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144179712:0@lo:400:kworker.0 00000100:00100000:0.0:1788361387.172506:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361387.172594:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144179840 00000100:00100000:0.0:1788361387.172601:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144179840 00000100:00100000:0.0:1788361387.172642:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361387.172651:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144179840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361387.172734:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144179840:12345-0@lo:400:kworker.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361387.172742:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361387.172792:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144179840:0@lo:400:kworker.0 00000100:00100000:2.0:1788361387.173248:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361387.173321:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361387.173348:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144179712 00000100:00100000:1.0:1788361387.173353:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144179712 00000100:00100000:0.0:1788361387.173488:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361387.173517:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144179584 00000100:00100000:1.0:1788361387.173521:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144179584 00000100:00100000:0.0:1788361387.173531:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361387.173540:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abee1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144179712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361387.173580:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abee1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144179712:12345-0@lo:400:kworker.0 Request processed in 41us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361387.173586:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361387.173701:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361387.173710:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144179584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361387.173770:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144179584:12345-0@lo:400:kworker.0 Request processed in 61us (282us total) trans 0 rc 0/0 00000100:00080000:0.0:1788361387.173773:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361387.173779:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361387.173780:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361387.173819:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144179456 00000100:00100000:1.0:1788361387.173830:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144179456 00000100:00100000:2.0:1788361387.173891:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144179968:0@lo:400:kworker.0 00000100:00100000:1.0:1788361387.173893:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788361387.173904:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:3313:x1875232144179456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361387.173943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361387.173947:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87183450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a25ae0af-c16d-4164-9502-26eb1af82516+19:3313:x1875232144179456:12345-0@lo:400:kworker.0 Request processed in 42us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361387.173955:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788361387.173987:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25ae0af-c16d-4164-9502-26eb1af82516:3313:1875232144179456:0@lo:400:kworker.0 00000100:00100000:1.0:1788361387.173999:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144179968 00000100:00100000:1.0:1788361387.174004:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144179968 00000100:00080000:2.0:1788361387.174035:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361387.174043:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361387.174052:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144179968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361387.174123:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144179968:12345-0@lo:400:kworker.0 Request processed in 73us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361387.174130:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788361387.174164:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144179968:0@lo:400:kworker.0 00000100:00100000:1.0:1788361387.177824:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144179584:0@lo:400:kworker.0 00000100:00100000:1.0:1788361387.177838:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144180096:0@lo:400:kworker.0 00000100:00100000:0.0:1788361387.177860:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144179712:0@lo:400:kworker.0 00000100:00100000:0.0:1788361387.177872:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144180224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361387.177893:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361387.177909:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361387.177960:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144180224 00000100:00100000:0.0:1788361387.177966:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144180224 00000100:00100000:2.0:1788361387.177995:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144180096 00000100:00100000:2.0:1788361387.178000:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144180096 00000100:00100000:0.0:1788361387.178019:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361387.178030:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144180224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361387.178042:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361387.178052:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144180096:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788361387.178059:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361387.178121:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144180224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361387.178136:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144180096:12345-0@lo:400:kworker.0 Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361387.178144:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361387.178148:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788361387.178171:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361387.178192:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144180224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361387.178203:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144180096:0@lo:400:kworker.0 00000001:00080000:1.0:1788361387.195315:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803780 is committed 00000100:00100000:3.0:1788361387.657850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361387.657889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361387.658018:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130620288 00000100:00100000:1.0:1788361387.658027:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130620288 00000100:00100000:1.0:1788361387.658120:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:1.0:1788361387.658127:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3538730-0385-4711-b11c-bb6af99a7674+10:2350:x1875232130620288:12345-192.168.203.60@tcp:16:kworker.0 00000100:00100000:0.0:1788361387.658328:0:31919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130620160 00000100:00100000:0.0:1788361387.658333:0:31919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130620160 00002000:00100000:0.0:1788361387.658359:0:31919:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa2:0x0] (0->13) req@ffff9a89859b1880 x1875232130620160/t0(0) o4->a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp:448/0 lens 504/0 e 0 to 0 dl 1788361398 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361387.658369:0:31919:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b1880 with x1875232130620160 ext(0->13) 00002000:00010000:0.0:1788361387.658376:0:31919:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b1880 00000100:00100000:0.0:1788361387.658401:0:31919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361387.658409:0:31919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3538730-0385-4711-b11c-bb6af99a7674+11:2350:x1875232130620160:12345-192.168.203.60@tcp:4:bash.0 00000100:00100000:0.0:1788361387.658849:0:31919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3538730-0385-4711-b11c-bb6af99a7674+13:2350:x1875232130620160:12345-192.168.203.60@tcp:4:bash.0 Request processed in 439us (1005us total) trans 25769803786 rc 0/0 00000100:00100000:0.0:1788361387.658857:0:31919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00002000:00100000:0.0:1788361387.658864:0:31919:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xa2:0x0] (0->13) req@ffff9a89859b1880 x1875232130620160/t25769803786(0) o4->a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp:448/0 lens 504/448 e 0 to 0 dl 1788361398 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361387.658872:0:31919:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b1880 with x1875232130620160 ext(0->13) 00002000:00010000:0.0:1788361387.658875:0:31919:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b1880 00000100:00080000:2.0:1788361387.666079:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788361387.715121:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803785 is committed 00000001:00080000:3.0:1788361387.715138:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803782 is committed 00000001:00080000:3.0:1788361387.715153:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803781 is committed 00000100:00100000:2.0:1788361387.715707:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a3538730-0385-4711-b11c-bb6af99a7674+8:2350:x1875232130620288:12345-192.168.203.60@tcp:16:kworker.0 Request processed in 57573us (57808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361387.715718:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00010000:00010000:1.0:1788361388.128787:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788361388.738752:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803822 is committed 00000001:00080000:3.0:1788361388.738770:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803807 is committed 00000001:00080000:3.0:1788361388.738781:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803824 is committed 00000001:00080000:3.0:1788361388.738789:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803819 is committed 00000020:00080000:3.0:1788361388.738799:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a8512e240 refcount 2 committed 0 result 0 batchid 21474836517 00000020:00080000:3.0:1788361388.738804:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a82848800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a8512e300 00000020:00080000:3.0:1788361388.738807:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a82848900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8aa94e0c00 00000020:00080000:0.0:1788361388.738824:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836517 committed batchid 21474836516 00000001:00080000:3.0:1788361388.738829:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803825 is committed 00000020:00080000:0.0:1788361388.739558:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836516 00000001:02000400:2.0:1788361388.927041:0:33498:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 3a: Repeat attach/detach operations === 11:03:08 (1788361388) 00000100:00100000:3.0:1788361389.095238:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.095336:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130620544 00000100:00100000:2.0:1788361389.095347:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130620544 00000100:00100000:2.0:1788361389.095429:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:2.0:1788361389.095438:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+10:28430:x1875232130620544:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361389.095461:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788361389.095476:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788361389.095481:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613fdc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f08b expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.095565:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613fe3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.095579:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613fe3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.095592:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613fe3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.095606:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613fea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.095613:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613fea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.095619:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613fea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096368:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ff1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096380:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096388:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361389.096398:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788361389.096672:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613fe3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096680:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613fe3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096687:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096704:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.096708:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096729:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613fe3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096742:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:3.0:1788361389.096745:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.096749:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613fe3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096754:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6613fe3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096765:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613fea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096771:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613fea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096777:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613fea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096782:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.096784:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613fea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096790:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613fea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096807:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8ac20d4b00) 00010000:00010000:3.0:1788361389.096809:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.096812:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613fea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.096818:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6613fea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.097214:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6613fdc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f08b expref: 13 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.097229:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f08b expref: 12 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.097236:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361389.097238:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.097240:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf800, rc 0) 00000100:00100000:3.0:1788361389.097307:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:28430:x1875232130620544:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1869us (2076us total) trans 25769803826 rc 0/0 00000100:00100000:3.0:1788361389.097316:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:0.0:1788361389.101217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.101255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.101277:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130620672 00000100:00100000:1.0:1788361389.101287:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130620672 00000100:00100000:1.0:1788361389.101355:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:1.0:1788361389.101377:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:2350:x1875232130620672:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361389.101408:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788361389.101412:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130620800 00000100:00100000:2.0:1788361389.101426:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130620800 00010000:00010000:1.0:1788361389.101433:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6613ff1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f08b expref: 13 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.101454:0:31264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:1.0:1788361389.101459:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361389.101464:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1788361389.101474:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:28430:x1875232130620800:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788361389.101556:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:2350:x1875232130620672:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 190us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.101565:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:2.0:1788361389.101822:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:28430:x1875232130620800:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 348us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.101829:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00010000:00010000:0.0:1788361389.154938:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361389.176999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.178664:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130621056 00000100:00100000:3.0:1788361389.178678:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130621056 00000100:00100000:3.0:1788361389.178816:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:3.0:1788361389.178826:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:28445:x1875232130621056:12345-192.168.203.60@tcp:36:mkdir.0 00010000:00010000:3.0:1788361389.178886:0:31281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361389.178913:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6613ca2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef81 expref: 11 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.178955:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:3.0:1788361389.178961:0:31281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361389.179299:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.179313:0:31281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff1 expref: 8 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.179320:0:31281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.179351:0:31281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff1 expref: 8 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.179363:0:31281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff1 expref: 8 pid: 31279 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.179376:0:31281:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144180352:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361389.179477:0:31281:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85087780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361389.181966:0:31281:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144180352:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361389.181992:0:31281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.183449:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.187303:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130621184 00000100:00100000:3.0:1788361389.187317:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130621184 00010000:00010000:3.0:1788361389.187373:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff1 expref: 9 pid: 31279 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.187442:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361389.187452:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9eaba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3538730-0385-4711-b11c-bb6af99a7674+9:2349:x1875232130621184:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361389.187472:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361389.187479:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff1 expref: 9 pid: 31279 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.187492:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff1 expref: 9 pid: 31279 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788361389.187637:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788361389.187793:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6613e00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff1 expref: 9 pid: 31279 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.187809:0:31265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:3.0:1788361389.187815:0:31265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.187824:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.187831:0:31265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.187912:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361389.187977:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9eaba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3538730-0385-4711-b11c-bb6af99a7674+8:2349:x1875232130621184:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 526us (4533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.187986:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00010000:00010000:2.0:1788361389.189591:0:31281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.189606:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.189632:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.189653:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.189665:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.191593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.191637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.191677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.191696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.191734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.191766:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130621440 00000100:00100000:1.0:1788361389.191775:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130621440 00000100:00100000:1.0:1788361389.191832:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130621696 00000100:00100000:1.0:1788361389.191836:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130621696 00000100:00100000:1.0:1788361389.191854:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130621568 00000100:00100000:1.0:1788361389.191857:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130621568 00000100:00100000:1.0:1788361389.191873:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130621824 00000100:00100000:1.0:1788361389.191876:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130621824 00000100:00100000:1.0:1788361389.191892:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361389.191901:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2352:x1875232130621440:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361389.191971:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2352:x1875232130621440:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 70us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.191995:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361389.192014:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:1.0:1788361389.192021:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3538730-0385-4711-b11c-bb6af99a7674+8:2352:x1875232130621696:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361389.192051:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3538730-0385-4711-b11c-bb6af99a7674+8:2352:x1875232130621696:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.192058:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:1.0:1788361389.192074:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1788361389.192080:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2352:x1875232130621568:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361389.192140:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2352:x1875232130621568:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 60us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.192146:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1788361389.192157:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361389.192163:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3538730-0385-4711-b11c-bb6af99a7674+5:2352:x1875232130621824:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361389.192184:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3538730-0385-4711-b11c-bb6af99a7674+5:2352:x1875232130621824:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 21us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.192190:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00080000:1.0:1788361389.192209:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361389.192213:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361389.192610:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130621312 00000100:00100000:3.0:1788361389.192624:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130621312 00000100:00100000:3.0:1788361389.192654:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:3.0:1788361389.192660:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+13:2352:x1875232130621312:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361389.192687:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87182c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:76414060-9cd0-4e10-991c-7eaed84bf288+13:2352:x1875232130621312:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.192693:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000004:00200000:2.0:1788361389.193012:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 512 00010000:00010000:2.0:1788361389.193027:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.193037:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.193045:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.193051:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.193062:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.193070:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.193099:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:2.0:1788361389.193103:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361389.193107:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.193114:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6613fff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361389.193136:0:31281:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000984cc102 reply state 00000000f6e6a9a1 transno 25769803827 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361389.193145:0:31281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361389.193212:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:28445:x1875232130621056:12345-192.168.203.60@tcp:36:mkdir.0 Request processed in 14386us (16220us total) trans 25769803827 rc 0/0 00000100:00100000:2.0:1788361389.193220:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00010000:00010000:2.0:1788361389.197987:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.198004:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.198011:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.198017:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.198022:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.198044:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.198060:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff9a8ac20d4200) 00010000:00010000:2.0:1788361389.198063:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361389.198067:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.198074:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614006 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.204014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.204236:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130621952 00000100:00100000:2.0:1788361389.204245:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130621952 00000100:00100000:2.0:1788361389.204303:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:2.0:1788361389.204313:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+8:28446:x1875232130621952:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361389.204337:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.204357:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661400d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f092 expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.204420:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614014 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.204434:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.204445:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361389.204502:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361389.204515:0:31280:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361389.204556:0:31280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614014 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.204581:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661400d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f092 expref: 10 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.204599:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614014 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f092 expref: 9 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.204609:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8ac20d4f00) 00010000:00010000:2.0:1788361389.204612:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361389.204615:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9800, rc 0) 00000100:00100000:2.0:1788361389.204686:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+9:28446:x1875232130621952:12345-192.168.203.60@tcp:101:dd.0 Request processed in 374us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.204693:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:1.0:1788361389.207273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.207339:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130622080 00000100:00100000:3.0:1788361389.207348:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130622080 00000100:00100000:3.0:1788361389.207396:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:3.0:1788361389.207405:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+9:28446:x1875232130622080:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1788361389.207424:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361389.207440:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661401b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f099 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207495:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614022 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207562:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614022 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207575:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614022 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207589:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614029 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207597:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207603:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207740:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf200/0xf6a94c97d6614030 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207748:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf200/0xf6a94c97d6614030 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207755:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf200/0xf6a94c97d6614030 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361389.207792:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 512 00000004:00200000:3.0:1788361389.207795:0:32594:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361389.207825:0:32594:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf200/0xf6a94c97d6614030 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207836:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614022 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207842:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614022 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207849:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614022 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207854:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.207858:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614022 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207865:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614022 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207875:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8ac20d4f00) 00010000:00010000:3.0:1788361389.207883:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.207887:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614022 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207893:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614022 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207907:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614029 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207913:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614029 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207918:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614029 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207923:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.207926:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614029 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207932:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614029 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207938:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff9a8a890c3500) 00010000:00010000:3.0:1788361389.207940:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.207942:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614029 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207948:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614029 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.207974:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661401b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f099 expref: 11 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.208012:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf200/0xf6a94c97d6614030 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f099 expref: 10 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.208029:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361389.208032:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788361389.208035:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf200, rc 0) 00000100:00100000:3.0:1788361389.208127:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+10:28446:x1875232130622080:12345-192.168.203.60@tcp:101:dd.0 Request processed in 722us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.208134:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:3.0:1788361389.210454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.210513:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130622336 00000100:00100000:2.0:1788361389.210523:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130622336 00000100:00100000:2.0:1788361389.210698:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1788361389.210708:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+10:28446:x1875232130622336:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361389.210739:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.210757:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614037 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0a0 expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.210882:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661403e lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.210898:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661403e lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.210931:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661403e lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.210945:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.210952:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.210958:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361389.211784:0:31280:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa3:0x0], index 1: 0 00010000:00010000:2.0:1788361389.211939:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.211948:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.211957:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.211989:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661403e lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.211996:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661403e lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.212003:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661403e lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.212008:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.212019:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661403e lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.212026:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661403e lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.212037:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361389.212040:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361389.212044:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661403e lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.212050:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661403e lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361389.212063:0:31280:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031de933c reply state 00000000aee3696c transno 25769803828 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361389.212073:0:31280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361389.212128:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614037 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a0 expref: 13 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.212142:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a0 expref: 12 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.212149:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4600) 00010000:00010000:2.0:1788361389.212151:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361389.212153:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9200, rc 0) 00000100:00100000:2.0:1788361389.212225:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+13:28446:x1875232130622336:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1519us (1778us total) trans 25769803828 rc 0/0 00000100:00100000:2.0:1788361389.212234:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:0.0:1788361389.217677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.217762:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130622464 00000100:00100000:1.0:1788361389.217772:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130622464 00010000:00010000:2.0:1788361389.217789:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.217803:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.217812:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.217819:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.217824:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.217833:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.217835:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361389.217849:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3538730-0385-4711-b11c-bb6af99a7674+5:28446:x1875232130622464:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361389.217856:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8ac20d4200) 00010000:00010000:2.0:1788361389.217860:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361389.217864:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.217877:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614045 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.217887:0:31912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361389.217907:0:31912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0a7 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361389.217930:0:31912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361389.217949:0:31912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1788361389.217953:0:31912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361389.217964:0:31912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 6 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.217981:0:31912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 6 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.217992:0:31912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841eee00, rc 0) 00000100:00100000:1.0:1788361389.218054:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3538730-0385-4711-b11c-bb6af99a7674+6:28446:x1875232130622464:12345-192.168.203.60@tcp:101:dd.0 Request processed in 208us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.218061:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361389.221736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.221783:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130622720 00000100:00100000:3.0:1788361389.221882:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130622720 00000100:00100000:3.0:1788361389.221942:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361389.221952:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3538730-0385-4711-b11c-bb6af99a7674+12:28446:x1875232130622720:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:3.0:1788361389.222885:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3538730-0385-4711-b11c-bb6af99a7674+13:28446:x1875232130622720:12345-192.168.203.60@tcp:35:dd.0 Request processed in 931us (1153us total) trans 25769803829 rc 0/0 00000100:00100000:3.0:1788361389.222894:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361389.254384:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.254479:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130622848 00000100:00100000:3.0:1788361389.254490:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130622848 00000100:00100000:3.0:1788361389.254553:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:3.0:1788361389.254563:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+11:28452:x1875232130622848:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361389.254589:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361389.254611:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614061 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0ae expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.254694:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614068 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.254707:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.254729:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361389.254787:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788361389.254792:0:31281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361389.254814:0:31281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.254838:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ae expref: 13 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.254859:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614068 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ae expref: 12 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.254867:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8ac20d4f00) 00010000:00010000:3.0:1788361389.254870:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361389.254874:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cee00, rc 0) 00000100:00100000:3.0:1788361389.254936:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:28452:x1875232130622848:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 374us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.254943:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:0.0:1788361389.257177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.257251:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130622976 00000100:00100000:2.0:1788361389.257260:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130622976 00000100:00100000:2.0:1788361389.257318:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:2.0:1788361389.257327:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+12:28452:x1875232130622976:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361389.257632:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.257652:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d661406f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0b5 expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.257738:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614076 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.257752:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614076 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.257763:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614076 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.257777:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661407d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.257784:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661407d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.257791:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661407d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.257880:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614084 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.257889:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614084 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.257896:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614084 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361389.257931:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 512 00000004:00200000:2.0:1788361389.257935:0:31279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361389.258192:0:31279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614084 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258216:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614076 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258223:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614076 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258231:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614076 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258237:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.258242:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614076 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258250:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614076 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258262:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8ac20d4f00) 00010000:00010000:2.0:1788361389.258265:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361389.258281:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614076 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258287:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614076 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258299:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661407d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258305:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661407d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258311:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661407d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258322:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.258326:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661407d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258333:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661407d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258341:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff9a8ac20d4200) 00010000:00010000:2.0:1788361389.258344:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361389.258494:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661407d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258501:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661407d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258616:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d661406f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0b5 expref: 14 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258632:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614084 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0b5 expref: 13 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.258640:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361389.258643:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361389.258646:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8c00, rc 0) 00000100:00100000:2.0:1788361389.258709:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+13:28452:x1875232130622976:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1382us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.258726:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:1.0:1788361389.261817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.261901:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130623104 00000100:00100000:2.0:1788361389.261921:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130623104 00000100:00100000:2.0:1788361389.262012:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:2.0:1788361389.262021:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+13:28452:x1875232130623104:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361389.262040:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.262059:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661408b lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0bc expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262140:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6614092 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262153:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6614092 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262164:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6614092 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262178:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6614099 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262185:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6614099 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262191:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6614099 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262481:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262491:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262499:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361389.262537:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:2.0:1788361389.262541:0:32594:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361389.262557:0:32594:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262567:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262575:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6614092 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262581:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6614092 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262588:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6614092 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262593:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.262596:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6614092 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262603:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6614092 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262614:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361389.262617:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361389.262621:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6614092 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262627:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6614092 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262650:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6614099 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262656:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6614099 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262662:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6614099 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262667:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.262670:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6614099 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262676:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6614099 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262684:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8ac20d4a00) 00010000:00010000:2.0:1788361389.262686:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361389.262689:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6614099 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262696:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d6614099 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262739:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661408b lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0bc expref: 15 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262753:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0bc expref: 14 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.262771:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4600) 00010000:00010000:2.0:1788361389.262773:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361389.262776:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e400, rc 0) 00000100:00100000:2.0:1788361389.262891:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+14:28452:x1875232130623104:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 869us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.262898:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:3.0:1788361389.265242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.265427:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130623232 00000100:00100000:0.0:1788361389.265436:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130623232 00000100:00100000:0.0:1788361389.265509:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361389.265518:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2349:x1875232130623232:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361389.265535:0:31913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361389.265551:0:31913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2658fe8/0xf6a94c97d66140a7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0c3 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.265600:0:31913:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31913:1875232144180480:192.168.203.60@tcp:106: 00000100:00100000:0.0:1788361389.265676:0:31913:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab240 going to sleep for 11 seconds 00002000:00010000:2.0:1788361389.267686:0:31913:0:(ofd_lvb.c:260:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb size: 0 -> 1024 00002000:00010000:2.0:1788361389.267695:0:31913:0:(ofd_lvb.c:266:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb mtime: 0 -> 1788361389 00002000:00010000:2.0:1788361389.267698:0:31913:0:(ofd_lvb.c:272:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb atime: 0 -> 1788361389 00002000:00010000:2.0:1788361389.267701:0:31913:0:(ofd_lvb.c:278:ofd_lvbo_update()) res: [0x280000400:0xa3:0x0] updating lvb ctime: 0 -> 1788361389 00000100:00100000:2.0:1788361389.267732:0:31913:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:31913:1875232144180480:192.168.203.60@tcp:106: 00010000:00010000:2.0:1788361389.267764:0:31913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2658fe8/0xf6a94c97d66140a7 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0c3 expref: 6 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.267790:0:31913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2658fe8/0xf6a94c97d66140a7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0c3 expref: 6 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.267804:0:31913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965e00, rc 0) 00000100:00100000:2.0:1788361389.267896:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2349:x1875232130623232:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 2378us (2660us total) trans 0 rc 301/301 00000100:00100000:2.0:1788361389.267905:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788361389.271261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.271364:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130623488 00000100:00100000:0.0:1788361389.271373:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130623488 00000100:00100000:0.0:1788361389.271445:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788361389.271453:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+14:28452:x1875232130623488:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361389.271471:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361389.271488:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d66140ae lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0ca expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.271570:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d66140b5 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.271584:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d66140b5 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.271596:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d66140b5 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361389.271619:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:0.0:1788361389.271739:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964400/0xf6a94c97d66140ae lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ca expref: 17 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.271764:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d66140b5 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ca expref: 16 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.271772:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4600) 00010000:00010000:0.0:1788361389.271775:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361389.271778:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965400, rc 0) 00000100:00100000:0.0:1788361389.271837:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:28452:x1875232130623488:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 384us (584us total) trans 25769803830 rc 0/0 00000100:00100000:0.0:1788361389.271843:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:3.0:1788361389.276464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.276579:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130623616 00000100:00100000:1.0:1788361389.276589:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130623616 00000100:00100000:1.0:1788361389.276652:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:1.0:1788361389.276663:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:2350:x1875232130623616:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361389.276678:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361389.276702:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d66140b5 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ca expref: 16 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.276737:0:31264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4600) 00010000:00010000:1.0:1788361389.276742:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361389.276802:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:2350:x1875232130623616:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 141us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.276811:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361389.277636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.277688:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130623872 00000100:00100000:2.0:1788361389.277692:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130623872 00000100:00100000:2.0:1788361389.277730:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788361389.277739:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+15:28452:x1875232130623872:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361389.277767:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.277781:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d66140c3 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0d1 expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.277869:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66140ca lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.277884:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66140ca lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.277894:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66140ca lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361389.277905:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:2.0:1788361389.278026:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d66140c3 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d1 expref: 18 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.278042:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66140ca lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d1 expref: 17 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.278049:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4600) 00010000:00010000:2.0:1788361389.278052:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361389.278055:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:2.0:1788361389.278252:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:28452:x1875232130623872:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 513us (615us total) trans 25769803831 rc 0/0 00000100:00100000:2.0:1788361389.278260:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788361389.293371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.293557:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130624000 00000100:00100000:1.0:1788361389.293567:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130624000 00000100:00100000:1.0:1788361389.293611:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:1.0:1788361389.293618:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:28452:x1875232130624000:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361389.293634:0:31912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361389.293647:0:31912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0d8 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.293670:0:31912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 5 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.293677:0:31912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361389.293680:0:31912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361389.293683:0:31912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 6 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.293708:0:31912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 5 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.293731:0:31912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 5 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.293764:0:31912:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:31912:1875232144180608:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361389.293927:0:31912:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361389.297402:0:31912:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:31912:1875232144180608:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361389.297437:0:31912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 6 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.297457:0:31912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef400, rc 0) 00000100:00100000:1.0:1788361389.297512:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:28452:x1875232130624000:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 3893us (4150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.297521:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:2.0:1788361389.298594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.298693:0:31918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130624128 00000100:00100000:0.0:1788361389.298702:0:31918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130624128 00002000:00100000:0.0:1788361389.298754:0:31918:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa3:0x0] (0->1023) req@ffff9a8986705500 x1875232130624128/t0(0) o4->a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp:450/0 lens 1512/0 e 0 to 0 dl 1788361400 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361389.298765:0:31918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986705500 with x1875232130624128 ext(0->1023) 00010000:00010000:0.0:1788361389.298774:0:31918:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 6 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.298788:0:31918:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 6 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361389.298796:0:31918:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a8986705500 00000100:00100000:0.0:1788361389.298871:0:31918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1788361389.298899:0:31918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3538730-0385-4711-b11c-bb6af99a7674+6:2349:x1875232130624128:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361389.299788:0:31918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3538730-0385-4711-b11c-bb6af99a7674+8:2349:x1875232130624128:12345-192.168.203.60@tcp:4:dd.0 Request processed in 888us (1193us total) trans 25769803781 rc 0/0 00000100:00100000:0.0:1788361389.299798:0:31918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00002000:00100000:0.0:1788361389.299806:0:31918:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa3:0x0] (0->1023) req@ffff9a8986705500 x1875232130624128/t25769803781(0) o4->a3538730-0385-4711-b11c-bb6af99a7674@192.168.203.60@tcp:450/0 lens 1512/448 e 0 to 0 dl 1788361400 ref 1 fl Complete:H/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361389.299815:0:31918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986705500 with x1875232130624128 ext(0->1023) 00010000:00010000:0.0:1788361389.299822:0:31918:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 8 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.299835:0:31918:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 8 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361389.299843:0:31918:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a8986705500 00000100:00100000:3.0:1788361389.301968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.302497:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130624256 00000100:00100000:1.0:1788361389.302506:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130624256 00010000:00010000:1.0:1788361389.302540:0:31266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 8 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.302620:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:1.0:1788361389.302629:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3538730-0385-4711-b11c-bb6af99a7674+8:2350:x1875232130624256:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361389.302643:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361389.302664:0:31266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 8 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.302676:0:31266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 8 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.302727:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074aca1ba/0xf6a94c97d661405a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a7 expref: 8 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.302742:0:31266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361389.302747:0:31266:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361389.302755:0:31266:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 5 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.302764:0:31266:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 5 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.302797:0:31266:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 5 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.302811:0:31266:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:31266:1875232144180736:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361389.302887:0:31266:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361389.305513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.305561:0:31266:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:31266:1875232144180736:192.168.203.60@tcp:105: 00010000:00010000:3.0:1788361389.305585:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361389.305591:0:31920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130624384 00000100:00100000:2.0:1788361389.305610:0:31920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130624384 00000100:00100000:3.0:1788361389.305651:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3538730-0385-4711-b11c-bb6af99a7674+7:2350:x1875232130624256:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3013us (3682us total) trans 0 rc 0/0 00002000:00100000:2.0:1788361389.305653:0:31920:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa3:0x0] (0->4095) req@ffff9a8a9f586300 x1875232130624384/t0(0) o3->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:450/0 lens 488/0 e 0 to 0 dl 1788361400 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361389.305661:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00002000:00100000:2.0:1788361389.305662:0:31920:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9f586300 with x1875232130624384 ext(0->4095) 00002000:00010000:2.0:1788361389.305667:0:31920:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9f586300 00000100:00100000:2.0:1788361389.305729:0:31920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1788361389.305738:0:31920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130624384:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361389.305894:0:31920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130624384:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 158us (390us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788361389.305901:0:31920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00002000:00100000:2.0:1788361389.305908:0:31920:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xa3:0x0] (0->4095) req@ffff9a8a9f586300 x1875232130624384/t0(0) o3->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:450/0 lens 488/4536 e 0 to 0 dl 1788361400 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361389.305916:0:31920:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9f586300 with x1875232130624384 ext(0->4095) 00002000:00010000:2.0:1788361389.305919:0:31920:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9f586300 00000100:00100000:1.0:1788361389.309273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.309324:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130624512 00000100:00100000:3.0:1788361389.309333:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130624512 00000100:00100000:3.0:1788361389.309381:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:3.0:1788361389.309391:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2349:x1875232130624512:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:3.0:1788361389.309433:0:31914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.309454:0:31914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 6 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.309463:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361389.309468:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361389.309472:0:31914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 4/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.309511:0:31914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 6 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.309522:0:31914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 6 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.309549:0:31914:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31914:1875232144180864:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361389.309680:0:31914:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361389.314529:0:31914:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:31914:1875232144180864:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361389.314558:0:31914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.314602:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.315069:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130624640 00000100:00100000:3.0:1788361389.315075:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130624640 00010000:00010000:3.0:1788361389.315126:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 7 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.315211:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788361389.315221:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2350:x1875232130624640:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361389.315236:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361389.315256:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 7 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.315269:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 7 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.315291:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1df7c52/0xf6a94c97d66140d8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d8 expref: 7 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.315321:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361389.315325:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361389.315330:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.315339:0:31265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.315369:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361389.315776:0:31914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.315789:0:31914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.315832:0:31914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.315840:0:31914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.315848:0:31914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.315855:0:31914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361389.315859:0:31914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.315868:0:31914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.315882:0:31914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.315889:0:31914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66140df lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.316015:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130624640:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 794us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.316025:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1788361389.316524:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2349:x1875232130624512:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 7133us (7257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.316534:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1788361389.321962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.322042:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130624896 00000100:00100000:1.0:1788361389.322053:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130624896 00000100:00100000:1.0:1788361389.322152:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1788361389.322164:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:28452:x1875232130624896:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:1.0:1788361389.322224:0:31283:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b12:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66140ca lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d1 expref: 17 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361389.322533:0:31283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803832 00000001:00080000:1.0:1788361389.322577:0:31283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803833 00000001:00080000:1.0:1788361389.323258:0:31283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803834 00010000:00010000:1.0:1788361389.323315:0:31283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.323332:0:31283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a0 expref: 12 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.323341:0:31283:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0bc expref: 21 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.323348:0:31283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 5/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.323382:0:31283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0bc expref: 21 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.323396:0:31283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0bc expref: 21 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.323409:0:31283:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:31283:1875232144180992:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361389.323521:0:31283:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a0 expref: 12 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.323543:0:31283:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a0 expref: 12 pid: 31280 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.323552:0:31283:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:31283:1875232144181120:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361389.323576:0:31283:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361389.329210:0:31283:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:31283:1875232144180992:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361389.333143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.333199:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130625152 00000100:00100000:3.0:1788361389.333208:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130625152 00010000:00010000:3.0:1788361389.333250:0:31266:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 5/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a0 expref: 13 pid: 31280 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.333282:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:3.0:1788361389.333291:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3538730-0385-4711-b11c-bb6af99a7674+13:2350:x1875232130625152:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361389.333308:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361389.333315:0:31266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 5/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a0 expref: 13 pid: 31280 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.333327:0:31266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a0 expref: 13 pid: 31280 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.333437:0:31266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4600) 00010000:00010000:3.0:1788361389.333444:0:31266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.333453:0:31266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.333460:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361389.333519:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3538730-0385-4711-b11c-bb6af99a7674+13:2350:x1875232130625152:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 228us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.333527:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:3.0:1788361389.335321:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.335354:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130625024 00000100:00100000:3.0:1788361389.335372:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130625024 00010000:00010000:3.0:1788361389.335403:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0bc expref: 22 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.335434:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1788361389.335443:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+22:2349:x1875232130625024:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361389.335456:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361389.335471:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0bc expref: 22 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.335484:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0bc expref: 22 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.335502:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d66140a0 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0bc expref: 22 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.335528:0:31265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4600) 00010000:00010000:3.0:1788361389.335532:0:31265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.335541:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.335547:0:31265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 4/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.335563:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361389.335604:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+21:2349:x1875232130625024:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 162us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.335611:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00010000:00010000:1.0:1788361389.336261:0:31283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661404c lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0a0 expref: 12 pid: 31280 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.336277:0:31283:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:31283:1875232144181120:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361389.336303:0:31283:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.336312:0:31283:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.336318:0:31283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361389.336444:0:31283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803835 00000001:00080000:1.0:1788361389.336764:0:31283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803836 00000001:00080000:1.0:1788361389.336828:0:31283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803837 00000100:00100000:1.0:1788361389.336898:0:31283:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:31283:1875232144181248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788361389.336943:0:31283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361389.336981:0:31283:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a850810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361389.337071:0:31284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144181248 00000100:00100000:2.0:1788361389.337077:0:31284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144181248 00000100:00080000:1.0:1788361389.337249:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361389.337257:0:31284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361389.337266:0:31284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31283:x1875232144181248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788361389.337349:0:31284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:31283:x1875232144181248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.337356:0:31284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788361389.337422:0:31283:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803780 gen 2 00000004:00080000:1.0:1788361389.337428:0:31283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a9f584e00, transno 25769803780 00000100:00100000:1.0:1788361389.337449:0:31283:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:31283:1875232144181248:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788361389.338221:0:31283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803838 00000100:00100000:1.0:1788361389.338272:0:31283:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:31283:1875232144181376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788361389.338306:0:31283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361389.338333:0:31283:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361389.338516:0:31285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144181376 00000100:00100000:0.0:1788361389.338522:0:31285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144181376 00000100:00100000:0.0:1788361389.338562:0:31285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361389.338570:0:31285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:31283:x1875232144181376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788361389.338728:0:31285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:31283:x1875232144181376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (420us total) trans 25769803782 rc 0/0 00000100:00100000:0.0:1788361389.338735:0:31285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361389.339457:0:31283:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:31283:1875232144181376:0@lo:1000:mdt_rdpg00_001.0 00010000:00010000:1.0:1788361389.339492:0:31283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.339501:0:31283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.339509:0:31283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.339515:0:31283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841eee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361389.339520:0:31283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.339526:0:31283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.339541:0:31283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4600) 00010000:00010000:1.0:1788361389.339544:0:31283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788361389.339548:0:31283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.339565:0:31283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140e6 lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361389.339993:0:31283:0:(mdd_object.c:4016:mdd_close()) Object [0x200002b11:0x7:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788361389.340078:0:31283:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x24:0x0].3, 64 off8384 00000004:00080000:1.0:1788361389.340105:0:31283:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 779355018924ns, next at 780355016807ns, rc = 0 00000001:00080000:1.0:1788361389.340113:0:31283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803839 00010000:00010000:1.0:1788361389.340160:0:31283:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4600) 00010000:00010000:1.0:1788361389.340163:0:31283:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788361389.340171:0:31283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66140ca lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0d1 expref: 25 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.340322:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+24:28452:x1875232130624896:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 18160us (18366us total) trans 25769803840 rc 0/0 00000100:00100000:1.0:1788361389.340331:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000020:00080000:1.0:1788361389.340336:0:31283:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788361389.344889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.344994:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130625280 00000100:00100000:2.0:1788361389.345005:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130625280 00000100:00100000:2.0:1788361389.345140:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:2.0:1788361389.345167:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+24:28452:x1875232130625280:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361389.345192:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.345217:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66140ed lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0df expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.345294:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66140ed lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0df expref: 25 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.345310:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66140ed lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0df expref: 25 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.345331:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:2.0:1788361389.345334:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361389.345338:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fa00, rc 0) 00000100:00100000:2.0:1788361389.345416:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+25:28452:x1875232130625280:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 253us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.345425:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:2.0:1788361389.348705:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.348804:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130625536 00000100:00100000:3.0:1788361389.348815:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130625536 00000100:00100000:3.0:1788361389.348871:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361389.348883:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+25:28452:x1875232130625536:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361389.349138:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+26:28452:x1875232130625536:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 257us (442us total) trans 25769803841 rc 0/0 00000100:00100000:3.0:1788361389.349147:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361389.407494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.407560:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130625792 00000100:00100000:1.0:1788361389.407570:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130625792 00000100:00100000:1.0:1788361389.407643:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:1.0:1788361389.407661:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+26:28462:x1875232130625792:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361389.407685:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361389.407705:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0e6 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361389.407841:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 512 00010000:00010000:1.0:1788361389.407977:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0e6 expref: 28 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.408011:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8ac20d4f00) 00010000:00010000:1.0:1788361389.408013:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361389.408019:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66140f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0e6 expref: 28 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.408033:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841eee00, rc 0) 00000100:00100000:1.0:1788361389.408141:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+27:28462:x1875232130625792:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 488us (655us total) trans 25769803842 rc 301/301 00000100:00100000:1.0:1788361389.408148:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:2.0:1788361389.411675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.411926:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130625920 00000100:00100000:0.0:1788361389.411936:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130625920 00000100:00100000:0.0:1788361389.412389:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:0.0:1788361389.412403:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+27:28462:x1875232130625920:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1788361389.412489:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614102 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412505:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614102 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412516:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614102 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412531:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614109 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412538:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614109 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412544:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614109 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412636:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412645:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412652:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361389.412692:0:31280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412703:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614102 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412729:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614102 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412736:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614102 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412742:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361389.412746:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614102 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412754:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614102 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412767:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361389.412770:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361389.412774:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614102 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412781:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614102 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412794:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614109 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412800:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614109 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412805:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614109 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412810:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361389.412819:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614109 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412825:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614109 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412831:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361389.412834:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361389.412837:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614109 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412842:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614109 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412856:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412862:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412867:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412872:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361389.412875:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412881:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412887:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:0.0:1788361389.412889:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361389.412898:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.412904:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614110 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.412968:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+27:28462:x1875232130625920:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 568us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361389.412976:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:2.0:1788361389.415160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.415685:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130626176 00000100:00100000:1.0:1788361389.415694:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130626176 00000100:00100000:1.0:1788361389.415758:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1788361389.415767:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+27:28462:x1875232130626176:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788361389.416002:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+28:28462:x1875232130626176:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 236us (848us total) trans 25769803843 rc 0/0 00000100:00100000:1.0:1788361389.416010:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361389.460869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.460988:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130626304 00000100:00100000:2.0:1788361389.460998:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130626304 00000100:00100000:2.0:1788361389.461055:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:2.0:1788361389.461065:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+28:28468:x1875232130626304:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361389.461136:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.461156:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6614117 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0ed expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461248:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661411e lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461263:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661411e lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461285:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661411e lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461302:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6614125 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461309:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6614125 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461317:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6614125 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461402:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461410:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461417:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361389.461449:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:2.0:1788361389.461453:0:31281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361389.461471:0:31281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461494:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461503:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661411e lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461510:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661411e lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461516:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661411e lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461522:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.461526:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661411e lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461534:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661411e lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461545:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361389.461548:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361389.461553:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661411e lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461559:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d661411e lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461571:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6614125 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461576:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6614125 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461588:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6614125 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461594:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.461597:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6614125 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461603:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6614125 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461612:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8ac20d4200) 00010000:00010000:2.0:1788361389.461614:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361389.461617:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6614125 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461622:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d6614125 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461653:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6614117 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ed expref: 30 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461665:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ed expref: 29 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.461672:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:2.0:1788361389.461674:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361389.461676:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e600, rc 0) 00000100:00100000:2.0:1788361389.461741:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+29:28468:x1875232130626304:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 677us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.461759:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:2.0:1788361389.465324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.465734:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130626560 00000100:00100000:0.0:1788361389.465742:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130626560 00000100:00100000:0.0:1788361389.465802:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1788361389.465823:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+29:28468:x1875232130626560:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361389.465844:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361389.465863:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614133 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0f4 expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.465960:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661413a lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.465975:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661413a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.465986:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661413a lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361389.465997:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:0.0:1788361389.466156:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614133 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0f4 expref: 32 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.466175:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661413a lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0f4 expref: 31 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.466196:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:0.0:1788361389.466199:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361389.466203:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964200, rc 0) 00000100:00100000:0.0:1788361389.466265:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+31:28468:x1875232130626560:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 454us (1010us total) trans 25769803844 rc 0/0 00000100:00100000:0.0:1788361389.466272:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1788361389.468653:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.468730:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130626816 00000100:00100000:3.0:1788361389.468740:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130626816 00000100:00100000:3.0:1788361389.468789:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788361389.468808:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+31:28468:x1875232130626816:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361389.469181:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+32:28468:x1875232130626816:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 373us (534us total) trans 25769803845 rc 0/0 00000100:00100000:3.0:1788361389.469189:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788361389.471025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.471614:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130626944 00000100:00100000:0.0:1788361389.471623:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130626944 00000100:00100000:0.0:1788361389.471704:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788361389.471724:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+32:2349:x1875232130626944:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361389.471740:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361389.471804:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661413a lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0f4 expref: 32 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.471839:0:31265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:0.0:1788361389.471845:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361389.471991:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+31:2349:x1875232130626944:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 264us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361389.472000:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:2.0:1788361389.514417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.514513:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130627200 00000100:00100000:3.0:1788361389.514522:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130627200 00000100:00100000:3.0:1788361389.514631:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:3.0:1788361389.514643:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+31:28478:x1875232130627200:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361389.514675:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361389.514695:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614148 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f0fb expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.514827:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf400/0xf6a94c97d661414f lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.514842:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf400/0xf6a94c97d661414f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.514854:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf400/0xf6a94c97d661414f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361389.514865:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 512 00010000:00010000:3.0:1788361389.514966:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614148 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0fb expref: 34 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.514981:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf400/0xf6a94c97d661414f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0fb expref: 33 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.515005:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361389.515008:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788361389.515012:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf400, rc 0) 00000100:00100000:3.0:1788361389.515073:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+33:28478:x1875232130627200:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 432us (665us total) trans 25769803846 rc 0/0 00000100:00100000:3.0:1788361389.515080:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1788361389.569375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.569470:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130627456 00000100:00100000:0.0:1788361389.569478:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130627456 00000100:00100000:0.0:1788361389.569544:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:0.0:1788361389.569551:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+33:28484:x1875232130627456:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361389.569570:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361389.569594:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661415d lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f102 expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.569685:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614164 lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.569700:0:31279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ed expref: 34 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.569722:0:31279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614164 lrc: 4/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.569759:0:31279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ed expref: 34 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.569773:0:31279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ed expref: 34 pid: 31281 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.569786:0:31279:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:31279:1875232144181504:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361389.569884:0:31279:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361389.572487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.572670:0:31279:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:31279:1875232144181504:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361389.572698:0:31279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614164 lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.573069:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130627584 00000100:00100000:1.0:1788361389.573078:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130627584 00010000:00010000:1.0:1788361389.573144:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ed expref: 35 pid: 31281 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.573185:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361389.573193:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9eab9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:2350:x1875232130627584:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361389.573208:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361389.573227:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ed expref: 35 pid: 31281 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.573239:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ed expref: 35 pid: 31281 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.573260:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661412c lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ed expref: 35 pid: 31281 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.573276:0:31264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:1.0:1788361389.573281:0:31264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614164 lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.573291:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614164 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.573299:0:31264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614164 lrc: 4/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.573329:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361389.573385:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9eab9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:2350:x1875232130627584:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 192us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.573392:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00010000:00010000:2.0:1788361389.573627:0:31279:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614164 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.573635:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614164 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361389.573721:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:2.0:1788361389.573869:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661415d lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f102 expref: 35 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.573885:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614164 lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f102 expref: 34 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.573892:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:2.0:1788361389.573895:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788361389.573898:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965600, rc 0) 00000100:00100000:2.0:1788361389.573945:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28484:x1875232130627456:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 4394us (4579us total) trans 25769803847 rc 0/0 00000100:00100000:2.0:1788361389.573952:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788361389.580908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.581833:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130627840 00000100:00100000:1.0:1788361389.581844:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130627840 00000100:00100000:1.0:1788361389.581954:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:1.0:1788361389.581964:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28484:x1875232130627840:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361389.582057:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361389.582061:0:32594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361389.582124:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614164 lrc: 0/0,0 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f102 expref: 34 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.582142:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:1.0:1788361389.582147:0:32594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361389.582159:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614172 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f109 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.582245:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eec00/0xf6a94c97d6614179 lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.582258:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eec00/0xf6a94c97d6614179 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.582267:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eec00/0xf6a94c97d6614179 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361389.582278:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:1.0:1788361389.582388:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614172 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f109 expref: 36 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.582402:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eec00/0xf6a94c97d6614179 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f109 expref: 35 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.582410:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:1.0:1788361389.582413:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788361389.582415:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841eec00, rc 0) 00000100:00100000:1.0:1788361389.582489:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:28484:x1875232130627840:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 526us (1589us total) trans 25769803848 rc 0/0 00000100:00100000:1.0:1788361389.582497:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788361389.586326:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.586402:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130628096 00000100:00100000:0.0:1788361389.586412:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130628096 00000100:00100000:0.0:1788361389.586490:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361389.586501:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:28484:x1875232130628096:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:0.0:1788361389.586534:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361389.586560:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d66140ed lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0df expref: 35 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.586576:0:31266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:0.0:1788361389.586581:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361389.586650:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28484:x1875232130628096:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 151us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361389.586658:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361389.588215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.588287:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130628224 00000100:00100000:0.0:1788361389.588295:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130628224 00000100:00100000:0.0:1788361389.588342:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:0.0:1788361389.588350:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28484:x1875232130628224:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:0.0:1788361389.588436:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.588463:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.588476:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361389.588813:0:31280:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x26:0x0].2, 136 off8464 00000100:00100000:0.0:1788361389.588902:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28484:x1875232130628224:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 552us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361389.588911:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:2.0:1788361389.590803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.590887:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130628352 00000100:00100000:3.0:1788361389.590895:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130628352 00000100:00100000:3.0:1788361389.590949:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1788361389.590959:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28484:x1875232130628352:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361389.590983:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361389.591002:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f110 expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.591052:0:31281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 2/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.591062:0:31281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 4/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 35 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.591081:0:31281:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.591204:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 3/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 35 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.591236:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361389.591240:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361389.591244:0:31281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 3/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 35 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.591251:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cec00, rc 0) 00000100:00100000:3.0:1788361389.591340:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:28484:x1875232130628352:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 382us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.591347:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000040:00080000:2.0:1788361389.600663:0:31311:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788361389.600686:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361389.600741:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:2.0:1788361389.600747:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788361389.600862:0:31311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:31311:1875232144181632:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788361389.601001:0:31311:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8138b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361389.604539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.604621:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130628480 00000100:00100000:0.0:1788361389.604631:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130628480 00000100:00100000:0.0:1788361389.604699:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:0.0:1788361389.604721:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:28485:x1875232130628480:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788361389.604755:0:31280:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200002b12:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788361389.604861:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:28485:x1875232130628480:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 153us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361389.604869:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:3.0:1788361389.606350:0:31311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83541880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:31311:1875232144181632:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361389.607169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.607298:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130628608 00000100:00100000:3.0:1788361389.607306:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130628608 00000100:00100000:3.0:1788361389.607377:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788361389.607386:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:28485:x1875232130628608:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788361389.607448:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614195 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607463:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614195 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607474:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614195 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607488:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661419c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607494:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661419c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607512:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661419c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607532:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607539:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607545:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361389.607576:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:3.0:1788361389.607579:0:31281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361389.607590:0:31281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607598:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614195 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607605:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614195 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607610:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614195 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607616:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.607620:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614195 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607627:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614195 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607643:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:3.0:1788361389.607645:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.607649:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614195 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607655:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614195 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607667:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661419c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607672:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661419c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607678:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661419c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607682:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.607684:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661419c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607689:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661419c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607695:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x31298142 (ffff9a8a890c3500) 00010000:00010000:3.0:1788361389.607697:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.607699:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661419c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607704:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661419c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x31298142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607741:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607746:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607751:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607756:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.607759:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607764:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607771:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361389.607773:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.607776:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.607781:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141a3 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.607893:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:28485:x1875232130628608:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 508us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.607901:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:1.0:1788361389.609690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.609805:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130628864 00000100:00100000:0.0:1788361389.609814:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130628864 00000100:00100000:0.0:1788361389.609911:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:0.0:1788361389.609921:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:28485:x1875232130628864:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361389.609940:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361389.609957:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f117 expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610051:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141b1 lrc: 3/1,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610066:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141b1 lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610078:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141b1 lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361389.610119:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:0.0:1788361389.610223:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141b1 lrc: 3/1,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610231:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141b1 lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610254:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141b1 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610260:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361389.610264:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141b1 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610272:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141b1 lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610284:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:0.0:1788361389.610286:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788361389.610290:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141b1 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610295:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141b1 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610335:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f117 expref: 37 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610345:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:0.0:1788361389.610347:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361389.610351:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f117 expref: 37 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.610359:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964c00, rc 0) 00000100:00100000:0.0:1788361389.610415:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:28485:x1875232130628864:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 495us (731us total) trans 25769803849 rc 301/301 00000100:00100000:0.0:1788361389.610431:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:2.0:1788361389.615195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.615301:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130628992 00000100:00100000:1.0:1788361389.615312:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130628992 00000100:00100000:1.0:1788361389.615416:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:1.0:1788361389.615428:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:28485:x1875232130628992:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788361389.615487:0:32594:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200002b12:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788361389.615820:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:28485:x1875232130628992:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 393us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.615828:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:1.0:1788361389.617943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.618003:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130629248 00000100:00100000:2.0:1788361389.618012:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130629248 00000100:00100000:2.0:1788361389.618074:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:2.0:1788361389.618114:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:28485:x1875232130629248:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361389.618134:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.618137:0:31279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361389.618162:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614084 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0b5 expref: 36 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.618180:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361389.618185:0:31279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361389.618196:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66141bf lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f11e expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361389.619441:0:31279:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xa3:0x0], index 0: 0 00010000:00010000:2.0:1788361389.619660:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d66141c6 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.619676:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d66141c6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.619694:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d66141c6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.619778:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66141bf lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f11e expref: 38 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.619794:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d66141c6 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f11e expref: 37 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.619808:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:2.0:1788361389.619811:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361389.619814:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e200, rc 0) 00000100:00100000:2.0:1788361389.619908:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+37:28485:x1875232130629248:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1824us (1971us total) trans 25769803850 rc 0/0 00000100:00100000:2.0:1788361389.619914:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:2.0:1788361389.623327:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.623469:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130629376 00000100:00100000:3.0:1788361389.623478:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130629376 00000100:00100000:3.0:1788361389.623534:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:3.0:1788361389.623559:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+37:28485:x1875232130629376:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361389.623583:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361389.623613:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f125 expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623680:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66141db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623692:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66141db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623702:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66141db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623725:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66141e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623734:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66141e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623740:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66141e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623852:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d66141e9 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623862:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d66141e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623869:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d66141e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361389.623915:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 512 00000004:00200000:3.0:1788361389.623919:0:31281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361389.623941:0:31281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d66141e9 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623950:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66141db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623954:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66141db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623959:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66141db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623962:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.623965:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66141db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623972:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66141db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623983:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8ac20d4f00) 00010000:00010000:3.0:1788361389.623986:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.623990:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66141db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.623996:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66141db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.624007:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66141e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.624025:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66141e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.624031:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66141e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.624036:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.624039:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66141e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.624046:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66141e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.624054:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2bed0786 (ffff9a8a890c3500) 00010000:00010000:3.0:1788361389.624056:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.624059:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66141e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.624064:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66141e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2bed0786 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.624210:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66141d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f125 expref: 39 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.624300:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d66141e9 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f125 expref: 38 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.624317:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361389.624320:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788361389.624329:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf800, rc 0) 00000100:00100000:2.0:1788361389.624777:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+38:28485:x1875232130629376:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1219us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.624794:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:3.0:1788361389.627185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.627818:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130629632 00000100:00100000:0.0:1788361389.627828:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130629632 00000100:00100000:0.0:1788361389.627877:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:0.0:1788361389.627887:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+38:28485:x1875232130629632:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361389.627936:0:31280:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361389.627961:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d66141c6 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f11e expref: 38 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.627976:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:0.0:1788361389.627988:0:31280:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361389.628009:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141f0 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628022:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141f0 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628031:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141f0 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628045:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141f7 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x22e21fa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628051:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141f7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x22e21fa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628056:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141f7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x22e21fa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628163:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141f0 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628170:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141f0 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628177:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141f0 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628183:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361389.628187:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141f0 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628195:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141f0 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628209:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361389.628212:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361389.628216:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141f0 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628221:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66141f0 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628231:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141f7 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x22e21fa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628237:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141f7 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x22e21fa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628243:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141f7 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x22e21fa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628253:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361389.628257:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141f7 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x22e21fa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628263:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141f7 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x22e21fa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628272:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x22e21fa5 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361389.628274:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361389.628278:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141f7 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x22e21fa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.628284:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66141f7 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x22e21fa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.628364:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+37:28485:x1875232130629632:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 478us (1185us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361389.628372:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1788361389.634612:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.637373:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130629760 00000100:00100000:2.0:1788361389.637389:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130629760 00000100:00100000:2.0:1788361389.637455:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:2.0:1788361389.637465:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+37:28485:x1875232130629760:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361389.637485:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.637508:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66141fe lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f12c expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.637544:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.637571:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.637596:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.637690:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e800/0xf6a94c97d66141fe lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f12c expref: 39 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.637706:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f12c expref: 38 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.637727:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4b00) 00010000:00010000:2.0:1788361389.637730:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361389.637733:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f600, rc 0) 00000100:00100000:2.0:1788361389.637837:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+38:28485:x1875232130629760:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 373us (3235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.637844:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:2.0:1788361389.641332:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.641386:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130630016 00000100:00100000:0.0:1788361389.641396:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130630016 00000100:00100000:0.0:1788361389.641449:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:0.0:1788361389.641457:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+38:28485:x1875232130630016:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361389.641527:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.641543:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.641554:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361389.641935:0:31279:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].3, 88 off8432 00000004:00080000:0.0:1788361389.641945:0:31279:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 779656858912ns, next at 780656856923ns, rc = 0 00000004:00010000:0.0:1788361389.642026:0:31279:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000dd9ce5d reply state 000000005f7cb800 transno 25769803851 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.642036:0:31279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361389.642142:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+40:28485:x1875232130630016:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 683us (817us total) trans 25769803851 rc 0/0 00000100:00100000:0.0:1788361389.642150:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00010000:00010000:2.0:1788361389.646202:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.646221:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.646228:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.646234:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.646253:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.646263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:2.0:1788361389.646276:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.646295:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4b00) 00010000:00010000:2.0:1788361389.646299:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361389.646304:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.646311:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d661420c lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.648910:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130630144 00000100:00100000:1.0:1788361389.648924:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130630144 00000100:00100000:1.0:1788361389.648997:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:1.0:1788361389.649007:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+39:28485:x1875232130630144:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361389.649033:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361389.649053:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eea00/0xf6a94c97d6614213 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f133 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.649129:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eea00/0xf6a94c97d6614213 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f133 expref: 40 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.649145:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eea00/0xf6a94c97d6614213 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f133 expref: 40 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.649164:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4b00) 00010000:00010000:1.0:1788361389.649177:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361389.649181:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841eea00, rc 0) 00000100:00100000:1.0:1788361389.649248:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+40:28485:x1875232130630144:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 242us (2993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.649255:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:1.0:1788361389.653187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.653270:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130630272 00000100:00100000:3.0:1788361389.653290:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130630272 00000100:00100000:3.0:1788361389.653344:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1788361389.653352:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2350:x1875232130630272:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788361389.653639:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130630272:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 286us (460us total) trans 25769803787 rc 0/0 00000100:00100000:3.0:1788361389.653646:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1788361389.658309:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.658400:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130630528 00000100:00100000:1.0:1788361389.658409:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130630528 00000100:00100000:1.0:1788361389.658469:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788361389.658479:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+40:28485:x1875232130630528:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788361389.658717:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+41:28485:x1875232130630528:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 230us (407us total) trans 25769803852 rc 0/0 00000100:00100000:1.0:1788361389.658724:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1788361389.660838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.660955:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130630784 00000100:00100000:0.0:1788361389.660964:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130630784 00000100:00100000:0.0:1788361389.661173:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:0.0:1788361389.661183:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+41:28485:x1875232130630784:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788361389.661430:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+41:28485:x1875232130630784:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 247us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361389.661438:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:2.0:1788361389.663416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.663601:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130630912 00000100:00100000:3.0:1788361389.663609:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130630912 00000100:00100000:3.0:1788361389.663662:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:3.0:1788361389.663672:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+41:28485:x1875232130630912:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361389.663690:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361389.663719:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661421a lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f13a expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.663815:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614221 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.663831:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614221 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.663843:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614221 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361389.663876:0:31281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361389.663893:0:31281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614221 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.663927:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661421a lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f13a expref: 43 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.663946:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614221 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f13a expref: 42 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.663954:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4b00) 00010000:00010000:3.0:1788361389.663957:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788361389.663960:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cfa00, rc 0) 00000100:00100000:3.0:1788361389.664021:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+42:28485:x1875232130630912:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 350us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.664027:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:1.0:1788361389.667181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.667286:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130631040 00000100:00100000:2.0:1788361389.667297:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130631040 00000100:00100000:2.0:1788361389.667354:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788361389.667364:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2352:x1875232130631040:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361389.667381:0:31913:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.667400:0:31913:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009402165c/0xf6a94c97d6614228 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f141 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361389.667425:0:31913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983aae, blocks: 0x1 00010000:00010000:2.0:1788361389.667442:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=779s v=(0 0) 00010000:00010000:2.0:1788361389.667447:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361389.667467:0:31913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009402165c/0xf6a94c97d6614228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f141 expref: 7 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.667501:0:31913:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009402165c/0xf6a94c97d6614228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f141 expref: 7 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.667514:0:31913:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fc00, rc 0) 00000100:00100000:2.0:1788361389.667573:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2352:x1875232130631040:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 211us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.667580:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788361389.670498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.670637:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130631296 00000100:00100000:0.0:1788361389.670646:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130631296 00000100:00100000:0.0:1788361389.670699:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:0.0:1788361389.670719:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+42:28485:x1875232130631296:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788361389.670829:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+42:28485:x1875232130631296:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 121us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361389.670837:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:3.0:1788361389.675690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.675813:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130631424 00000100:00100000:1.0:1788361389.675830:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130631424 00000100:00100000:1.0:1788361389.675884:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788361389.675894:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:28485:x1875232130631424:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361389.675912:0:32018:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361389.675927:0:32018:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f148 expref: -99 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.675957:0:32018:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009402165c/0xf6a94c97d6614228 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f141 expref: 8 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.675966:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361389.675983:0:32018:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361389.675989:0:32018:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 4/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 8 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.676027:0:32018:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009402165c/0xf6a94c97d6614228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f141 expref: 8 pid: 31913 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.676040:0:32018:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009402165c/0xf6a94c97d6614228 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f141 expref: 8 pid: 31913 timeout: 879 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.676053:0:32018:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:32018:1875232144181760:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361389.676173:0:32018:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361389.679573:0:32018:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:32018:1875232144181760:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361389.679606:0:32018:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 3/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 8 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.679627:0:32018:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ee800, rc 0) 00000100:00100000:3.0:1788361389.679686:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:28485:x1875232130631424:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 3792us (4004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.679694:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788361389.679779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.683072:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130631552 00000100:00100000:0.0:1788361389.683534:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130631552 00010000:00010000:0.0:1788361389.683598:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009402165c/0xf6a94c97d6614228 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f141 expref: 8 pid: 31913 timeout: 879 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.683704:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361389.683859:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2350:x1875232130631552:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361389.683875:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361389.683897:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009402165c/0xf6a94c97d6614228 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f141 expref: 8 pid: 31913 timeout: 879 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.683912:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009402165c/0xf6a94c97d6614228 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f141 expref: 8 pid: 31913 timeout: 879 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.683935:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009402165c/0xf6a94c97d6614228 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f141 expref: 8 pid: 31913 timeout: 879 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.683951:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361389.683956:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361389.683965:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 7 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.683985:0:31265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 7 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.684027:0:31265:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 7 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.684059:0:31265:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:31265:1875232144181888:192.168.203.60@tcp:105: 00000100:00100000:0.0:1788361389.684170:0:31265:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361389.691650:0:31265:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:31265:1875232144181888:192.168.203.60@tcp:105: 00010000:00010000:0.0:1788361389.691677:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361389.691740:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2350:x1875232130631552:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 7884us (11961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361389.691751:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:2.0:1788361389.692332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.692617:0:31918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130631680 00000100:00100000:0.0:1788361389.692624:0:31918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130631680 00002000:00100000:0.0:1788361389.692665:0:31918:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa3:0x0] (0->1023) req@ffff9a8a83540a80 x1875232130631680/t0(0) o4->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:450/0 lens 1512/0 e 0 to 0 dl 1788361400 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361389.692676:0:31918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a83540a80 with x1875232130631680 ext(0->1023) 00002000:00010000:0.0:1788361389.692680:0:31918:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a83540a80 00000100:00100000:0.0:1788361389.692755:0:31918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361389.692764:0:31918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130631680:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361389.693219:0:31918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:2349:x1875232130631680:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 456us (888us total) trans 25769803788 rc 0/0 00000100:00100000:0.0:1788361389.693227:0:31918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00002000:00100000:0.0:1788361389.693234:0:31918:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xa3:0x0] (0->1023) req@ffff9a8a83540a80 x1875232130631680/t25769803788(0) o4->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:450/0 lens 1512/448 e 0 to 0 dl 1788361400 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361389.693242:0:31918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a83540a80 with x1875232130631680 ext(0->1023) 00002000:00010000:0.0:1788361389.693246:0:31918:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a83540a80 00000100:00100000:1.0:1788361389.695930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.696197:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130631808 00000100:00100000:2.0:1788361389.696206:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130631808 00000100:00100000:2.0:1788361389.696249:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:2.0:1788361389.696258:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+42:28485:x1875232130631808:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788361389.753163:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+42:28485:x1875232130631808:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 56896us (57231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.753176:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000001:00080000:3.0:1788361389.753575:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803851 is committed 00000004:00080000:3.0:1788361389.753582:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788361389.753632:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836517 batchid updated 00000001:00080000:3.0:1788361389.753651:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803852 is committed 00000004:00080000:3.0:1788361389.753677:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788361389.753690:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a850810c0 refcount 2 committed 0 result 0 batchid 21474836518 00000020:00080000:3.0:1788361389.753694:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a882b6e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a850816c0 00000020:00080000:3.0:1788361389.753698:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a882b6c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a9f461800 00000001:00080000:3.0:1788361389.753732:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803828 is committed 00000001:00080000:3.0:1788361389.753747:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803829 is committed 00000100:00100000:2.0:1788361389.754044:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361389.754059:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144182144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788361389.754144:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361389.754202:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144182144 00000100:00100000:2.0:1788361389.754210:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144182144 00000100:00100000:2.0:1788361389.754455:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788361389.754464:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144182144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788361389.754614:0:31913:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1788361389.754628:0:31913:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb mtime from disk: 0 -> 1788361390 00002000:00010000:2.0:1788361389.754630:0:31913:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361389.754632:0:31913:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb ctime from disk: 1788361390 -> 1788361390 00002000:00010000:2.0:1788361389.754634:0:31913:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361389.754674:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144182144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 211us (529us total) trans 25769803789 rc 0/0 00000100:00100000:2.0:1788361389.754682:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788361389.754700:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361389.754735:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803782 gen 2 00000004:00080000:2.0:1788361389.754741:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803782 committed transno 25769803782 00000100:00100000:2.0:1788361389.754762:0:3314:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8a83540380 x1875232144182144/t25769803789(25769803789) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788361405 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788361389.754848:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a83540380/2, rc 0, transno 25769803789 00000100:00100000:2.0:1788361389.754854:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144182144:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1788361389.754930:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836518 committed batchid 21474836517 00000020:00080000:1.0:1788361389.755143:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836517 00000100:00100000:1.0:1788361389.755524:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144182016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788361389.755566:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361389.755795:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144182016 00000100:00100000:3.0:1788361389.755803:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144182016 00000100:00100000:3.0:1788361389.755844:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788361389.755857:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144182016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788361389.755879:0:31912:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:163 count 1 00002000:00010000:3.0:1788361389.755907:0:31912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa3:0x0] initial LVB size: 1024, mtime: 0x6a983aad, atime: 0x0, ctime: 0x6a983aad, blocks: 0x1 00010000:00010000:3.0:1788361389.755916:0:31912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6614236 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.755931:0:31912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=779s v=(0 0) 00010000:00010000:3.0:1788361389.755936:0:31912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361389.755943:0:31912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6614236 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.755956:0:31912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6614236 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.755966:0:31912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6614236 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.755973:0:31912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6614236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.756003:0:31912:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788361389.756953:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144182016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1099us (1383us total) trans 25769803783 rc 0/0 00000100:00100000:3.0:1788361389.756962:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788361389.756984:0:33055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361389.756991:0:33055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6614236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.757000:0:33055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361389.757004:0:33055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6614236 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.757013:0:33055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6614236 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.757031:0:33055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6614236 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.757039:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d6614236 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.757059:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361389.757061:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361389.757062:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361389.757635:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.757702:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130631936 00000100:00100000:3.0:1788361389.757726:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130631936 00000100:00100000:3.0:1788361389.757885:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:3.0:1788361389.757896:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:2350:x1875232130631936:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1788361389.758984:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ab6aba680/2, rc 0, transno 25769803783 00000100:00100000:1.0:1788361389.758994:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144182016:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788361389.792186:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+9:2350:x1875232130631936:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 34280us (34542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.792201:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000001:00080000:0.0:1788361389.792643:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803788 is committed 00000001:00080000:0.0:1788361389.792659:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803786 is committed 00000001:00080000:0.0:1788361389.792668:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803789 is committed 00000100:00100000:1.0:1788361389.796047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.796165:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130632192 00000100:00100000:0.0:1788361389.796174:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130632192 00000100:00100000:0.0:1788361389.796221:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:0.0:1788361389.796231:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:28485:x1875232130632192:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361389.796283:0:31279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361389.796309:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6614221 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f13a expref: 17 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.796329:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4b00) 00010000:00010000:0.0:1788361389.796333:0:31279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361389.796357:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.796370:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.796379:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361389.796524:0:31279:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aab2cb8d reply state 000000000ea51921 transno 25769803853 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.796531:0:31279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361389.796603:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:28485:x1875232130632192:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 373us (564us total) trans 25769803853 rc 0/0 00000100:00100000:0.0:1788361389.796610:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00010000:00010000:3.0:1788361389.798557:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.798570:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.798576:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.798582:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.798701:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.798744:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.798761:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4b00) 00010000:00010000:3.0:1788361389.798764:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.798829:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.798836:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661423d lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.799731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.799915:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130632320 00000100:00100000:3.0:1788361389.799936:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130632320 00000100:00100000:3.0:1788361389.800021:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1788361389.800031:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2349:x1875232130632320:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788361389.800297:0:32018:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb size from disk: 1024 -> 1024 00002000:00010000:3.0:1788361389.800301:0:32018:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb mtime from disk: 1788361390 -> 1788361389 00002000:00010000:3.0:1788361389.800304:0:32018:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb atime from disk: 0 -> 1788361389 00002000:00010000:3.0:1788361389.800306:0:32018:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb ctime from disk: 1788361390 -> 1788361389 00002000:00010000:3.0:1788361389.800308:0:32018:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xa3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788361389.800369:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130632320:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 339us (642us total) trans 25769803790 rc 0/0 00000100:00100000:3.0:1788361389.800377:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:2.0:1788361389.802106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.802387:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130632576 00000100:00100000:0.0:1788361389.802405:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130632576 00000100:00100000:0.0:1788361389.802457:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:0.0:1788361389.802467:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:28485:x1875232130632576:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788361389.802538:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.802554:0:31280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f12c expref: 17 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.802563:0:31280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 4/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.802606:0:31280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f12c expref: 17 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.802619:0:31280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f12c expref: 17 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.802633:0:31280:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144182272:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361389.802733:0:31280:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361389.804704:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.804794:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130632704 00000100:00100000:1.0:1788361389.804802:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130632704 00010000:00010000:1.0:1788361389.804836:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f12c expref: 18 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.804885:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:1.0:1788361389.804894:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:2349:x1875232130632704:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361389.804909:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361389.804916:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 5/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f12c expref: 18 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.804930:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f12c expref: 18 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.804952:0:31264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4b00) 00010000:00010000:1.0:1788361389.804958:0:31264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.804967:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.804974:0:31264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.804991:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361389.805043:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:2349:x1875232130632704:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 149us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.805050:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00010000:00010000:0.0:1788361389.806233:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6614205 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f12c expref: 17 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.806252:0:31280:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144182272:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361389.806274:0:31280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.806284:0:31280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.806301:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.806330:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.806337:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.806344:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.806349:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361389.806354:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.806361:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.806373:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4b00) 00010000:00010000:0.0:1788361389.806376:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788361389.806380:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.806386:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614244 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.806449:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:28485:x1875232130632576:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 3983us (4368us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788361389.806458:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:2.0:1788361389.808406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.808498:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130632832 00000100:00100000:1.0:1788361389.808506:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130632832 00000100:00100000:1.0:1788361389.808550:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:1.0:1788361389.808560:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130632832:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788361389.808623:0:31914:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.808642:0:31914:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 7 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.808650:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361389.808654:0:31914:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361389.808659:0:31914:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 4/1,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.808693:0:31914:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 7 pid: 32018 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.808706:0:31914:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 7 pid: 32018 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.808732:0:31914:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:31914:1875232144182400:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361389.808839:0:31914:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361389.810325:0:31914:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:31914:1875232144182400:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361389.810345:0:31914:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 3/1,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361389.810717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.810766:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130632960 00000100:00100000:0.0:1788361389.810773:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130632960 00010000:00010000:0.0:1788361389.810798:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 8 pid: 32018 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.810820:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1788361389.810826:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2350:x1875232130632960:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361389.810838:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361389.810859:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 8 pid: 32018 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.810872:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 8 pid: 32018 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.810893:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a2b2bd2/0xf6a94c97d661422f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f148 expref: 8 pid: 32018 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.810905:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361389.810908:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361389.810912:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.810919:0:31265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.810947:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361389.810982:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2350:x1875232130632960:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 157us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361389.810996:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00010000:00010000:1.0:1788361389.811806:0:31914:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.811840:0:31914:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.811864:0:31914:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.811872:0:31914:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.811880:0:31914:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.811887:0:31914:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ee000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361389.811890:0:31914:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.811898:0:31914:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.811914:0:31914:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.811922:0:31914:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1f3a626/0xf6a94c97d661424b lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31914 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.811992:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2349:x1875232130632832:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 3433us (3590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.811999:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1788361389.813799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.813868:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130633216 00000100:00100000:3.0:1788361389.813876:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130633216 00000100:00100000:3.0:1788361389.813968:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:3.0:1788361389.813988:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:28485:x1875232130633216:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788361389.814068:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6614252 lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.814110:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6614252 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.814122:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6614252 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.814339:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.814352:0:31281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eea00/0xf6a94c97d6614213 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f133 expref: 17 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.814373:0:31281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 4/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.814405:0:31281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eea00/0xf6a94c97d6614213 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f133 expref: 17 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.814420:0:31281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eea00/0xf6a94c97d6614213 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f133 expref: 17 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.814435:0:31281:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144182528:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361389.814507:0:31281:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361389.815800:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.815956:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130633344 00000100:00100000:1.0:1788361389.815962:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130633344 00010000:00010000:1.0:1788361389.815993:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eea00/0xf6a94c97d6614213 lrc: 5/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f133 expref: 18 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.816019:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361389.816025:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:2349:x1875232130633344:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361389.816034:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361389.816038:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eea00/0xf6a94c97d6614213 lrc: 5/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f133 expref: 18 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.816047:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eea00/0xf6a94c97d6614213 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f133 expref: 18 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.816062:0:31264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4b00) 00010000:00010000:1.0:1788361389.816065:0:31264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.816073:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.816080:0:31264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 4/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.816125:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361389.816170:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:2349:x1875232130633344:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 143us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.816179:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00010000:00010000:0.0:1788361389.816299:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eea00/0xf6a94c97d6614213 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f133 expref: 17 pid: 32594 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.816339:0:31281:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144182528:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361389.816355:0:31281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.816364:0:31281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.816369:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361389.816500:0:31281:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803854 00000001:00080000:0.0:1788361389.816626:0:31281:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803855 00000100:00100000:0.0:1788361389.816717:0:31281:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31281:1875232144182656:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788361389.816850:0:31281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361389.816888:0:31281:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85087a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361389.816934:0:31285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144182656 00000100:00100000:2.0:1788361389.816939:0:31285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144182656 00000100:00100000:2.0:1788361389.816983:0:31285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361389.816993:0:31284:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788361389.816994:0:31285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:31281:x1875232144182656:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788361389.817003:0:31284:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788361389.817221:0:31285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:31281:x1875232144182656:12345-0@lo:1000:mdt00_002.0 Request processed in 230us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.817239:0:31285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361389.817315:0:31281:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803789 gen 2 00000004:00080000:3.0:1788361389.817321:0:31281:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a83540380, transno 25769803789 00000100:00100000:3.0:1788361389.817330:0:31281:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31281:1875232144182656:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788361389.817852:0:31281:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803856 00000100:00100000:3.0:1788361389.817895:0:31281:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6aba300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31281:1875232144182784:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361389.817927:0:31281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361389.817946:0:31281:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84e2ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361389.817965:0:31285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144182784 00000100:00100000:2.0:1788361389.817970:0:31285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144182784 00000100:00100000:2.0:1788361389.817997:0:31285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361389.818003:0:31285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:31281:x1875232144182784:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361389.818149:0:31285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:31281:x1875232144182784:12345-0@lo:1000:mdt00_002.0 Request processed in 145us (219us total) trans 25769803791 rc 0/0 00000100:00100000:2.0:1788361389.818157:0:31285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361389.818179:0:31281:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6aba300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:31281:1875232144182784:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788361389.818217:0:31281:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803857 00000001:00080000:3.0:1788361389.818278:0:31281:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803858 00010000:00010000:3.0:1788361389.818301:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818310:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 2/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818323:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818327:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.818330:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 3/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818335:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 4/0,0 mode: EX/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818344:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8ac20d4b00) 00010000:00010000:3.0:1788361389.818345:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361389.818348:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818351:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d6614259 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818373:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818380:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818385:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818390:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.818393:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818408:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818416:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361389.818417:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361389.818422:0:31281:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 21 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818428:0:31281:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 21 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818433:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 21 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.818449:0:31281:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 21 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.818456:0:31281:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144182912:192.168.203.60@tcp:105: 00000100:00100000:3.0:1788361389.818499:0:31281:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361389.820479:0:31281:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:31281:1875232144182912:192.168.203.60@tcp:105: 00010000:00010000:3.0:1788361389.820500:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.820618:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614187 lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361389.820696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.820780:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130633472 00000100:00100000:1.0:1788361389.820787:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130633472 00000100:00100000:1.0:1788361389.820839:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361389.820848:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+22:28484:x1875232130633472:12345-192.168.203.60@tcp:49:lfs.0 00000100:00100000:1.0:1788361389.820966:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+22:28484:x1875232130633472:12345-192.168.203.60@tcp:49:lfs.0 Request processed in 119us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.820972:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00010000:00010000:3.0:1788361389.820997:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614260 lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821019:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614260 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821031:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614260 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821045:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614260 lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821052:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614260 lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821058:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614260 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821065:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.821069:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614260 lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821075:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614260 lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821110:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361389.821114:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.821118:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614260 lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821124:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614260 lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821136:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6614252 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821148:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6614252 lrc: 2/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821155:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6614252 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821160:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.821163:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6614252 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821170:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6614252 lrc: 4/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821178:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:3.0:1788361389.821181:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361389.821184:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6614252 lrc: 2/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.821189:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6614252 lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.821376:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+21:28485:x1875232130633216:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 7399us (7581us total) trans 25769803859 rc 0/0 00000100:00100000:3.0:1788361389.821385:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000020:00080000:3.0:1788361389.821389:0:31281:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1788361389.822176:0:31311:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788361389.822182:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361389.822217:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:2.0:1788361389.822224:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788361389.822847:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.822876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.822887:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130633600 00000100:00100000:1.0:1788361389.822895:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130633600 00000100:00100000:0.0:1788361389.822922:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130633856 00000100:00100000:0.0:1788361389.822929:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130633856 00000100:00100000:1.0:1788361389.822944:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788361389.822955:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:28484:x1875232130633600:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361389.822969:0:31912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1788361389.822975:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361389.822987:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+21:28485:x1875232130633856:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00010000:00010000:1.0:1788361389.822997:0:31912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2c0a1e6/0xf6a94c97d6614267 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f14f expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361389.823021:0:31912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa3:0x0] initial LVB size: 1024, mtime: 0x6a983aad, atime: 0x6a983aad, ctime: 0x6a983aad, blocks: 0xb 00010000:00010000:1.0:1788361389.823038:0:31912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=779s v=(0 0) 00010000:00010000:1.0:1788361389.823042:0:31912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361389.823051:0:31912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c0a1e6/0xf6a94c97d6614267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f14f expref: 7 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.823119:0:31912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d2c0a1e6/0xf6a94c97d6614267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f14f expref: 7 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.823133:0:31912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ee600, rc 0) 00000100:00100000:1.0:1788361389.823181:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:28484:x1875232130633600:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 229us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.823188:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000004:00080000:0.0:1788361389.823639:0:31283:0:(mdd_object.c:4016:mdd_close()) Object [0x200002b11:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788361389.823755:0:31283:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803860 00010000:00010000:0.0:1788361389.823805:0:31283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.823829:0:31283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.823839:0:31283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.823848:0:31283:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.823854:0:31283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 4/0,1 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.823861:0:31283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.823877:0:31283:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788361389.823937:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+23:28485:x1875232130633856:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 953us (1058us total) trans 25769803861 rc 0/0 00000100:00100000:0.0:1788361389.823945:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000020:00080000:0.0:1788361389.823949:0:31283:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788361389.824131:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361389.824138:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.824146:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361389.824149:0:31267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.824156:0:31267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.824168:0:31267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x8:0x0].0x0 (ffff9a8a90b43600) 00010000:00010000:1.0:1788361389.824171:0:31267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788361389.824175:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 1/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.824182:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965a00/0xf6a94c97d661426e lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31283 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.824196:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361389.824198:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361389.824205:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361389.825512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.825789:0:31920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130633984 00000100:00100000:1.0:1788361389.825798:0:31920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130633984 00002000:00100000:1.0:1788361389.825904:0:31920:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa3:0x0] (0->4095) req@ffff9a898705c000 x1875232130633984/t0(0) o3->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:450/0 lens 488/0 e 0 to 0 dl 1788361400 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361389.825914:0:31920:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705c000 with x1875232130633984 ext(0->4095) 00002000:00010000:1.0:1788361389.825918:0:31920:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898705c000 00000100:00100000:1.0:1788361389.825941:0:31920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361389.825947:0:31920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130633984:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361389.826122:0:31920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2349:x1875232130633984:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 174us (616us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788361389.826129:0:31920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00002000:00100000:1.0:1788361389.826136:0:31920:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xa3:0x0] (0->4095) req@ffff9a898705c000 x1875232130633984/t0(0) o3->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:450/0 lens 488/4536 e 0 to 0 dl 1788361400 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361389.826143:0:31920:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705c000 with x1875232130633984 ext(0->4095) 00002000:00010000:1.0:1788361389.826146:0:31920:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898705c000 00000100:00100000:2.0:1788361389.831331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.831379:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130634112 00000100:00100000:3.0:1788361389.831389:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130634112 00000100:00100000:3.0:1788361389.831469:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1788361389.831480:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2352:x1875232130634112:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:3.0:1788361389.831533:0:31913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.831549:0:31913:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2c0a1e6/0xf6a94c97d6614267 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f14f expref: 7 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.831555:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361389.831559:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361389.831562:0:31913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.831587:0:31913:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2c0a1e6/0xf6a94c97d6614267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f14f expref: 7 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.831596:0:31913:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2c0a1e6/0xf6a94c97d6614267 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f14f expref: 7 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.831607:0:31913:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31913:1875232144183040:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361389.831871:0:31913:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361389.838115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.838194:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130634240 00000100:00100000:1.0:1788361389.838205:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130634240 00010000:00010000:1.0:1788361389.838245:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2c0a1e6/0xf6a94c97d6614267 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f14f expref: 8 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.838613:0:31913:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:31913:1875232144183040:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361389.838637:0:31913:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.838749:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:1.0:1788361389.838761:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2350:x1875232130634240:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361389.838790:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361389.838816:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2c0a1e6/0xf6a94c97d6614267 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f14f expref: 8 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.838856:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2c0a1e6/0xf6a94c97d6614267 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f14f expref: 8 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.838880:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2c0a1e6/0xf6a94c97d6614267 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xa3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f14f expref: 8 pid: 31912 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.838896:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361389.838901:0:31265:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361389.838913:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.838924:0:31265:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.838951:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361389.838977:0:31913:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.839000:0:31913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.839010:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+7:2350:x1875232130634240:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 249us (933us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361389.839028:0:31913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.839030:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00010000:00010000:3.0:1788361389.839041:0:31913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.839049:0:31913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.839056:0:31913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361389.839060:0:31913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.839070:0:31913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.839082:0:31913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.839461:0:31913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d6614275 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361389.839895:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2352:x1875232130634112:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 8414us (8571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.839903:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:2.0:1788361389.842880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.842947:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130634496 00000100:00100000:3.0:1788361389.842957:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130634496 00000100:00100000:3.0:1788361389.843021:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788361389.843031:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+23:28484:x1875232130634496:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:3.0:1788361389.843182:0:31282:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200002b12:0x2:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eec00/0xf6a94c97d6614179 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f109 expref: 23 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361389.843590:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803862 00000001:00080000:3.0:1788361389.843920:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803863 00010000:00010000:3.0:1788361389.843973:0:31282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.843988:0:31282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 2/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 26 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.843997:0:31282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 4/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.844029:0:31282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 26 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.844043:0:31282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 26 pid: 31281 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361389.844057:0:31282:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:31282:1875232144183168:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361389.844502:0:31282:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361389.846856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.846947:0:31282:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab9880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:31282:1875232144183168:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361389.846970:0:31282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.847033:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130634624 00000100:00100000:1.0:1788361389.847040:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130634624 00010000:00010000:1.0:1788361389.847070:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 27 pid: 31281 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.847134:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788361389.847143:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9eabb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+27:2349:x1875232130634624:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361389.847169:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361389.847176:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 4/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 27 pid: 31281 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.847187:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 27 pid: 31281 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.847207:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d661418e lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f110 expref: 27 pid: 31281 timeout: 879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.847221:0:31264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:1.0:1788361389.847496:0:31264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.847508:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.847515:0:31264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 4/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.847571:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361389.847620:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9eabb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+26:2349:x1875232130634624:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 474us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.847628:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00010000:00010000:2.0:1788361389.847717:0:31282:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.847732:0:31282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361389.847840:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803864 00000001:00080000:2.0:1788361389.848029:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803865 00000001:00080000:2.0:1788361389.848566:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803866 00000100:00100000:2.0:1788361389.848645:0:31282:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31282:1875232144183296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788361389.848685:0:31282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361389.848734:0:33511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144183296 00000100:00100000:2.0:1788361389.848736:0:31282:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a1600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361389.848741:0:33511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144183296 00000100:00100000:1.0:1788361389.848845:0:33511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788361389.848854:0:33511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:31282:x1875232144183296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788361389.848923:0:33511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:31282:x1875232144183296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 71us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.848937:0:33511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361389.848997:0:31282:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31282:1875232144183296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788361389.849441:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803867 00000100:00100000:2.0:1788361389.849486:0:31282:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31282:1875232144183424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788361389.849512:0:31282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361389.849539:0:31282:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361389.849650:0:31285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144183424 00000100:00100000:0.0:1788361389.849655:0:31285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144183424 00000100:00100000:0.0:1788361389.849691:0:31285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361389.849698:0:31285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:31282:x1875232144183424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788361389.849854:0:31285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:31282:x1875232144183424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 156us (340us total) trans 25769803792 rc 0/0 00000100:00100000:0.0:1788361389.849861:0:31285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361389.849971:0:31282:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:31282:1875232144183424:0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:2.0:1788361389.849997:0:31282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.850006:0:31282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.850012:0:31282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.850018:0:31282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361389.850022:0:31282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.850040:0:31282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.850053:0:31282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:2.0:1788361389.850056:0:31282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788361389.850060:0:31282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.850065:0:31282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d661427c lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31282 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361389.850337:0:31282:0:(mdd_object.c:4016:mdd_close()) Object [0x200002b11:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788361389.850414:0:31282:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x22:0x0].4, 64 off8496 00000001:00080000:2.0:1788361389.850423:0:31282:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 25769803868 00010000:00010000:2.0:1788361389.850457:0:31282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4a00) 00010000:00010000:2.0:1788361389.850460:0:31282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361389.850467:0:31282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eec00/0xf6a94c97d6614179 lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f109 expref: 30 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361389.850715:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+29:28484:x1875232130634496:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 7676us (7834us total) trans 25769803869 rc 0/0 00000100:00100000:2.0:1788361389.850724:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000020:00080000:2.0:1788361389.850728:0:31282:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:3.0:1788361389.853911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.854126:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130634752 00000100:00100000:2.0:1788361389.854136:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130634752 00000100:00100000:2.0:1788361389.854185:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:2.0:1788361389.854194:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+29:28484:x1875232130634752:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361389.854217:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.854251:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6614283 lrc: 2/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f156 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.854311:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6614283 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f156 expref: 30 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.854326:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6614283 lrc: 3/0,0 mode: CR/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f156 expref: 30 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.854345:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:2.0:1788361389.854348:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361389.854352:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ea00, rc 0) 00000100:00100000:2.0:1788361389.854415:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+30:28484:x1875232130634752:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 222us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.854422:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:2.0:1788361389.858972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.859688:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130635008 00000100:00100000:0.0:1788361389.859699:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130635008 00000100:00100000:0.0:1788361389.859819:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361389.859829:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+30:28484:x1875232130635008:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361389.860066:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+31:28484:x1875232130635008:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 238us (1101us total) trans 25769803870 rc 0/0 00000100:00100000:0.0:1788361389.860073:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:1.0:1788361389.919517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.919575:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130635136 00000100:00100000:0.0:1788361389.919584:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130635136 00000100:00100000:0.0:1788361389.919632:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:0.0:1788361389.919643:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+31:28495:x1875232130635136:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1788361389.919721:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d661428a lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.919737:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d661428a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.919749:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d661428a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.919774:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614291 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.919782:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614291 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.919789:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614291 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920067:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920119:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920128:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361389.920165:0:31279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920176:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d661428a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920183:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d661428a lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920190:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d661428a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920195:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361389.920199:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d661428a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920206:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d661428a lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920217:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361389.920219:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361389.920223:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d661428a lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920229:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d661428a lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920245:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614291 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920251:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614291 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920256:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614291 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920261:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361389.920264:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614291 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920269:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614291 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920276:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361389.920278:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361389.920281:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614291 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920286:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d6614291 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920298:0:31279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920304:0:31279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920310:0:31279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920321:0:31279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361389.920323:0:31279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920330:0:31279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920337:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:0.0:1788361389.920339:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361389.920342:0:31279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.920347:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614298 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.920414:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+31:28495:x1875232130635136:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 773us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361389.920423:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:3.0:1788361389.970031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361389.970235:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130635264 00000100:00100000:2.0:1788361389.970246:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130635264 00000100:00100000:2.0:1788361389.970305:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:2.0:1788361389.970315:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+31:28501:x1875232130635264:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361389.970334:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361389.970354:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d661429f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f15d expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.970437:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66142a6 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.970451:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66142a6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.970482:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66142a6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361389.970870:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 7680 00000004:00200000:2.0:1788361389.970875:0:32594:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361389.971080:0:32594:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66142a6 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.971155:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d661429f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f15d expref: 33 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.971179:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66142a6 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f15d expref: 32 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361389.971665:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361389.971669:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361389.971675:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fc00, rc 0) 00000100:00100000:2.0:1788361389.972394:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+32:28501:x1875232130635264:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 2076us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361389.972403:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:2.0:1788361389.982873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361389.983122:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130635392 00000100:00100000:3.0:1788361389.983524:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130635392 00000100:00100000:3.0:1788361389.983585:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:3.0:1788361389.983595:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+32:28501:x1875232130635392:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361389.983614:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361389.983634:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142ad lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f164 expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.983694:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142b4 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.983718:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142b4 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.983730:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142b4 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.983745:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142bb lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.983752:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142bb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.983758:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142bb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984077:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984123:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984142:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361389.984174:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:3.0:1788361389.984178:0:31281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361389.984196:0:31281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984206:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984214:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142b4 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984220:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142b4 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984226:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142b4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984232:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.984236:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142b4 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984242:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142b4 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984254:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361389.984261:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.984267:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142b4 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984272:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142b4 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984286:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142bb lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984291:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142bb lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984296:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142bb lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984301:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361389.984304:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142bb lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984310:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142bb lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984316:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8a890c3e00) 00010000:00010000:3.0:1788361389.984318:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361389.984321:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142bb lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984325:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142bb lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984353:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142ad lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f164 expref: 34 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984376:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f164 expref: 33 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361389.984383:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:3.0:1788361389.984385:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361389.984388:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce200, rc 0) 00000100:00100000:3.0:1788361389.984452:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+33:28501:x1875232130635392:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 859us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361389.984460:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:1.0:1788361389.990438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361389.991015:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130635648 00000100:00100000:0.0:1788361389.991026:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130635648 00000100:00100000:0.0:1788361389.993067:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:0.0:1788361389.993103:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+33:28501:x1875232130635648:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361389.993125:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361389.993148:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66142c9 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f16b expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.993250:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.993286:0:31280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f164 expref: 34 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.993295:0:31280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 4/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.993335:0:31280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f164 expref: 34 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361389.993351:0:31280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f164 expref: 34 pid: 31281 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361389.996344:0:31280:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144183552:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361389.996542:0:31280:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85081180 going to sleep for 11 seconds 00000100:00100000:2.0:1788361389.998757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361389.998850:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130635776 00000100:00100000:1.0:1788361389.998860:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130635776 00010000:00010000:1.0:1788361389.998896:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 5/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f164 expref: 35 pid: 31281 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361389.998938:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:1.0:1788361389.998948:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:2350:x1875232130635776:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361389.998963:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361389.998970:0:31265:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 5/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f164 expref: 35 pid: 31281 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.998980:0:31265:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f164 expref: 35 pid: 31281 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.998999:0:31265:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:1.0:1788361389.999003:0:31265:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 3/0,1 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.999009:0:31265:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.999014:0:31265:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 4/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361389.999027:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361389.999111:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:2350:x1875232130635776:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 139us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361389.999119:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00010000:00010000:0.0:1788361390.003042:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66142c2 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f164 expref: 34 pid: 31281 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361390.003071:0:31280:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144183552:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361390.003115:0:31280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.003127:0:31280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.003133:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 3/0,1 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361390.003154:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00010000:00010000:0.0:1788361390.003398:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d66142c9 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f16b expref: 35 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.003414:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f16b expref: 34 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.003422:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:0.0:1788361390.003425:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361390.003428:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964c00, rc 0) 00000100:00100000:0.0:1788361390.003540:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28501:x1875232130635648:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 10461us (13111us total) trans 25769803871 rc 0/0 00000100:00100000:0.0:1788361390.003549:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:2.0:1788361390.068771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361390.068854:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130635904 00000100:00100000:3.0:1788361390.068865:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130635904 00000100:00100000:3.0:1788361390.068924:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:3.0:1788361390.068933:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28511:x1875232130635904:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788361390.069015:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142de lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069031:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142de lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069042:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142de lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069055:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142e5 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069062:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142e5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069111:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142e5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069463:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069473:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069480:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361390.069519:0:31281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069529:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142de lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069535:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142de lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069543:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142de lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069548:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361390.069552:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142de lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069560:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142de lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069571:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361390.069582:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361390.069587:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142de lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069594:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66142de lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069608:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142e5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069614:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142e5 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069620:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142e5 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069625:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361390.069628:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142e5 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069634:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142e5 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069642:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8a890c3e00) 00010000:00010000:3.0:1788361390.069644:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361390.069647:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142e5 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069653:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66142e5 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069668:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069682:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 2/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069688:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069693:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361390.069696:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069702:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 4/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069720:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:3.0:1788361390.069722:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361390.069726:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 2/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.069732:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66142ec lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361390.069811:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28511:x1875232130635904:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 878us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361390.069820:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:2.0:1788361390.091004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361390.091125:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130636032 00000100:00100000:1.0:1788361390.091134:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130636032 00000100:00100000:1.0:1788361390.091187:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:1.0:1788361390.091197:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28512:x1875232130636032:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:1.0:1788361390.091217:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361390.091238:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d66142f3 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f172 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091301:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66142fa lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091316:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66142fa lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091326:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66142fa lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091339:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614301 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091346:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614301 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091353:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614301 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091787:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091811:0:32594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 2/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f16b expref: 35 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091819:0:32594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 4/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091852:0:32594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f16b expref: 35 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.091871:0:32594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 4/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f16b expref: 35 pid: 31280 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361390.091886:0:32594:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32594:1875232144183680:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361390.092032:0:32594:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8138bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361390.101461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361390.101578:0:32594:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:32594:1875232144183680:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361390.101605:0:32594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361390.102128:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130636288 00000100:00100000:3.0:1788361390.102136:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130636288 00000100:00100000:3.0:1788361390.102234:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361390.102244:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:27077:x1875232130636288:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788361390.102522:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+37:27077:x1875232130636288:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 278us (1070us total) trans 25769803872 rc 0/0 00000100:00100000:3.0:1788361390.102541:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:2.0:1788361390.104968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361390.105112:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130636416 00000100:00100000:1.0:1788361390.105122:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130636416 00010000:00010000:1.0:1788361390.105159:0:31264:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 4/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f16b expref: 37 pid: 31280 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361390.105201:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:1.0:1788361390.105210:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+37:2349:x1875232130636416:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361390.105225:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361390.105233:0:31264:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 4/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f16b expref: 37 pid: 31280 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.105266:0:31264:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 3/0,0 mode: CW/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f16b expref: 37 pid: 31280 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.105288:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964c00/0xf6a94c97d66142d0 lrc: 0/0,0 mode: --/CW res: [0x200002b12:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f16b expref: 37 pid: 31280 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.105306:0:31264:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:1.0:1788361390.105311:0:31264:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 3/1,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.105320:0:31264:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.105328:0:31264:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 4/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.105358:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361390.105412:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:2349:x1875232130636416:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 202us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361390.105420:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00010000:00010000:2.0:1788361390.105767:0:32594:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105776:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361390.105819:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b12:0x2:0x0]: returning size 1024 00000004:00200000:2.0:1788361390.105824:0:32594:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361390.105842:0:32594:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105855:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 3/1,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105863:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66142fa lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105869:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66142fa lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105875:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66142fa lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105880:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841eee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361390.105884:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66142fa lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105892:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66142fa lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105901:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361390.105912:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361390.105916:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66142fa lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105922:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d66142fa lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105934:0:32594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614301 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105939:0:32594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614301 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105944:0:32594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614301 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105949:0:32594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ee400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361390.105951:0:32594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614301 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105957:0:32594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614301 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.105964:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361390.105966:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361390.105968:0:32594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614301 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.106039:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614301 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.106073:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d66142f3 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f172 expref: 36 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.106159:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 3/0,0 mode: PR/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f172 expref: 35 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.106168:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:2.0:1788361390.106170:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361390.106172:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef400, rc 0) 00000100:00100000:2.0:1788361390.106214:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:28512:x1875232130636032:12345-192.168.203.60@tcp:101:rm.0 Request processed in 15019us (15220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361390.106221:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:2.0:1788361390.109321:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361390.109416:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130636672 00000100:00100000:3.0:1788361390.109426:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130636672 00000100:00100000:3.0:1788361390.109526:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:3.0:1788361390.109537:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:28512:x1875232130636672:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:3.0:1788361390.109594:0:31281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788361390.109622:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef400/0xf6a94c97d6614308 lrc: 0/0,0 mode: --/PR res: [0x200002b12:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f172 expref: 35 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.109644:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6614283 lrc: 0/0,0 mode: --/CR res: [0x200002b12:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f156 expref: 34 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.109656:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8ac20d4200) 00010000:00010000:3.0:1788361390.109672:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fc00/0xf6a94c97d66142a6 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f15d expref: 33 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.109681:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361390.109684:0:31281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361390.109703:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d661430f lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.109760:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d661430f lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.109770:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d661430f lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.109786:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.109869:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.109877:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.113271:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661431d lrc: 3/0,1 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.113289:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661431d lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.113301:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661431d lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114408:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 3/0,1 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114420:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114430:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 3/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114437:0:31281:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 4/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114444:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 4/0,1 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114450:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114476:0:31281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361390.114500:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661431d lrc: 3/0,1 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114506:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661431d lrc: 2/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114513:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661431d lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114519:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361390.114523:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661431d lrc: 3/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114530:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661431d lrc: 4/0,0 mode: EX/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114541:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:3.0:1788361390.114544:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788361390.114548:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661431d lrc: 2/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114554:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661431d lrc: 0/0,0 mode: --/EX res: [0x200002b12:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114573:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d661430f lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114579:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d661430f lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114594:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d661430f lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114599:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361390.114602:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d661430f lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114608:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d661430f lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114616:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361390.114619:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361390.114621:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d661430f lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.114627:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d661430f lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361390.114639:0:31281:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082509c89 reply state 00000000c7632040 transno 25769803873 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361390.114649:0:31281:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361390.114755:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+34:28512:x1875232130636672:12345-192.168.203.60@tcp:36:rm.0 Request processed in 5215us (5438us total) trans 25769803873 rc 0/0 00000100:00100000:3.0:1788361390.114764:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00010000:00010000:0.0:1788361390.114840:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361390.114847:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 2/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.114853:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361390.114856:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 2/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.114863:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 3/0,0 mode: PW/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.114872:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b12:0x2:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:0.0:1788361390.114874:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361390.114877:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 1/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.114883:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6614324 lrc: 0/0,0 mode: --/PW res: [0x200002b12:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.114910:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361390.114912:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361390.114914:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361390.118467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:2.0:1788361390.118550:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.118563:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.118571:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.118577:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361390.118582:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.118590:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.118607:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361390.118611:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361390.118632:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.118639:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6614316 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361390.118718:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130636928 00000100:00100000:0.0:1788361390.118728:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130636928 00000100:00100000:0.0:1788361390.118782:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:0.0:1788361390.118794:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+33:28261:x1875232130636928:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788361390.118817:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361390.118833:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661432b lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f179 expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.118951:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614332 lrc: 3/0,1 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.118965:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614332 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.118987:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614332 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.119002:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 3/0,1 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.119010:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.119017:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361390.120400:0:31280:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xa4:0x0], index 1: 0 00010000:00010000:0.0:1788361390.120543:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614340 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120552:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614340 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120559:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614340 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120583:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614332 lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120587:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614332 lrc: 2/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120591:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614332 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120594:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361390.120596:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614332 lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120601:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614332 lrc: 4/0,0 mode: CW/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120606:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361390.120608:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361390.120611:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614332 lrc: 2/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120616:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614332 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361390.120638:0:31280:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f89d6f5c reply state 00000000fcb3d045 transno 25769803874 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361390.120646:0:31280:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361390.120679:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d661432b lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f179 expref: 36 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120693:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614340 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f179 expref: 35 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.120700:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361390.120703:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361390.120715:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965600, rc 0) 00000100:00100000:0.0:1788361390.120822:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:28261:x1875232130636928:12345-192.168.203.60@tcp:101:bash.0 Request processed in 2030us (2363us total) trans 25769803874 rc 0/0 00000100:00100000:0.0:1788361390.120830:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:1.0:1788361390.132229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1788361390.132364:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 3/0,1 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.132376:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 2/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.132403:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.132410:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361390.132414:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 3/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.132422:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 4/0,0 mode: PW/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.132438:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361390.132441:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361390.132445:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 2/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.132463:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614339 lrc: 0/0,0 mode: --/PW res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361390.132702:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130637056 00000100:00100000:0.0:1788361390.132721:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130637056 00000100:00100000:0.0:1788361390.132781:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1788361390.132793:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:28261:x1875232130637056:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788361390.132810:0:31912:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361390.132832:0:31912:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0c03a6f/0xf6a94c97d661434e lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f180 expref: -99 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361390.132858:0:31912:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361390.132882:0:31912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=780s v=(0 0) 00010000:00010000:0.0:1788361390.132895:0:31912:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361390.132904:0:31912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0c03a6f/0xf6a94c97d661434e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f180 expref: 6 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.132923:0:31912:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0c03a6f/0xf6a94c97d661434e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f180 expref: 6 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.132935:0:31912:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964800, rc 0) 00000100:00100000:0.0:1788361390.133223:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:28261:x1875232130637056:12345-192.168.203.60@tcp:101:bash.0 Request processed in 432us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361390.133231:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:2.0:1788361390.135877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361390.136220:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130637312 00000100:00100000:0.0:1788361390.136229:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130637312 00000100:00100000:0.0:1788361390.136328:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788361390.136338:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+35:28261:x1875232130637312:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:0.0:1788361390.136695:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:28261:x1875232130637312:12345-192.168.203.60@tcp:35:bash.0 Request processed in 358us (826us total) trans 25769803875 rc 0/0 00000100:00100000:0.0:1788361390.136704:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00010000:00010000:3.0:1788361390.176379:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361390.185235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361390.185328:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130637440 00000100:00100000:0.0:1788361390.185339:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130637440 00000100:00100000:0.0:1788361390.185414:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:0.0:1788361390.185425:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+36:28518:x1875232130637440:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361390.185447:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361390.185467:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614355 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f187 expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.185555:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661435c lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.185570:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661435c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.185582:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661435c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361390.185640:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0x6:0x0]: returning size 7680 00000004:00200000:0.0:1788361390.185645:0:31279:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361390.185670:0:31279:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661435c lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.185694:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964000/0xf6a94c97d6614355 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f187 expref: 38 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.185722:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661435c lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f187 expref: 37 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.185731:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361390.185733:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361390.185737:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964200, rc 0) 00000100:00100000:0.0:1788361390.185807:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+37:28518:x1875232130637440:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 384us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361390.185814:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:1.0:1788361390.189615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361390.191839:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130637696 00000100:00100000:2.0:1788361390.191853:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130637696 00000100:00100000:2.0:1788361390.191947:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:2.0:1788361390.191958:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+37:28518:x1875232130637696:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361390.191989:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361390.192010:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6614363 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f18e expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.192122:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661436a lrc: 3/1,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.192148:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661436a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.192161:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661436a lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361390.192172:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:2.0:1788361390.192444:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e200/0xf6a94c97d6614363 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f18e expref: 40 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.192465:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661436a lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f18e expref: 39 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.192493:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:2.0:1788361390.192496:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788361390.192500:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e400, rc 0) 00000100:00100000:2.0:1788361390.192582:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+39:28518:x1875232130637696:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 626us (2979us total) trans 25769803876 rc 0/0 00000100:00100000:2.0:1788361390.192590:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:2.0:1788361390.195927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361390.196002:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130637952 00000100:00100000:3.0:1788361390.196012:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130637952 00000100:00100000:3.0:1788361390.196070:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:3.0:1788361390.196079:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+39:28518:x1875232130637952:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361390.196134:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361390.196145:0:31281:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1788361390.196171:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e400/0xf6a94c97d661436a lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f18e expref: 39 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196215:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965600/0xf6a94c97d6614340 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f179 expref: 38 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196225:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:3.0:1788361390.196235:0:31281:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361390.196249:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614378 lrc: 2/0,0 mode: --/EX res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f195 expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196397:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661437f lrc: 3/1,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196414:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661437f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196424:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661437f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196439:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661437f lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196444:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661437f lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196452:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661437f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196459:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361390.196463:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661437f lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196482:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661437f lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196491:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:3.0:1788361390.196493:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361390.196497:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661437f lrc: 2/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196503:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d661437f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196537:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6614386 lrc: 3/0,1 mode: --/EX res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196548:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6614386 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196555:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6614386 lrc: 3/0,1 mode: EX/EX res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196782:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6614386 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f195 expref: 40 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196791:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:3.0:1788361390.196793:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788361390.196802:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6614378 lrc: 0/0,0 mode: --/EX res: [0x200002b11:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f195 expref: 40 pid: 31281 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196816:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6614386 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f195 expref: 39 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.196861:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:3.0:1788361390.196864:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788361390.196866:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf000, rc 0) 00000100:00100000:3.0:1788361390.196918:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+39:28518:x1875232130637952:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 840us (1000us total) trans 25769803877 rc 0/0 00000100:00100000:3.0:1788361390.196926:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:3.0:1788361390.200609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361390.200843:0:31918:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130638080 00000100:00100000:0.0:1788361390.200853:0:31918:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130638080 00002000:00100000:0.0:1788361390.200918:0:31918:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa4:0x0] (0->10) req@ffff9a8ab6abaa00 x1875232130638080/t0(0) o4->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:451/0 lens 504/0 e 0 to 0 dl 1788361401 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361390.201039:0:31918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6abaa00 with x1875232130638080 ext(0->10) 00002000:00010000:0.0:1788361390.201045:0:31918:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6abaa00 00000100:00100000:0.0:1788361390.201081:0:31918:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361390.201248:0:31918:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2349:x1875232130638080:12345-192.168.203.60@tcp:4:bash.0 00000100:00100000:0.0:1788361390.202265:0:31918:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2349:x1875232130638080:12345-192.168.203.60@tcp:4:bash.0 Request processed in 1018us (1661us total) trans 25769803784 rc 0/0 00000100:00100000:0.0:1788361390.202276:0:31918:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00002000:00100000:0.0:1788361390.202286:0:31918:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xa4:0x0] (0->10) req@ffff9a8ab6abaa00 x1875232130638080/t25769803784(0) o4->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:451/0 lens 504/448 e 0 to 0 dl 1788361401 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361390.202295:0:31918:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6abaa00 with x1875232130638080 ext(0->10) 00002000:00010000:0.0:1788361390.202299:0:31918:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6abaa00 00000100:00100000:1.0:1788361390.207844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361390.207931:0:31919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130638208 00000100:00100000:3.0:1788361390.207941:0:31919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130638208 00002000:00100000:3.0:1788361390.207999:0:31919:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa4:0x0] (0->4095) req@ffff9a8a843e9c00 x1875232130638208/t0(0) o3->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:451/0 lens 488/0 e 0 to 0 dl 1788361401 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361390.208011:0:31919:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a843e9c00 with x1875232130638208 ext(0->4095) 00002000:00010000:3.0:1788361390.208017:0:31919:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a843e9c00 00000100:00100000:3.0:1788361390.208047:0:31919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361390.208057:0:31919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2349:x1875232130638208:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361390.208270:0:31919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+8:2349:x1875232130638208:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 214us (434us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788361390.208277:0:31919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00002000:00100000:3.0:1788361390.208285:0:31919:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xa4:0x0] (0->4095) req@ffff9a8a843e9c00 x1875232130638208/t0(0) o3->7b6b2b85-840a-4c64-a4e4-54d135f64238@192.168.203.60@tcp:451/0 lens 488/4536 e 0 to 0 dl 1788361401 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361390.208294:0:31919:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a843e9c00 with x1875232130638208 ext(0->4095) 00002000:00010000:3.0:1788361390.208298:0:31919:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a843e9c00 00000100:00100000:2.0:1788361390.216530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361390.216646:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130638464 00000100:00100000:3.0:1788361390.216667:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130638464 00000100:00100000:3.0:1788361390.216730:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788361390.216741:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+39:28518:x1875232130638464:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361390.217022:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+40:28518:x1875232130638464:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 281us (500us total) trans 25769803878 rc 0/0 00000100:00100000:3.0:1788361390.217030:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1788361390.240604:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144183808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361390.240675:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361390.241722:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144183808 00000100:00100000:0.0:1788361390.241732:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144183808 00000100:00100000:0.0:1788361390.241785:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788361390.241808:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144183808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361390.241832:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3851419648 avail 3847225344 00000100:00100000:0.0:1788361390.241895:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144183808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361390.241902:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361390.242052:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144183808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361390.296860:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361390.300799:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130638592 00000100:00100000:2.0:1788361390.300813:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130638592 00000100:00100000:2.0:1788361390.300879:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:2.0:1788361390.300888:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+40:28528:x1875232130638592:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361390.300958:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661438d lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.300976:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661438d lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.300986:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661438d lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301000:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6614394 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301025:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6614394 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301034:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6614394 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301151:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301159:0:31280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301166:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361390.301201:0:31280:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301212:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661438d lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301219:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661438d lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301226:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661438d lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301232:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361390.301235:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661438d lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301243:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661438d lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301259:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361390.301262:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361390.301266:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661438d lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301272:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d661438d lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301283:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6614394 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301288:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6614394 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301294:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6614394 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301299:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361390.301302:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6614394 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301308:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6614394 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301314:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8ac20d4a00) 00010000:00010000:2.0:1788361390.301316:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361390.301318:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6614394 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301323:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d6614394 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301344:0:31280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301350:0:31280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301355:0:31280:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301360:0:31280:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361390.301363:0:31280:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301367:0:31280:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301374:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:2.0:1788361390.301376:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361390.301378:0:31280:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 2/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.301384:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fa00/0xf6a94c97d661439b lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361390.301452:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+40:28528:x1875232130638592:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 565us (4602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361390.301461:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:1.0:1788361390.371758:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361390.371856:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130638720 00000100:00100000:3.0:1788361390.371866:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130638720 00000100:00100000:3.0:1788361390.371953:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:3.0:1788361390.371963:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+40:28534:x1875232130638720:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361390.371982:0:31281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361390.372000:0:31281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66143a2 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f19c expref: -99 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372057:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66143a9 lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372072:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66143a9 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372082:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66143a9 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372119:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d66143b0 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372126:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d66143b0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372133:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d66143b0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372234:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372242:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372248:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361390.372277:0:31281:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00000004:00200000:3.0:1788361390.372280:0:31281:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361390.372294:0:31281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372304:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372313:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66143a9 lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372319:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66143a9 lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372326:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66143a9 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372331:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361390.372336:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66143a9 lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372343:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66143a9 lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372358:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361390.372361:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361390.372366:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66143a9 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372373:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66143a9 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372386:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d66143b0 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372391:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d66143b0 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372397:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d66143b0 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372402:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361390.372405:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d66143b0 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372410:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d66143b0 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372416:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8a890c3b00) 00010000:00010000:3.0:1788361390.372418:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361390.372420:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d66143b0 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372426:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce600/0xf6a94c97d66143b0 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372463:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66143a2 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f19c expref: 42 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372479:0:31281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f19c expref: 41 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361390.372486:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:3.0:1788361390.372488:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361390.372491:0:31281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf600, rc 0) 00000100:00100000:3.0:1788361390.372594:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+41:28534:x1875232130638720:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 632us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361390.372601:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:3.0:1788361390.379682:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361390.379842:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130638976 00000100:00100000:1.0:1788361390.379852:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130638976 00000100:00100000:1.0:1788361390.379968:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:1.0:1788361390.379992:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+41:28534:x1875232130638976:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361390.380013:0:32594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361390.380033:0:32594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eec00/0xf6a94c97d66143be lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f1a3 expref: -99 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.380151:0:32594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee600/0xf6a94c97d66143c5 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.380166:0:32594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee600/0xf6a94c97d66143c5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.380178:0:32594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee600/0xf6a94c97d66143c5 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361390.380189:0:32594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:1.0:1788361390.380306:0:32594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eec00/0xf6a94c97d66143be lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1a3 expref: 44 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.380324:0:32594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee600/0xf6a94c97d66143c5 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1a3 expref: 43 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361390.380332:0:32594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:1.0:1788361390.380335:0:32594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361390.380338:0:32594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ee600, rc 0) 00000100:00100000:1.0:1788361390.380404:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+43:28534:x1875232130638976:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 413us (732us total) trans 25769803879 rc 0/0 00000100:00100000:1.0:1788361390.380411:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:1.0:1788361390.384038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361390.384134:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130639232 00000100:00100000:0.0:1788361390.384144:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130639232 00000100:00100000:0.0:1788361390.384194:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361390.384204:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+43:28534:x1875232130639232:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361390.384552:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+44:28534:x1875232130639232:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 348us (521us total) trans 25769803880 rc 0/0 00000100:00100000:0.0:1788361390.384560:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:3.0:1788361390.385244:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361390.385354:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130639360 00000100:00100000:2.0:1788361390.385361:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130639360 00000100:00100000:2.0:1788361390.385412:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361390.385431:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+44:2350:x1875232130639360:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361390.385443:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361390.385473:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee600/0xf6a94c97d66143c5 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1a3 expref: 44 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.385494:0:31266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:2.0:1788361390.385500:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361390.385540:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+43:2350:x1875232130639360:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 110us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361390.385548:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361390.481861:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361390.485126:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130639616 00000100:00100000:0.0:1788361390.485144:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130639616 00000100:00100000:0.0:1788361390.485300:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:0.0:1788361390.485313:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+43:28550:x1875232130639616:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361390.485757:0:31279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361390.485781:0:31279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143d3 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f1aa expref: -99 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.485906:0:31279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66143da lrc: 3/1,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.485922:0:31279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66143da lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.485933:0:31279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66143da lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361390.485944:0:31279:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:0.0:1788361390.486491:0:31279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143d3 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1aa expref: 46 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.486513:0:31279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66143da lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1aa expref: 45 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.486522:0:31279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:0.0:1788361390.486533:0:31279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788361390.486536:0:31279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964a00, rc 0) 00000100:00100000:0.0:1788361390.486609:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+45:28550:x1875232130639616:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1298us (4756us total) trans 25769803881 rc 0/0 00000100:00100000:0.0:1788361390.486617:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:3.0:1788361390.602454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361390.604282:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130639872 00000100:00100000:2.0:1788361390.604296:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130639872 00000100:00100000:2.0:1788361390.604369:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:2.0:1788361390.604379:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+45:28566:x1875232130639872:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361390.604403:0:31280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361390.604422:0:31280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d66143e8 lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f1b1 expref: -99 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.604515:0:31280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66143ef lrc: 3/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.604530:0:31280:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f19c expref: 46 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.604539:0:31280:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66143ef lrc: 4/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.604590:0:31280:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f19c expref: 46 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.604603:0:31280:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f19c expref: 46 pid: 31281 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361390.604616:0:31280:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144183936:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361390.604851:0:31280:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a81254240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361390.609070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361390.609437:0:31280:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:31280:1875232144183936:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361390.609465:0:31280:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66143ef lrc: 3/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361390.609515:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130640000 00000100:00100000:0.0:1788361390.609523:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130640000 00010000:00010000:0.0:1788361390.609556:0:31265:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f19c expref: 47 pid: 31281 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361390.609611:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1788361390.609619:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+47:2349:x1875232130640000:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361390.609631:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361390.609637:0:31266:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f19c expref: 47 pid: 31281 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.609646:0:31266:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f19c expref: 47 pid: 31281 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.609662:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66143b7 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f19c expref: 47 pid: 31281 timeout: 880 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.609674:0:31266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:2.0:1788361390.609689:0:31266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66143ef lrc: 3/0,1 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.609696:0:31266:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66143ef lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.609701:0:31266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66143ef lrc: 4/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361390.610298:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361390.610352:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+46:2349:x1875232130640000:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 732us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361390.610360:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00010000:00010000:0.0:1788361390.610685:0:31280:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66143ef lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.610694:0:31280:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66143ef lrc: 3/0,1 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 31280 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361390.610780:0:31280:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200002b11:0xa:0x0]: returning size 11 00010000:00010000:0.0:1788361390.610920:0:31280:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f800/0xf6a94c97d66143e8 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1b1 expref: 47 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.610938:0:31280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66143ef lrc: 3/0,0 mode: CW/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1b1 expref: 46 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.610947:0:31280:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:0.0:1788361390.610950:0:31280:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361390.610953:0:31280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ec00, rc 0) 00000100:00100000:0.0:1788361390.610980:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+46:28566:x1875232130639872:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 6603us (8534us total) trans 25769803882 rc 0/0 00000100:00100000:0.0:1788361390.610987:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:3.0:1788361390.666743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361390.666841:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130640128 00000100:00100000:0.0:1788361390.666851:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130640128 00000100:00100000:0.0:1788361390.666905:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1788361390.666914:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+46:28576:x1875232130640128:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1788361390.666989:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143fd lrc: 3/1,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667005:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143fd lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667015:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143fd lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667028:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614404 lrc: 3/1,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667035:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614404 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667042:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614404 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667167:0:31281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 3/1,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667176:0:31281:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667183:0:31281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361390.667220:0:31281:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667244:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143fd lrc: 3/1,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667251:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143fd lrc: 2/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667257:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143fd lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667263:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361390.667266:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143fd lrc: 3/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667273:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143fd lrc: 4/0,0 mode: CR/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667284:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361390.667287:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361390.667291:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143fd lrc: 2/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667297:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d66143fd lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667308:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614404 lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667314:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614404 lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667320:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614404 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667329:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361390.667332:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614404 lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667338:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614404 lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667345:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x9cd2ad07 (ffff9a8a90b43800) 00010000:00010000:0.0:1788361390.667347:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361390.667410:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614404 lrc: 2/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667416:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614404 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x9cd2ad07 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667430:0:31281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 3/1,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667436:0:31281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 2/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667442:0:31281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667447:0:31281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361390.667450:0:31281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 3/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667455:0:31281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 4/0,0 mode: PR/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667472:0:31281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:0.0:1788361390.667474:0:31281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361390.667477:0:31281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 2/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361390.667482:0:31281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965400/0xf6a94c97d661440b lrc: 0/0,0 mode: --/PR res: [0x200002b11:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 31281 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361390.667549:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+46:28576:x1875232130640128:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 635us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361390.667557:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00010000:00010000:1.0:1788361391.200695:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361392.224177:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361392.288248:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144184064:0@lo:400:kworker.0 00000100:00100000:3.0:1788361392.288314:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144184320:0@lo:400:kworker.0 00000100:00100000:0.0:1788361392.288327:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361392.288352:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361392.288383:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361392.288387:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144184576:0@lo:400:kworker.0 00000100:00100000:3.0:1788361392.288394:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144184448:0@lo:400:kworker.0 00000100:00100000:0.0:1788361392.288422:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361392.288452:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788361392.288460:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144184192:0@lo:400:kworker.0 00000100:00100000:3.0:1788361392.288467:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361392.288496:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361392.288521:0:31274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144184064 00000100:00100000:0.0:1788361392.288523:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144184704:0@lo:400:kworker.0 00000100:00100000:3.0:1788361392.288530:0:31274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144184064 00000100:00100000:0.0:1788361392.288552:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361392.288586:0:31274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788361392.288587:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144184576 00000100:00100000:0.0:1788361392.288593:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144184576 00000100:00100000:3.0:1788361392.288601:0:31274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+19:3311:x1875232144184064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361392.288639:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144184448 00000100:00100000:0.0:1788361392.288644:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144184448 00000100:00100000:1.0:1788361392.288665:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144184320 00000100:00100000:0.0:1788361392.288665:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144184704 00000100:00100000:3.0:1788361392.288669:0:31274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87181c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a25ae0af-c16d-4164-9502-26eb1af82516+19:3311:x1875232144184064:12345-0@lo:400:kworker.0 Request processed in 69us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361392.288671:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144184704 00000100:00100000:1.0:1788361392.288672:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144184320 00000100:00100000:3.0:1788361392.288682:0:31274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788361392.288722:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788361392.288731:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144184192 00000100:00100000:0.0:1788361392.288732:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144184576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361392.288737:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144184192 00000100:00100000:3.0:1788361392.288753:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788361392.288764:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144184448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361392.288776:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361392.288779:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144184576:12345-0@lo:400:kworker.0 Request processed in 48us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361392.288790:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788361392.288791:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144184320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361392.288814:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788361392.288817:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144184448:12345-0@lo:400:kworker.0 Request processed in 54us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361392.288826:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144184704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361392.288830:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788361392.288857:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361392.288862:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361392.288865:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361392.288867:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144184704:12345-0@lo:400:kworker.0 Request processed in 44us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361392.288876:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788361392.288884:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361392.288894:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144184192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361392.288946:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144184320:12345-0@lo:400:kworker.0 Request processed in 160us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361392.288956:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788361392.288979:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361392.288993:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144184832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361392.289000:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144184192:12345-0@lo:400:kworker.0 Request processed in 106us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361392.289010:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788361392.289028:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361392.289060:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144184448:0@lo:400:kworker.0 00000100:00100000:0.0:1788361392.289064:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144184704:0@lo:400:kworker.0 00000100:00100000:1.0:1788361392.290973:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144184320:0@lo:400:kworker.0 00000100:00100000:1.0:1788361392.291033:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144184832 00000100:00100000:1.0:1788361392.291038:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144184832 00000100:00100000:2.0:1788361392.291135:0:31916:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361392.291146:0:31916:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144184832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361392.291179:0:31916:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 56164352 pending 3407872 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361392.291249:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144184576:0@lo:400:kworker.0 00000100:00100000:2.0:1788361392.293980:0:31916:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144184832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2828us (4943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361392.293994:0:31916:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361392.294030:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144184064:0@lo:400:kworker.0 00000100:00100000:2.0:1788361392.294064:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144184832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361392.294226:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144184192:0@lo:400:kworker.0 00000001:00080000:3.0:1788361392.334149:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803784 is committed 00000001:00080000:3.0:1788361392.334172:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803782 is committed 00000001:00080000:3.0:1788361392.334176:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803781 is committed 00000001:00080000:3.0:1788361392.334184:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 25769803783 is committed 00000040:00080000:2.0:1788361392.929442:0:31311:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788361392.929452:0:31311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361392.929510:0:31311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:2.0:1788361392.929517:0:31311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00010000:00010000:3.0:1788361393.248516:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361393.572797:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361393.576186:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130640256 00000100:00100000:0.0:1788361393.576201:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130640256 00000100:00080000:3.0:1788361393.576715:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361393.576729:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:2.0:1788361393.576759:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+46:28430:x1875232130640256:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788361393.576878:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+46:28430:x1875232130640256:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 123us (4094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361393.576885:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:2.0:1788361393.580778:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361393.580933:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130640512 00000100:00100000:0.0:1788361393.580944:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130640512 00000100:00100000:0.0:1788361393.581008:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:0.0:1788361393.581019:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+46:28430:x1875232130640512:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361393.581498:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+47:28430:x1875232130640512:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 480us (727us total) trans 25769803883 rc 0/0 00000100:00100000:0.0:1788361393.581505:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00010000:00010000:3.0:1788361394.272249:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361394.320336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361394.320372:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361394.320397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361394.320401:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130640768 00000100:00100000:0.0:1788361394.320420:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130640768 00000100:00100000:3.0:1788361394.320446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361394.320471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361394.320481:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361394.320493:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+47:2350:x1875232130640768:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361394.320514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361394.320542:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130641024 00000100:00100000:1.0:1788361394.320548:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130641024 00000100:00100000:3.0:1788361394.320564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361394.320574:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+47:2350:x1875232130640768:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 82us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361394.320583:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:1.0:1788361394.320589:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130641280 00000100:00100000:1.0:1788361394.320594:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130641280 00000100:00100000:0.0:1788361394.320603:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130641152 00000100:00100000:0.0:1788361394.320608:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130641152 00000100:00100000:1.0:1788361394.320614:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130640896 00000100:00100000:1.0:1788361394.320618:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130640896 00000100:00100000:1.0:1788361394.320641:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130641408 00000100:00100000:0.0:1788361394.320641:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361394.320647:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130641408 00000100:00100000:0.0:1788361394.320653:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+10:2350:x1875232130641152:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361394.320671:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788361394.320692:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130641024:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361394.320699:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361394.320706:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3538730-0385-4711-b11c-bb6af99a7674+10:2350:x1875232130641152:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 54us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361394.320714:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3538730-0385-4711-b11c-bb6af99a7674+6:2350:x1875232130641280:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361394.320718:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361394.320737:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130641024:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 56us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361394.320746:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1788361394.320760:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3538730-0385-4711-b11c-bb6af99a7674+6:2350:x1875232130641280:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 50us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361394.320769:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788361394.320778:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130640896:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361394.322640:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2350:x1875232130640896:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1853us (2159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361394.324813:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:3.0:1788361394.324851:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788361394.324865:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3538730-0385-4711-b11c-bb6af99a7674+5:2350:x1875232130641408:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361394.325072:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3538730-0385-4711-b11c-bb6af99a7674+5:2350:x1875232130641408:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 209us (4507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361394.325081:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1788361394.325112:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361394.325137:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130640640 00000100:00100000:3.0:1788361394.325146:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130640640 00000100:00080000:1.0:1788361394.325181:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361394.325186:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00080000:1.0:1788361394.325189:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361394.325195:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361394.325197:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+13:2350:x1875232130640640:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361394.325230:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87180c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+13:2350:x1875232130640640:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 35us (4784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361394.325236:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00000001:02000400:1.0:1788361394.566880:0:33694:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 3b: Repeat attach/detach operations on multiple clients ========================================================== 11:03:14 (1788361394) 00000001:00080000:3.0:1788361394.906996:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803883 is committed 00000020:00080000:3.0:1788361394.907043:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836518 batchid updated 00000020:00080000:3.0:1788361394.907073:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8aae3a1000 refcount 2 committed 0 result 0 batchid 21474836520 00000020:00080000:3.0:1788361394.907079:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a83646d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8aae3a1600 00000020:00080000:3.0:1788361394.907124:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a83646c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8985935800 00000020:00080000:3.0:1788361394.907164:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a84e2ec00 refcount 2 committed 0 result 0 batchid 21474836519 00000020:00080000:3.0:1788361394.907169:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a8a6b6f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a84e2ecc0 00000020:00080000:3.0:1788361394.907172:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a8a6b6000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8986f77c00 00000020:00080000:1.0:1788361394.907228:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 21474836520 committed batchid 21474836518 00000020:00080000:1.0:1788361394.907537:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836518 00000001:00080000:0.0:1788361394.917355:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803792 is committed 00000001:00080000:0.0:1788361394.917383:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803790 is committed 00010000:00010000:0.0:1788361395.296276:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361395.360338:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144184960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361395.360407:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788361395.360688:0:31302:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 785375599852ns, next at 786375597512ns, rc = 0 00000100:00100000:0.0:1788361395.360796:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144184960 00000100:00100000:0.0:1788361395.360805:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144184960 00000100:00100000:0.0:1788361395.360866:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788361395.360874:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144184960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361395.360907:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 54460416 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361395.360962:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144184960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361395.360968:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788361395.361024:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361395.361179:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803792 gen 2 00000004:00080000:3.0:1788361395.361186:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803791 committed transno 25769803792 00000004:00080000:3.0:1788361395.361203:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803792 committed transno 25769803792 00000100:00100000:3.0:1788361395.361222:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144184960:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788361395.521188:0:33745:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_3b Need 3 or more clients, have 1 00010000:00010000:3.0:1788361396.320288:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361396.570655:0:33794:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 4: Auto cache test for mmap =========== 11:03:16 (1788361396) 00010000:00010000:2.0:1788361397.344606:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361397.408345:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361397.408368:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144185088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361397.408437:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144185344:0@lo:400:kworker.0 00000100:00100000:2.0:1788361397.408442:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361397.408482:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361397.408507:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144185856:0@lo:400:kworker.0 00000100:00100000:2.0:1788361397.408512:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144185216:0@lo:400:kworker.0 00000100:00100000:3.0:1788361397.408543:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361397.408566:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361397.408572:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361397.408581:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144185472:0@lo:400:kworker.0 00000100:00100000:2.0:1788361397.408597:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144185728:0@lo:400:kworker.0 00000100:00100000:3.0:1788361397.408609:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361397.408627:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361397.408648:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361397.408653:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144185344 00000100:00100000:2.0:1788361397.408654:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144185600:0@lo:400:kworker.0 00000100:00100000:3.0:1788361397.408672:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144185344 00000100:00100000:2.0:1788361397.408692:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361397.408731:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144185472 00000100:00100000:3.0:1788361397.408735:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144185472 00000100:00100000:2.0:1788361397.408744:0:31271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144185216 00000100:00100000:2.0:1788361397.408750:0:31271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144185216 00000100:00100000:3.0:1788361397.408767:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361397.408780:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144185344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361397.408783:0:31271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788361397.408836:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144185344:12345-0@lo:400:kworker.0 Request processed in 59us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361397.408843:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361397.408881:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361397.408888:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144185088 00000100:00100000:3.0:1788361397.408890:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144185472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361397.408894:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144185088 00000100:00100000:0.0:1788361397.408931:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788361397.408934:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144185472:12345-0@lo:400:kworker.0 Request processed in 44us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361397.408945:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361397.408950:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144185088:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788361397.408970:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361397.408976:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788361397.408979:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361397.409011:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803783 gen 2 00000004:00080000:3.0:1788361397.409018:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 25769803782 committed transno 25769803783 00000004:00080000:3.0:1788361397.409038:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ab6aba680, transno 25769803783 00000100:00100000:3.0:1788361397.409053:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144185472:0@lo:400:kworker.0 00000100:00100000:2.0:1788361397.409106:0:31271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a87180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+19:3312:x1875232144185216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361397.409168:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144185856 00000100:00100000:1.0:1788361397.409172:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144185856 00000100:00100000:1.0:1788361397.409200:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144185728 00000100:00100000:1.0:1788361397.409202:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144185728 00000100:00100000:1.0:1788361397.409213:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144185600 00000100:00100000:1.0:1788361397.409215:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144185600 00000100:00100000:1.0:1788361397.409225:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788361397.409230:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144185856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361397.409928:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144185088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 980us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361397.409936:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361397.409960:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361397.409967:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144185728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361397.409996:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144185728:12345-0@lo:400:kworker.0 Request processed in 30us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361397.410000:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361397.410012:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361397.410017:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144185600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361397.410054:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144185344:0@lo:400:kworker.0 00000100:00100000:2.0:1788361397.410075:0:31271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a87180450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a25ae0af-c16d-4164-9502-26eb1af82516+19:3312:x1875232144185216:12345-0@lo:400:kworker.0 Request processed in 987us (1507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361397.410081:0:31271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788361397.410418:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144185600:12345-0@lo:400:kworker.0 Request processed in 400us (1726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361397.410426:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361397.410458:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144185600:0@lo:400:kworker.0 00000100:00100000:0.0:1788361397.410466:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144185216:0@lo:400:kworker.0 00000100:00100000:0.0:1788361397.410475:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144185728:0@lo:400:kworker.0 00000100:00100000:0.0:1788361397.410486:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144185088:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788361397.410531:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361397.410706:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144185856:12345-0@lo:400:kworker.0 Request processed in 1474us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361397.410712:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788361397.410760:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144185856:0@lo:400:kworker.0 00010000:00010000:0.0:1788361398.369825:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361398.875753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361398.875831:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130641664 00000100:00100000:3.0:1788361398.875841:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130641664 00000100:00100000:3.0:1788361398.875911:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:3.0:1788361398.875920:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+16:29497:x1875232130641664:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:3.0:1788361398.876294:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:29497:x1875232130641664:12345-192.168.203.60@tcp:35:umount.0 Request processed in 373us (549us total) trans 25769803884 rc 0/0 00000100:00100000:3.0:1788361398.876302:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00080000:0.0:1788361398.876466:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361398.880117:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361398.880798:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130641920 00000100:00100000:3.0:1788361398.880807:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130641920 00000100:00100000:3.0:1788361398.880858:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:3.0:1788361398.880874:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+17:29497:x1875232130641920:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:3.0:1788361398.881820:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:29497:x1875232130641920:12345-192.168.203.60@tcp:35:umount.0 Request processed in 950us (1736us total) trans 25769803885 rc 0/0 00000100:00100000:3.0:1788361398.881831:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:2.0:1788361398.883686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361398.883760:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130642176 00000100:00100000:1.0:1788361398.883768:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130642176 00000100:00100000:1.0:1788361398.883821:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:1.0:1788361398.883844:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:29497:x1875232130642176:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:1.0:1788361398.884140:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+19:29497:x1875232130642176:12345-192.168.203.60@tcp:35:umount.0 Request processed in 298us (459us total) trans 25769803886 rc 0/0 00000100:00100000:1.0:1788361398.884148:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788361398.886293:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361398.886397:0:31282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130642432 00000100:00100000:3.0:1788361398.886411:0:31282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130642432 00000100:00100000:3.0:1788361398.886501:0:31282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:3.0:1788361398.886508:0:31282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1cc7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+19:29497:x1875232130642432:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:3.0:1788361398.886740:0:31282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1cc7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7b6b2b85-840a-4c64-a4e4-54d135f64238+20:29497:x1875232130642432:12345-192.168.203.60@tcp:35:umount.0 Request processed in 231us (455us total) trans 25769803887 rc 0/0 00000100:00100000:3.0:1788361398.886747:0:31282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1788361398.888914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361398.888956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361398.889029:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130642560 00000100:00100000:3.0:1788361398.889038:0:31266:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130642688 00000100:00100000:3.0:1788361398.889047:0:31266:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130642688 00000100:00100000:0.0:1788361398.889049:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130642560 00000100:00100000:3.0:1788361398.889145:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361398.889610:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76414060-9cd0-4e10-991c-7eaed84bf288+14:2351:x1875232130642688:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361398.889625:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361398.889644:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a89bcb000/0xf6a94c97d6613d27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efb9 expref: 14 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361398.889675:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361398.889741:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76414060-9cd0-4e10-991c-7eaed84bf288+13:2351:x1875232130642688:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 587us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361398.889855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361398.889928:0:31264:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788361398.889935:0:31264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788361398.890063:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130642816 00000100:00100000:1.0:1788361398.890069:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130642816 00000100:00100000:3.0:1788361398.890835:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361398.890861:0:31266:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361398.890872:0:31266:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76414060-9cd0-4e10-991c-7eaed84bf288+13:2352:x1875232130642560:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361398.890884:0:31266:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361398.890908:0:31266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987622e00/0xf6a94c97d6613af0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eeaf expref: 13 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361398.890921:0:31266:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361398.890965:0:31266:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:76414060-9cd0-4e10-991c-7eaed84bf288+12:2352:x1875232130642560:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 95us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361398.890972:0:31266:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361398.891053:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361398.891870:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361398.891884:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9eab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76414060-9cd0-4e10-991c-7eaed84bf288+11:2351:x1875232130642816:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361398.891897:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361398.891910:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8400/0xf6a94c97d6613af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eed9 expref: 11 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.891923:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361398.891967:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9eab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76414060-9cd0-4e10-991c-7eaed84bf288+10:2351:x1875232130642816:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 87us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361398.891974:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1788361398.892261:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130643072 00000100:00100000:3.0:1788361398.892268:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130643072 00000100:00100000:3.0:1788361398.892333:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:3.0:1788361398.892341:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+6:2348:x1875232130643072:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:3.0:1788361398.892364:0:31914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613bfa 00000020:00010000:3.0:1788361398.892377:0:31914:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a9808d800: total 0 00000100:00080000:3.0:1788361398.892381:0:31914:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a11f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361398.892415:0:31914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803784 00000020:00010000:2.0:1788361398.892443:0:33055:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a9808d800: total 0 00010000:00010000:2.0:1788361398.892485:0:33055:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a9808d800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1788361398.892516:0:33055:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xa4:0x0] updating lvb size from disk: 0 -> 11 00002000:00010000:2.0:1788361398.892520:0:33055:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xa4:0x0] updating lvb mtime from disk: 0 -> 1788361390 00002000:00010000:2.0:1788361398.892523:0:33055:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xa4:0x0] updating lvb ctime from disk: 0 -> 1788361390 00002000:00010000:2.0:1788361398.892525:0:33055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xa4:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788361398.892555:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0c03a6f/0xf6a94c97d661434e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f180 expref: 5 pid: 31912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361398.892579:0:33055:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a9808d800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788361398.892597:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361398.892601:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361398.892603:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361398.892701:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7b6b2b85-840a-4c64-a4e4-54d135f64238+2:2348:x1875232130643072:12345-192.168.203.60@tcp:9:umount.0 Request processed in 360us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361398.892708:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00080000:1.0:1788361398.892836:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361398.897004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361398.897194:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130643200 00000100:00100000:3.0:1788361398.897205:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130643200 00000100:00100000:3.0:1788361398.897280:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:3.0:1788361398.897290:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+5:2348:x1875232130643200:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:3.0:1788361398.897319:0:32018:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613bf3 00000100:00080000:3.0:1788361398.897329:0:32018:0:(import.c:65:import_set_state_nolock()) ffff9a8987bd0000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788361398.897409:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1788361398.897483:0:32018:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803792 00000100:00100000:3.0:1788361398.897758:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7b6b2b85-840a-4c64-a4e4-54d135f64238+2:2348:x1875232130643200:12345-192.168.203.60@tcp:9:umount.0 Request processed in 469us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361398.897781:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00010000:00010000:0.0:1788361398.897850:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361398.903827:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361398.903900:0:31280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130644224 00000100:00100000:0.0:1788361398.903909:0:31280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130644224 00000100:00100000:0.0:1788361398.904017:0:31280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:0.0:1788361398.904028:0:31280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+20:2348:x1875232130644224:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:0.0:1788361398.904061:0:31280:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613b0c 00000020:00010000:0.0:1788361398.904076:0:31280:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a89852f7000: total 0 00000100:00080000:0.0:1788361398.904081:0:31280:0:(import.c:65:import_set_state_nolock()) ffff9a89852f6800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361398.904131:0:31280:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803887 00000020:00010000:1.0:1788361398.904356:0:31268:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a89852f7000: total 0 00010000:00010000:1.0:1788361398.904405:0:31268:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a89852f7000, canceled 0 locks, left on hash table 11. 00010000:00010000:1.0:1788361398.904448:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:1.0:1788361398.904452:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788361398.904461:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d66143da lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1aa expref: 19 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.904501:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361398.904504:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788361398.904510:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf400/0xf6a94c97d661414f lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x6:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0fb expref: 18 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361398.904518:0:31280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7b6b2b85-840a-4c64-a4e4-54d135f64238+18:2348:x1875232130644224:12345-192.168.203.60@tcp:39:umount.0 Request processed in 489us (695us total) trans 25769803888 rc 0/0 00010000:00010000:1.0:1788361398.904529:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8ac20d4f00) 00000100:00100000:0.0:1788361398.904529:0:31280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00010000:00010000:1.0:1788361398.904534:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361398.904539:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d6614068 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f0ae expref: 17 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.904554:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:1.0:1788361398.904556:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788361398.904560:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6613f81 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f068 expref: 15 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.904574:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8ac20d4000) 00010000:00010000:1.0:1788361398.904577:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361398.904582:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6613c7f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef7a expref: 14 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.904601:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361398.904604:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361398.904608:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661435c lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f187 expref: 13 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.904620:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:1.0:1788361398.904622:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788361398.904633:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6614386 lrc: 0/0,0 mode: --/CR res: [0x200002b11:0xa:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f195 expref: 12 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.904661:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361398.904664:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788361398.904668:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d66141e9 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f125 expref: 11 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.904683:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:1.0:1788361398.904685:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788361398.904690:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6613cbe lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef88 expref: 10 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.904705:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43400) 00010000:00010000:1.0:1788361398.904707:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361398.904712:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965200/0xf6a94c97d6613c63 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef73 expref: 9 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.904728:0:31268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0xa:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:1.0:1788361398.904730:0:31268:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788361398.904734:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ec00/0xf6a94c97d66143ef lrc: 0/0,0 mode: --/CW res: [0x200002b11:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1b1 expref: 8 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361398.904747:0:31268:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a89852f7000, canceled 11 locks, left on hash table 0. 00010000:00010000:1.0:1788361398.904761:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361398.904763:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361398.904765:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361399.393018:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361399.433052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361399.433119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361399.433158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361399.433237:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130644608 00000100:00100000:3.0:1788361399.433247:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130644608 00000100:00080000:2.0:1788361399.433310:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361399.433320:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130644480 00000100:00100000:3.0:1788361399.433325:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130644480 00000100:00100000:2.0:1788361399.433350:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1788361399.433370:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+5:2351:x1875232130644608:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361399.433396:0:32594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130644352 00000100:00100000:0.0:1788361399.433401:0:32594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130644352 00000100:00100000:0.0:1788361399.433435:0:32594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:0.0:1788361399.433444:0:32594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+10:2351:x1875232130644352:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361399.433453:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+5:2351:x1875232130644608:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 92us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361399.433480:0:32594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3538730-0385-4711-b11c-bb6af99a7674+10:2351:x1875232130644352:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 36us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361399.433793:0:32594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00080000:0.0:1788361399.434180:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361399.434184:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361399.434402:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1788361399.434422:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1788361399.434431:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:2351:x1875232130644480:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361399.434478:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3538730-0385-4711-b11c-bb6af99a7674+6:2351:x1875232130644480:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 48us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361399.434484:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1788361399.940769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361399.940878:0:31283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130644864 00000100:00100000:1.0:1788361399.940887:0:31283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130644864 00000100:00100000:1.0:1788361399.940963:0:31283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361399.940973:0:31283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3538730-0385-4711-b11c-bb6af99a7674+10:29511:x1875232130644864:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:1.0:1788361399.941235:0:31283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3538730-0385-4711-b11c-bb6af99a7674+11:29511:x1875232130644864:12345-192.168.203.60@tcp:35:umount.0 Request processed in 262us (474us total) trans 25769803889 rc 0/0 00000100:00100000:1.0:1788361399.941242:0:31283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:0.0:1788361399.944005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361399.944190:0:33904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130644992 00000100:00100000:1.0:1788361399.944200:0:33904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130644992 00000100:00100000:1.0:1788361399.944268:0:33904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1788361399.944278:0:33904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76414060-9cd0-4e10-991c-7eaed84bf288+10:2352:x1875232130644992:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361399.944294:0:33904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361399.944313:0:33904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964600/0xf6a94c97d6613c0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef11 expref: 10 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361399.944331:0:33904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361399.944390:0:33904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:76414060-9cd0-4e10-991c-7eaed84bf288+9:2352:x1875232130644992:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 114us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361399.944398:0:33904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361399.946003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361399.946038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361399.946138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361399.946302:0:31914:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130645376 00000100:00100000:3.0:1788361399.946310:0:31914:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130645376 00000100:00100000:1.0:1788361399.946343:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130645120 00000100:00100000:1.0:1788361399.946347:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130645120 00000100:00100000:1.0:1788361399.946378:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130645248 00000100:00100000:1.0:1788361399.946381:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130645248 00000100:00100000:3.0:1788361399.946392:0:31914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:3.0:1788361399.946401:0:31914:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3538730-0385-4711-b11c-bb6af99a7674+5:2348:x1875232130645376:12345-192.168.203.60@tcp:9:umount.0 00000100:00100000:1.0:1788361399.946401:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361399.946406:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76414060-9cd0-4e10-991c-7eaed84bf288+10:2350:x1875232130645120:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361399.946416:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:3.0:1788361399.946430:0:31914:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613c32 00010000:00010000:1.0:1788361399.946430:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b9600/0xf6a94c97d6613c16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86ef3b expref: 10 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361399.946439:0:31914:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efdc800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361399.946462:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:3.0:1788361399.946473:0:31914:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803784 00000100:00100000:1.0:1788361399.946565:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76414060-9cd0-4e10-991c-7eaed84bf288+9:2350:x1875232130645120:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 158us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361399.946573:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361399.946590:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361399.946595:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76414060-9cd0-4e10-991c-7eaed84bf288+8:2350:x1875232130645248:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361399.946603:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361399.946611:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a89bcba00/0xf6a94c97d6613d20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86efb2 expref: 8 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361399.946619:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361399.946653:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:76414060-9cd0-4e10-991c-7eaed84bf288+7:2350:x1875232130645248:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 57us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361399.946660:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00010000:00010000:0.0:1788361399.946861:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361399.946990:0:31914:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3538730-0385-4711-b11c-bb6af99a7674+2:2348:x1875232130645376:12345-192.168.203.60@tcp:9:umount.0 Request processed in 589us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361399.946998:0:31914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:2.0:1788361399.950193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361399.950274:0:31912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130645632 00000100:00100000:3.0:1788361399.950284:0:31912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130645632 00000100:00100000:3.0:1788361399.950330:0:31912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:3.0:1788361399.950340:0:31912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3538730-0385-4711-b11c-bb6af99a7674+6:2348:x1875232130645632:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:3.0:1788361399.950377:0:31912:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613c2b 00000020:00010000:3.0:1788361399.950386:0:31912:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a9efde000: total 0 00000100:00080000:3.0:1788361399.950390:0:31912:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efda000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361399.950431:0:31912:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803792 00000020:00010000:1.0:1788361399.950533:0:31268:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a9efde000: total 0 00010000:00010000:1.0:1788361399.950538:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361399.950577:0:31268:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a9efde000, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1788361399.950609:0:31268:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xa2:0x0] updating lvb size from disk: 0 -> 14 00010000:00010000:1.0:1788361399.950633:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d6613fd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f084 expref: 4 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361399.950669:0:31268:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a9efde000, canceled 1 locks, left on hash table 0. 00000100:00100000:3.0:1788361399.950673:0:31912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3538730-0385-4711-b11c-bb6af99a7674+3:2348:x1875232130645632:12345-192.168.203.60@tcp:9:umount.0 Request processed in 332us (486us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361399.950683:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361399.950684:0:31912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00010000:00010000:1.0:1788361399.950687:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361399.950690:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361399.957285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361399.957376:0:31279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130646272 00000100:00100000:2.0:1788361399.957386:0:31279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130646272 00000100:00100000:2.0:1788361399.957448:0:31279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:2.0:1788361399.957461:0:31279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+11:2348:x1875232130646272:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:2.0:1788361399.957496:0:31279:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613c24 00000020:00010000:2.0:1788361399.957505:0:31279:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8abc487000: total 0 00000100:00080000:2.0:1788361399.957510:0:31279:0:(import.c:65:import_set_state_nolock()) ffff9a8a8377b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788361399.957585:0:31279:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803889 00000100:00100000:2.0:1788361399.958065:0:31279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3538730-0385-4711-b11c-bb6af99a7674+10:2348:x1875232130646272:12345-192.168.203.60@tcp:39:umount.0 Request processed in 607us (787us total) trans 25769803890 rc 0/0 00000100:00100000:2.0:1788361399.958074:0:31279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00000020:00010000:3.0:1788361399.958195:0:33055:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8abc487000: total 0 00010000:00010000:3.0:1788361399.958247:0:33055:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8abc487000, canceled 0 locks, left on hash table 5. 00010000:00010000:3.0:1788361399.958337:0:33055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361399.958342:0:33055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788361399.958351:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfe00/0xf6a94c97d6613fc0 lrc: 0/0,0 mode: --/CW res: [0x200002b11:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f07d expref: 9 pid: 31281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.958495:0:33055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x2:0x0].0x0 (ffff9a8a983f4100) 00010000:00010000:3.0:1788361399.958500:0:33055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361399.958505:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce400/0xf6a94c97d6613e5b lrc: 0/0,0 mode: --/CR res: [0x200002b11:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f00d expref: 8 pid: 31279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.958528:0:33055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x1:0x0].0x0 (ffff9a8ac20d4d00) 00010000:00010000:3.0:1788361399.958531:0:33055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788361399.958535:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef200/0xf6a94c97d6613e1c lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eff8 expref: 7 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.958551:0:33055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200002b11:0x6:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361399.958554:0:33055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788361399.958558:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf200/0xf6a94c97d6614030 lrc: 0/0,0 mode: --/PR res: [0x200002b11:0x6:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f099 expref: 6 pid: 32594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.958572:0:33055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8ac20d4f00) 00010000:00010000:3.0:1788361399.958574:0:33055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361399.958577:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614014 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f092 expref: 5 pid: 31280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.958589:0:33055:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8abc487000, canceled 5 locks, left on hash table 0. 00010000:00010000:3.0:1788361399.958600:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361399.958602:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361399.958615:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361399.967701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361399.967867:0:31272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130646528 00000100:00100000:3.0:1788361399.967878:0:31272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130646528 00000100:00100000:3.0:1788361399.967973:0:31272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:3.0:1788361399.967983:0:31272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+7:2348:x1875232130646528:12345-192.168.203.60@tcp:251:umount.0 00000020:00000080:3.0:1788361399.968027:0:31272:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613ae2 00000020:00010000:3.0:1788361399.968034:0:31272:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a89852f3800: total 0 00000100:00080000:3.0:1788361399.968038:0:31272:0:(import.c:65:import_set_state_nolock()) ffff9a89852f2000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788361399.968133:0:31272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:76414060-9cd0-4e10-991c-7eaed84bf288+3:2348:x1875232130646528:12345-192.168.203.60@tcp:251:umount.0 Request processed in 152us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361399.968140:0:31272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000020:00010000:0.0:1788361399.968212:0:31267:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a89852f3800: total 0 00010000:00010000:0.0:1788361399.968257:0:31267:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a89852f3800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788361399.968289:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987623400/0xf6a94c97d6613ae9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86eea8 expref: 2 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361399.968319:0:31267:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a89852f3800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788361399.968331:0:31267:0:(genops.c:906:class_export_put()) final put ffff9a89852f3800/76414060-9cd0-4e10-991c-7eaed84bf288 00010000:00010000:0.0:1788361399.968395:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361399.968398:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361399.968401:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788361399.970411:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89852f3800/76414060-9cd0-4e10-991c-7eaed84bf288 for MGS 00000020:00000080:2.0:1788361399.970449:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89852f2000 for MGS 00000001:00100000:3.0:1788361399.997373:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7b6b2b85-840a-4c64-a4e4-54d135f64238 00000001:00080000:3.0:1788361399.997389:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803888 is committed 00000001:00080000:3.0:1788361399.997397:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803889 is committed 00000004:00080000:3.0:1788361399.997404:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788361399.997426:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 21474836520 batchid updated 00000001:00100000:3.0:1788361399.997438:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a3538730-0385-4711-b11c-bb6af99a7674 00000001:00080000:3.0:1788361399.997443:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 25769803890 is committed 00000020:00000080:3.0:1788361399.997446:0:5819:0:(genops.c:906:class_export_put()) final put ffff9a8abc487000/a3538730-0385-4711-b11c-bb6af99a7674 00000020:00000080:3.0:1788361399.997463:0:5819:0:(genops.c:906:class_export_put()) final put ffff9a89852f7000/7b6b2b85-840a-4c64-a4e4-54d135f64238 00000020:00080000:1.0:1788361399.997486:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000020:00080000:1.0:1788361399.997503:0:31316:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000020:00000080:0.0:1788361399.997584:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abc487000/a3538730-0385-4711-b11c-bb6af99a7674 for lustre-MDT0000 00000100:00100000:3.0:1788361399.997795:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144185984:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788361399.997862:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361399.997933:0:31913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144185984 00000100:00100000:3.0:1788361399.997941:0:31913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144185984 00000100:00100000:3.0:1788361399.997997:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788361399.998007:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144185984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788361399.998035:0:31913:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:163 count 1 00002000:00010000:3.0:1788361399.998068:0:31913:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa3:0x0] initial LVB size: 1024, mtime: 0x6a983aad, atime: 0x6a983aad, ctime: 0x6a983aad, blocks: 0xb 00010000:00010000:3.0:1788361399.998111:0:31913:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7cde27/0xf6a94c97d6614412 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.998126:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=790s v=(0 0) 00010000:00010000:3.0:1788361399.998131:0:31913:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361399.998137:0:31913:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c7cde27/0xf6a94c97d6614412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.998153:0:31913:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c7cde27/0xf6a94c97d6614412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.998163:0:31913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c7cde27/0xf6a94c97d6614412 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.998171:0:31913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c7cde27/0xf6a94c97d6614412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.998190:0:31913:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00000080:0.0:1788361399.998221:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89852f7000/7b6b2b85-840a-4c64-a4e4-54d135f64238 for lustre-MDT0000 00000020:00000080:0.0:1788361399.998271:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8377b800 for lustre-MDT0000 00000020:00000080:0.0:1788361399.998277:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89852f6800 for lustre-MDT0000 00000100:00080000:0.0:1788361399.998286:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361399.999003:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144185984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 996us (1140us total) trans 25769803793 rc 0/0 00000100:00100000:3.0:1788361399.999013:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1788361399.999034:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8abc896d80/2, rc 0, transno 25769803793 00010000:00010000:3.0:1788361399.999040:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788361399.999042:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144185984:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788361399.999048:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c7cde27/0xf6a94c97d6614412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.999058:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361399.999062:0:31268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c7cde27/0xf6a94c97d6614412 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.999077:0:31268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c7cde27/0xf6a94c97d6614412 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.999115:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c7cde27/0xf6a94c97d6614412 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.999124:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c7cde27/0xf6a94c97d6614412 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 31913 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361399.999144:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361399.999146:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361399.999149:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788361400.000006:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a3538730-0385-4711-b11c-bb6af99a7674 00000020:00000080:2.0:1788361400.000011:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8a9efde000/a3538730-0385-4711-b11c-bb6af99a7674 00000001:00100000:2.0:1788361400.000048:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7b6b2b85-840a-4c64-a4e4-54d135f64238 00000020:00000080:2.0:1788361400.000050:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8987bd0800/7b6b2b85-840a-4c64-a4e4-54d135f64238 00000020:00000080:0.0:1788361400.000068:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efde000/a3538730-0385-4711-b11c-bb6af99a7674 for lustre-OST0000 00000020:00000080:0.0:1788361400.000129:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a9efda000 for lustre-OST0000 00000020:00000080:1.0:1788361400.000255:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8987bd0800/7b6b2b85-840a-4c64-a4e4-54d135f64238 for lustre-OST0000 00000020:00000080:1.0:1788361400.000300:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8987bd0000 for lustre-OST0000 00010000:00010000:2.0:1788361400.416978:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361400.480479:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144186112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361400.480563:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361400.480632:0:31917:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144186112 00000100:00100000:2.0:1788361400.480648:0:31917:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144186112 00000100:00100000:2.0:1788361400.480699:0:31917:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361400.480708:0:31917:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144186112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361400.480742:0:31917:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361400.480784:0:31917:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144186112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361400.480790:0:31917:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788361400.482204:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144186112:0@lo:13:osp-pre-0-0.0 00000020:01000004:3.0:1788361401.060247:0:33994:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788361401.070542:0:33994:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788361401.070589:0:33994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361401.070604:0:33994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361401.070611:0:33994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361401.070619:0:33994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361401.070650:0:33994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361401.070684:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361401.070693:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361401.070702:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:0.0:1788361401.070706:0:31267:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361401.070719:0:33994:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788361401.070719:0:31267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788361401.070737:0:31267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361401.070742:0:31267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788361401.070745:0:31267:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788361401.070747:0:31267:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788361401.070781:0:31267:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361401.070789:0:31267:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788361401.070834:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361401.070840:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9000/0xf6a94c97d66138c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d66138c7 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361401.070851:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361401.070853:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361401.070856:0:33994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788361401.070856:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361401.070863:0:33994:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788361401.070868:0:33994:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788361401.070883:0:33994:0:(import.c:65:import_set_state_nolock()) ffff9a8a8377d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788361401.070897:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361401.070917:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144186240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361401.070980:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361401.071044:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144186240 00000100:00100000:3.0:1788361401.071052:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144186240 00000100:00100000:3.0:1788361401.071123:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361401.071132:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25ae0af-c16d-4164-9502-26eb1af82516+19:3311:x1875232144186240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361401.071145:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361401.071171:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841b8800/0xf6a94c97d66138c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d66138c0 expref: 19 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361401.071186:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144186368:0@lo:39:umount.0 00010000:00010000:3.0:1788361401.071192:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361401.071227:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361401.071255:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25ae0af-c16d-4164-9502-26eb1af82516+18:3311:x1875232144186240:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361401.071272:0:31281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144186368 00000100:00100000:0.0:1788361401.071278:0:31281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144186368 00000100:00100000:0.0:1788361401.071765:0:31281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788361401.071777:0:31281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232144186368:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788361401.071799:0:31281:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66138f1 00000100:00080000:0.0:1788361401.071806:0:31281:0:(import.c:65:import_set_state_nolock()) ffff9a8a85da9000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788361401.071870:0:31281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1875232144186368:12345-0@lo:39:umount.0 Request processed in 96us (643us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361401.071976:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361401.072019:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8377d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788361401.072030:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144186368:0@lo:39:umount.0 00000100:00100000:2.0:1788361401.072119:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144186240:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788361401.072151:0:33994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361401.072154:0:33994:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788361401.072158:0:33994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788361401.073201:0:33994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073215:0:33994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073222:0:33994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073229:0:33994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073270:0:33994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361401.073276:0:33994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073283:0:33994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073290:0:33994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073297:0:33994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073311:0:33994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788361401.073318:0:33994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073325:0:33994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073332:0:33994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073338:0:33994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073348:0:33994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788361401.073353:0:33994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073368:0:33994:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073374:0:33994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073380:0:33994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361401.073388:0:33994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1788361401.073391:0:33994:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788361401.073413:0:33994:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788361401.073417:0:33994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788361401.073422:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361401.073427:0:33994:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1788361401.073433:0:33994:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a89852f3000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361401.073439:0:33994:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9a8a83e4b800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361401.073443:0:33994:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9a8a85daa000 lustre-MDT0000-lwp-MDT0000_UUID 0@lo 1 (1 0 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361401.073448:0:33994:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9a8a84f14d40) has exports, disconnecting them 00000020:00080000:2.0:1788361401.073453:0:33994:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a89852f3000), last request at 1788361397 00000020:00000080:2.0:1788361401.073459:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613ac6 00000100:00080000:2.0:1788361401.073476:0:33994:0:(import.c:65:import_set_state_nolock()) ffff9a89852f5000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361401.073511:0:33055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788361401.073520:0:33055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788361401.073524:0:33994:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a89852f3000): rc 0 00000020:00000080:2.0:1788361401.073529:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a89852f3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788361401.073540:0:33994:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9a8a83e4b800), last request at 1788361397 00010000:00010000:1.0:1788361401.073541:0:33055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb600 already unused, calling callback (ffffffffc1ba5c20) 00000020:00000080:2.0:1788361401.073546:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613976 10000000:00010000:1.0:1788361401.073547:0:33055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361401.073553:0:33994:0:(import.c:65:import_set_state_nolock()) ffff9a8a83e4a800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788361401.073558:0:33055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361401.073570:0:33055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788361401.073577:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89852f3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 10000000:01000000:1.0:1788361401.073577:0:33055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361401.073582:0:33055:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1788361401.073586:0:33055:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1788361401.073619:0:33055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073644:0:33055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361401.073666:0:33055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073673:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb600/0xf6a94c97d6613826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661382d expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073686:0:33055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788361401.073689:0:33055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073694:0:33055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361401.073698:0:33055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073705:0:33055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361401.073711:0:33055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788361401.073712:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89852f5000 for lustre-MDT0000 10000000:01000000:1.0:1788361401.073721:0:33055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361401.073723:0:33055:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788361401.073725:0:33055:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00080000:2.0:1788361401.073729:0:33994:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a83e4b800): rc 0 00000020:00000080:2.0:1788361401.073732:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8a83e4b800/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:1.0:1788361401.073741:0:33055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:2.0:1788361401.073742:0:33994:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa998c2bbfae0 00010000:00010000:1.0:1788361401.073752:0:33055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:2.0:1788361401.073755:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e4b800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1788361401.073760:0:33055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073779:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6613ad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613adb expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788361401.073782:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a83e4a800 for lustre-MDT0000 00010000:00010000:1.0:1788361401.073796:0:33055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361401.073799:0:33055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361401.073805:0:33994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:1.0:1788361401.073805:0:33055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1ba5c20) 00000100:00100000:2.0:1788361401.073810:0:33994:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803792 gen 3 00000100:00100000:2.0:1788361401.073820:0:33994:0:(client.c:3153:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9a8abc896d80 x1875232144185984/t25769803793(25769803793) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788361415 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 10000000:00010000:1.0:1788361401.073824:0:33055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361401.073838:0:33994:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8abc896d80, transno 25769803793 00010000:00010000:1.0:1788361401.073840:0:33055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361401.073849:0:33055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361401.073854:0:33055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788361401.073856:0:33055:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00000004:00080000:2.0:1788361401.073858:0:33994:0:(osp_dev.c:1634:osp_import_event()) got inactive 10000000:01000000:1.0:1788361401.073859:0:33055:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788361401.073876:0:33055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073882:0:33055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361401.073899:0:33055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073906:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841b9400/0xf6a94c97d6613dc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613dc8 expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073927:0:33055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361401.073930:0:33055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073936:0:33055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361401.073939:0:33055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.073946:0:33055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361401.073952:0:33994:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 10000000:00010000:1.0:1788361401.073953:0:33055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361401.073961:0:33055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361401.073963:0:33055:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788361401.073965:0:33055:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:2.0:1788361401.073966:0:33994:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788361401.073981:0:33994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00010000:00010000:1.0:1788361401.073981:0:33055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361401.073985:0:33994:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803783 gen 3 00010000:00010000:1.0:1788361401.073992:0:33055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:2.0:1788361401.073997:0:33994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1788361401.074000:0:33055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.074008:0:33055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcb800/0xf6a94c97d6613818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d661381f expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.074019:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361401.074022:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361401.074029:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361401.074045:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144186752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361401.074061:0:31281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1788361401.074071:0:33994:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:00000080:0.0:1788361401.074074:0:31281:0:(genops.c:906:class_export_put()) final put ffff9a8a85daa000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1788361401.074105:0:33994:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788361401.074130:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361401.074141:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25ae0af-c16d-4164-9502-26eb1af82516:3314:1875232144186624:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788361401.074145:0:33994:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a8a84f14d40) has no exports 00000100:00100000:1.0:1788361401.074175:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361401.074186:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25ae0af-c16d-4164-9502-26eb1af82516:3313:1875232144186496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361401.074186:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144187008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361401.074191:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361401.074235:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361401.074242:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361401.074263:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144186752 00000100:00100000:0.0:1788361401.074271:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144186752 00000020:00000080:2.0:1788361401.074281:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a85daa000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788361401.074313:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a85da9000 for lustre-MDT0000 00000100:00100000:1.0:1788361401.074348:0:33904:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144186624 00000100:00100000:1.0:1788361401.074353:0:33904:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144186624 00000100:00100000:3.0:1788361401.074533:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361401.074551:0:31264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144187008 00000100:00100000:3.0:1788361401.074555:0:31264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144187008 00000100:00100000:0.0:1788361401.074600:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144186496 00000100:00100000:0.0:1788361401.074604:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144186496 00000100:00100000:1.0:1788361401.074610:0:33904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361401.074622:0:33904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a25ae0af-c16d-4164-9502-26eb1af82516+21:3311:x1875232144186752:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361401.074626:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788361401.074647:0:33904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361401.074663:0:33904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987622400/0xf6a94c97d6613dc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613dc1 expref: 21 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.074674:0:33904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361401.074708:0:33904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a25ae0af-c16d-4164-9502-26eb1af82516+20:3311:x1875232144186752:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361401.074715:0:33904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361401.074722:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a25ae0af-c16d-4164-9502-26eb1af82516+20:3314:x1875232144186624:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361401.074732:0:33904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1788361401.074733:0:31265:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788361401.074743:0:33904:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a25ae0af-c16d-4164-9502-26eb1af82516+19:3313:x1875232144186496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361401.074747:0:31265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965c00/0xf6a94c97d6613adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613ad4 expref: 19 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.074754:0:33904:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361401.074762:0:31265:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361401.074767:0:33904:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987623000/0xf6a94c97d661382d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613826 expref: 18 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.074778:0:33904:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361401.074861:0:33904:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a25ae0af-c16d-4164-9502-26eb1af82516+17:3313:x1875232144186496:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361401.074869:0:33904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361401.074872:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a25ae0af-c16d-4164-9502-26eb1af82516+17:3314:x1875232144186624:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361401.074884:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361401.074922:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a25ae0af-c16d-4164-9502-26eb1af82516:3313:1875232144186496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361401.074923:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25ae0af-c16d-4164-9502-26eb1af82516:3314:1875232144186624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361401.074951:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361401.074962:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144186880:0@lo:9:umount.0 00000100:00100000:1.0:1788361401.074995:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361401.075022:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144187136:0@lo:9:umount.0 00000100:00100000:0.0:1788361401.075027:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144186880 00000100:00100000:0.0:1788361401.075033:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144186880 00000100:00100000:1.0:1788361401.075045:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361401.075077:0:32018:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144187136 00000100:00100000:0.0:1788361401.075081:0:32018:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144187136 00000100:00100000:1.0:1788361401.075118:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144186752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361401.075137:0:32018:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361401.075146:0:32018:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144186880:12345-0@lo:9:umount.0 00000100:00100000:1.0:1788361401.075170:0:31913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000020:00000080:0.0:1788361401.075177:0:32018:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613984 00000100:00100000:1.0:1788361401.075182:0:31913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875232144187136:12345-0@lo:9:umount.0 00000100:00080000:0.0:1788361401.075186:0:32018:0:(import.c:65:import_set_state_nolock()) ffff9a8abf244800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788361401.075198:0:31913:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613b05 00000100:00080000:1.0:1788361401.075206:0:31913:0:(import.c:65:import_set_state_nolock()) ffff9a8a8986a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361401.075242:0:32018:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 6, last_transno is 25769803793 00000001:00000004:1.0:1788361401.075250:0:31913:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 6, last_transno is 25769803784 00000100:00100000:1.0:1788361401.075445:0:31913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3310:x1875232144187136:12345-0@lo:9:umount.0 Request processed in 266us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361401.075452:0:31913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788361401.075472:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361401.075472:0:32018:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+3:3310:x1875232144186880:12345-0@lo:9:umount.0 Request processed in 326us (475us total) trans 0 rc 0/0 00000100:00080000:1.0:1788361401.075477:0:31275:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361401.075484:0:32018:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1788361401.075485:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361401.075508:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361401.075509:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a89249000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788361401.078181:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:2.0:1788361401.078364:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361401.078396:0:31264:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1788361401.078405:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361401.078415:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144186880:0@lo:9:umount.0 00000100:00100000:3.0:1788361401.078421:0:31264:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9eab8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25ae0af-c16d-4164-9502-26eb1af82516+15:3311:x1875232144187008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788361401.078443:0:31264:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:1.0:1788361401.078454:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a89879b4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:3.0:1788361401.078463:0:31264:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987622a00/0xf6a94c97d661381f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613818 expref: 15 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361401.078475:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788361401.078478:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788361401.078482:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144187136:0@lo:9:umount.0 00010000:00010000:3.0:1788361401.078485:0:31264:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361401.078556:0:31264:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9eab8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a25ae0af-c16d-4164-9502-26eb1af82516+14:3311:x1875232144187008:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (4321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361401.078580:0:31264:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361401.078645:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a25ae0af-c16d-4164-9502-26eb1af82516:3311:1875232144187008:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788361401.086352:0:33994:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9a8a84f14d40) has no exports 00000020:00000080:0.0:1788361401.122847:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613873 00000020:00000080:0.0:1788361401.122863:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6a800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788361401.122923:0:33994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788361401.122991:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361401.123001:0:33994:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361401.123005:0:33994:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9a8985c64d40) has no exports 00000020:00000080:1.0:1788361401.123324:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661386c 00000020:00000080:1.0:1788361401.123328:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8a84a41000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788361401.123385:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788361401.123450:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84a41000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361401.123523:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361401.123529:0:33994:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788361401.123532:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8987188000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788361401.123534:0:33994:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8987188000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788361401.123541:0:33994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1788361401.123657:0:33994:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8ab732bf00 - data ffff9a8abda8b5e8/ffff9a89867d0000 00000020:01000000:1.0:1788361401.123791:0:33994:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a829cf1e0 - data ffff9a8ab538e948/ffff9a8a85a59400 00000001:00000004:2.0:1788361401.138187:0:33994:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 6, last_transno is 25769803890 00000100:00080000:3.0:1788361401.189872:0:33994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788361401.189880:0:33994:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803792 gen 4 00000004:00080000:3.0:1788361401.190179:0:33994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361401.190183:0:33994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788361401.190606:0:31301:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788361401.190610:0:31301:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x22:0x0] index 4 count 2 00000040:00080000:0.0:1788361401.190618:0:31301:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 6 count 2 00000100:00080000:3.0:1788361401.190848:0:33994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788361401.190852:0:33994:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803783 gen 4 00000004:00080000:3.0:1788361401.190868:0:33994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361401.190869:0:33994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788361401.191190:0:31303:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788361401.191194:0:31303:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x24:0x0] index 3 count 1 00000040:00080000:1.0:1788361401.191202:0:31303:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 6 count 2 00000020:00000080:3.0:1788361401.243156:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661383b 00000020:00000080:3.0:1788361401.243169:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6f800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361401.243259:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361401.244032:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613850 00000020:00000080:3.0:1788361401.244038:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a898718d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788361401.244051:0:33994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788361401.244056:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361401.244065:0:33994:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361401.244069:0:33994:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9a8a84f13380) has no exports 00000020:00000080:0.0:1788361401.244078:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a898718d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788361401.244755:0:33994:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788361401.244764:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661389d 00000020:00000080:3.0:1788361401.244768:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8a8377f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788361401.244782:0:33994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788361401.244787:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361401.244796:0:33994:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788361401.244798:0:33994:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9a8984a5b380) has no exports 00000020:00000080:3.0:1788361401.244804:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613896 00000020:00000080:3.0:1788361401.244808:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a89879b1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361401.245027:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8377f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788361401.245037:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89879b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788361401.246950:0:33994:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788361401.246958:0:33994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788361401.246965:0:33994:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 25769803783 gen 5 00000004:00080000:3.0:1788361401.247271:0:33994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361401.247274:0:33994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361401.247338:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361401.247347:0:33994:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361401.247354:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613888 00000020:00000080:3.0:1788361401.247362:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a898534b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788361401.247367:0:33994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788361401.247371:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361401.247374:0:33994:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788361401.247377:0:33994:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9a8984a58000) has no exports 00000020:00000080:3.0:1788361401.247382:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613881 00000020:00000080:3.0:1788361401.247385:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8a89248000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361401.247606:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a89879b4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788361401.247612:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a898534d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361401.247615:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a898534d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788361401.247620:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361401.247693:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a898534b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788361401.247701:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a89248000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788361401.247967:0:33994:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788361401.247970:0:33994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788361401.247973:0:33994:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 25769803792 gen 5 00000004:00080000:3.0:1788361401.247977:0:33994:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788361401.247978:0:33994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361401.248008:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361401.248012:0:33994:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361401.248042:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361401.248045:0:33994:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361401.248048:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361401.248050:0:33994:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788361401.248054:0:33994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788361401.248157:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a89249000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788361401.248162:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a89879b6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361401.248164:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a89879b6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788361401.248167:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788361401.248444:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613857 00000020:00000080:3.0:1788361401.248449:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8987189000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788361401.248481:0:33994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788361401.248485:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361401.248489:0:33994:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788361401.248491:0:33994:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9a8a84f10000) has no exports 00000020:00000080:3.0:1788361401.248508:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361401.248511:0:33994:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788361401.248514:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661385e 00000020:00000080:3.0:1788361401.248517:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a898718c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788361401.248543:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8987189000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788361401.248547:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6b800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788361401.248555:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788361401.248559:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1788361401.248704:0:33994:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8986533800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788361401.248708:0:33994:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8986533800 3 00000020:01000004:3.0:1788361401.248716:0:33994:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8986533800 from lustre-MDT0000 00000020:00000080:3.0:1788361401.248763:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361401.248766:0:33994:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788361401.248769:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c6b000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788361401.248771:0:33994:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c6b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788361401.248776:0:33994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788361401.248801:0:33994:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788361401.248805:0:33994:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788361401.248807:0:33994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788361401.248809:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361401.248830:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a898718c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788361401.248850:0:33994:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788361401.248856:0:33994:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9a8a98052800 a25ae0af-c16d-4164-9502-26eb1af82516 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788361401.248861:0:33994:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9a8a84f119c0) has exports, disconnecting them 00000020:00080000:3.0:1788361401.248864:0:33994:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9a8a98052800), last request at 1788361349 00000020:00000080:3.0:1788361401.248878:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613803 00000020:00010000:3.0:1788361401.248881:0:33994:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9a8a98052800: total 0 00000100:00080000:3.0:1788361401.248885:0:33994:0:(import.c:65:import_set_state_nolock()) ffff9a8a867a5000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788361401.248924:0:33994:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a98052800): rc 0 00000020:00080000:3.0:1788361401.248928:0:33994:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9a8a84f119c0) has no exports 00000100:00100000:3.0:1788361401.249023:0:31272:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9a8a8af08400:31272] 1 exiting: rc = 0 00000100:00100000:0.0:1788361401.249152:0:31271:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9a898586c600:31271] 0 exiting: rc = 1 00000020:00010000:1.0:1788361401.249213:0:31268:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9a8a98052800: total 0 00010000:00010000:1.0:1788361401.249217:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361401.249242:0:31268:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9a8a98052800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788361401.249266:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987623800/0xf6a94c97d6613929 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613922 expref: 9 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.249284:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987622200/0xf6a94c97d6613a87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613a80 expref: 8 pid: 31274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.249295:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6613937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613930 expref: 7 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.249305:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8573e600/0xf6a94c97d6613811 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661380a expref: 6 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.249315:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987623200/0xf6a94c97d6613dac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613da5 expref: 5 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.249335:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987622800/0xf6a94c97d6613961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d661395a expref: 4 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.249344:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965000/0xf6a94c97d6613dba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613db3 expref: 3 pid: 31271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.249355:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8987623c00/0xf6a94c97d6613ab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf6a94c97d6613aaa expref: 2 pid: 31272 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361401.249364:0:31268:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9a8a98052800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788361401.249375:0:31268:0:(genops.c:906:class_export_put()) final put ffff9a8a98052800/a25ae0af-c16d-4164-9502-26eb1af82516 00010000:00010000:1.0:1788361401.249413:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361401.249415:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361401.249417:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361401.249443:0:31274:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9a8a8af09000:31274] 2 exiting: rc = 0 00000100:00100000:3.0:1788361401.249537:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249545:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249551:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249556:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249569:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249575:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249581:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249587:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249593:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249599:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249626:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249640:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249645:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249653:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249658:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249662:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249685:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249691:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249696:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249700:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249705:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249710:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249715:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249719:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249725:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249730:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249735:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249739:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249744:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249748:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249753:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249757:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249761:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249766:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249774:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249779:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249784:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249790:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249794:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249799:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249804:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249809:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249814:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249818:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249823:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249833:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249839:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249844:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249849:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249853:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249858:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249862:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249867:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249872:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249876:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249882:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249887:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249891:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249896:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249900:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249905:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249909:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249914:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.249919:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788361401.250268:0:33994:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788361401.250272:0:33994:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:0.0:1788361401.250879:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a98052800/a25ae0af-c16d-4164-9502-26eb1af82516 for MGS 00000020:00000080:0.0:1788361401.251053:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a867a5000 for MGS 00000020:01000000:3.0:1788361401.251333:0:33994:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a88360f00 - data ffff9a8abda8b0d8/ffff9a89879ebc00 00000020:01000000:3.0:1788361401.251477:0:33994:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8987a83840 - data ffff9a8abda51870/ffff9a8ab7527000 00000020:00000080:3.0:1788361401.252000:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66137e7 00000020:00000080:3.0:1788361401.252007:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8a84691000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788361401.252073:0:33994:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8986533800 from MGS, refs=2 00000020:01000004:3.0:1788361401.252077:0:33994:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8986533800 2 00000020:01000004:3.0:1788361401.252080:0:33994:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8986533800 from MGS 00000020:00000080:3.0:1788361401.252155:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788361401.252162:0:33994:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788361401.252164:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8a84694000/MGS 00000020:00000080:3.0:1788361401.252166:0:33994:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84694000/MGS for MGS 00000020:01000000:3.0:1788361401.252171:0:33994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788361401.252218:0:33994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788361401.252227:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361401.252231:0:33994:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788361401.252238:0:33994:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9a8a83779000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788361401.252243:0:33994:0:(genops.c:1574:class_disconnect_exports()) OBD device 10 (ffff9a8985c60000) has exports, disconnecting them 00000020:00080000:3.0:1788361401.252247:0:33994:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9a8a83779000), last request at 1788361349 00000020:00000080:3.0:1788361401.252250:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66138d5 00000020:00080000:3.0:1788361401.252259:0:33994:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a83779000): rc 0 00000020:00000080:3.0:1788361401.252262:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8a83779000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788361401.252301:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84691000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788361401.252979:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83779000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788361401.257133:0:33994:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788361401.257141:0:33994:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788361401.257145:0:33994:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788361401.257151:0:33994:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788361401.257273:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361401.257282:0:33994:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788361401.257288:0:33994:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8986533800 1 00000020:00000080:1.0:1788361401.257294:0:33994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66137d9 00000020:00000080:1.0:1788361401.257301:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8a84696800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788361401.257306:0:33994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788361401.257311:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361401.257315:0:33994:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361401.257318:0:33994:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9a8ab7460000) has no exports 00000020:00000080:0.0:1788361401.260107:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8377d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788361401.260119:0:15670:0:(genops.c:906:class_export_put()) final put ffff9a8ac1c69000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788361401.260122:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac1c69000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788361401.260129:0:15670:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788361401.260188:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a84696800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788361401.266059:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361401.266080:0:33994:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788361401.266131:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8986535000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788361401.266136:0:33994:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8986535000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788361401.266143:0:33994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788361401.266245:0:33994:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8986532000 00000020:01000000:1.0:1788361401.266264:0:33994:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788361401.266267:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361401.266272:0:33994:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788361401.266276:0:33994:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9a8a90bf4d40) has no exports 00000100:00100000:2.0:1788361401.266397:0:31279:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9a8ab7776400:31279] 0 exiting: rc = 1 00000100:00100000:0.0:1788361401.266410:0:31280:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9a8985352400:31280] 1 exiting: rc = 0 00000100:00100000:1.0:1788361401.266479:0:32594:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9a8a856a0200:32594] 3 exiting: rc = 0 00000100:00100000:1.0:1788361401.266996:0:31281:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9a8985352800:31281] 2 exiting: rc = 0 00000100:00100000:1.0:1788361401.267053:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267063:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267069:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267075:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267079:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267132:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267139:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267144:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267149:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267153:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267158:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267163:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267168:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267173:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267178:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267183:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267187:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267192:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267197:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267202:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267207:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267212:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267216:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267229:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267236:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267241:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267245:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267249:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267254:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267259:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267264:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267270:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267275:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267280:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267284:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267289:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267294:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267299:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267304:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267309:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267314:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267318:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267323:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267328:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267332:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267337:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267342:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267347:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267352:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267358:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267362:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267368:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267372:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267377:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267383:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267387:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267394:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267398:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267408:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267413:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267419:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267424:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267431:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.267436:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361401.271621:0:31282:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9a8985353c00:31282] 0 exiting: rc = 1 00000100:00100000:1.0:1788361401.271801:0:31283:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9a8985353e00:31283] 1 exiting: rc = 0 00000100:00100000:0.0:1788361401.271995:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272002:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272008:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272013:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272019:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272025:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272030:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272034:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272039:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272043:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272048:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272052:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272057:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272061:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272066:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272070:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.272074:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276365:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276371:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276376:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276380:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276384:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276390:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276394:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276399:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276403:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276408:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276412:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276416:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276421:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276425:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276429:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276434:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276439:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276444:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276448:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276453:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276457:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276462:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276467:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276471:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276476:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276481:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276486:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276491:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276496:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276505:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276511:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276516:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276521:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276526:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276531:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276638:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276644:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276649:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276655:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276660:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276666:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276671:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276676:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276681:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276685:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276689:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.276692:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361401.277227:0:31285:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9a8a87b7e800:31285] 1 exiting: rc = 0 00000100:00100000:1.0:1788361401.277227:0:31284:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9a8a87b7f200:31284] 0 exiting: rc = 1 00000100:00100000:3.0:1788361401.277363:0:33511:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9a8985ec2200:33511] 2 exiting: rc = 0 00000100:00100000:0.0:1788361401.277437:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277457:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277463:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277469:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277474:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277480:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277485:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277491:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277497:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277503:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277508:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277513:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277519:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277536:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277542:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277547:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277552:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277557:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277572:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277577:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277583:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277588:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277593:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277605:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277610:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277627:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277643:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277648:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277654:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277659:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277664:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277669:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277675:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277680:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277685:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277694:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277703:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277720:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277726:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277731:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277743:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277749:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277754:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277761:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277768:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277773:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277778:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277783:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277789:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277805:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277811:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277817:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277822:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277833:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277838:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277844:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277849:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277853:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277862:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277866:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277870:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277873:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277877:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.277885:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361401.285466:0:31286:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9a8a87b7ee00:31286] 0 exiting: rc = 1 00000100:00100000:1.0:1788361401.285790:0:31287:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9a8a87b7fc00:31287] 1 exiting: rc = 0 00000100:00100000:0.0:1788361401.285896:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285901:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285906:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285912:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285917:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285922:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285927:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285931:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285937:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285942:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285947:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285952:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285957:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285962:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285968:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285973:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285978:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285983:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285987:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285992:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.285998:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286003:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286008:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286014:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286018:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286022:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286027:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286032:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286037:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286055:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286059:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286065:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286069:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286074:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286079:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286166:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286175:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286181:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286186:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286191:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286196:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286201:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286206:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286211:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286216:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286221:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286226:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286231:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286236:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286241:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286245:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286250:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286254:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286257:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286260:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286263:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286266:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286269:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286272:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286275:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286278:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286281:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286284:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286287:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361401.286626:0:31288:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9a8a87b7f000:31288] 0 exiting: rc = 1 00000100:00100000:3.0:1788361401.286729:0:31289:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9a8a87b7e400:31289] 1 exiting: rc = 0 00000100:00100000:1.0:1788361401.286804:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286810:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286815:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286821:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286827:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286832:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286837:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286842:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286847:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286852:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286857:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286862:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286868:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286872:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286877:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286881:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286886:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286891:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286896:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286901:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286906:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286911:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286917:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286921:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286925:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286929:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286944:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286949:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286953:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286959:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286964:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286969:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286974:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286979:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286984:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286989:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286993:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286996:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.286999:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287003:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287006:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287009:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287012:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287015:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287018:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287021:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287024:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287027:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287030:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287033:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287035:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287038:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287041:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287044:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287046:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287049:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287051:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287054:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287057:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287060:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287063:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287071:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287074:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287077:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361401.287404:0:31291:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9a8987610c00:31291] 1 exiting: rc = 0 00000100:00100000:0.0:1788361401.287423:0:31290:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9a8a87b7ea00:31290] 0 exiting: rc = 1 00000100:00100000:1.0:1788361401.287487:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287492:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287496:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287501:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287506:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287510:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287515:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287519:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287524:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287529:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287534:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287540:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287545:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287550:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287554:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287559:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287564:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287569:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287574:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287579:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287584:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287589:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287594:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287599:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287603:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287608:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287612:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287616:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287621:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287625:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287643:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287649:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287662:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287667:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287676:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287681:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287685:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287690:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287695:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287700:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287705:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287709:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287713:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287718:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287723:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287728:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287732:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287737:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287742:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287746:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287750:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287755:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287760:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287764:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287769:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287774:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287779:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287784:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287789:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287793:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287797:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287800:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287803:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.287806:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.288424:0:31294:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9a8987611a00:31294] 2 exiting: rc = 0 00000100:00100000:2.0:1788361401.288432:0:31292:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9a8987611600:31292] 0 exiting: rc = 1 00000100:00100000:3.0:1788361401.288609:0:31293:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9a8987611400:31293] 1 exiting: rc = 0 00000100:00100000:1.0:1788361401.289344:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289351:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289434:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289441:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289446:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289452:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289457:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289463:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289469:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289475:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289481:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289486:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289491:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289509:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289516:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289523:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289528:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289534:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289539:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289545:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289550:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289556:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289562:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289568:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289573:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289579:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289585:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289591:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289597:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289602:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289608:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289613:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289619:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289625:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289653:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289660:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289666:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289679:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289685:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289690:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289696:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289702:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289707:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289712:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289718:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289723:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289728:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289733:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289739:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289744:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289750:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289755:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289762:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289767:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289773:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289779:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289784:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289789:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289794:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289800:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289806:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289812:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289818:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361401.289825:0:33994:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788361401.295689:0:33994:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361401.295702:0:33994:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788361401.295707:0:33994:0:(genops.c:906:class_export_put()) final put ffff9a8a89248800/MDS_uuid 00000020:00000080:0.0:1788361401.295712:0:33994:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a89248800/MDS_uuid for MDS 00000020:01000000:0.0:1788361401.295721:0:33994:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788361401.295865:0:33994:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788361401.440190:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361402.466816:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361402.529395:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144187392:0@lo:400:kworker.0 00000400:00000100:0.0:1788361402.529445:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144187392 offset 0 length 224: 4 00000100:00100000:0.0:1788361402.529499:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361402.529505:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25ae0af-c16d-4164-9502-26eb1af82516:3314:1875232144187264:0@lo:400:kworker.0 00000400:00000100:0.0:1788361402.529524:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875232144187264 offset 0 length 224: 4 00000100:00100000:1.0:1788361402.529676:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144187520:0@lo:400:kworker.0 00000400:00000100:1.0:1788361402.529703:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144187520 offset 0 length 224: 4 00000001:00100000:0.0:1788361402.574616:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788361402.575347:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a89868000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788361402.575374:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3538730-0385-4711-b11c-bb6af99a7674 00000020:00000080:0.0:1788361402.575376:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a9efdf800/a3538730-0385-4711-b11c-bb6af99a7674 00000001:00100000:0.0:1788361402.575385:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7b6b2b85-840a-4c64-a4e4-54d135f64238 00000020:00000080:0.0:1788361402.575387:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8a9808d800/7b6b2b85-840a-4c64-a4e4-54d135f64238 00000020:00000080:2.0:1788361402.575882:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a89868000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788361402.575931:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9efdf800/a3538730-0385-4711-b11c-bb6af99a7674 for lustre-OST0001 00000020:00000080:2.0:1788361402.575949:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a9808d800/7b6b2b85-840a-4c64-a4e4-54d135f64238 for lustre-OST0001 00000020:00000080:2.0:1788361402.575967:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8986a000 for lustre-OST0001 00000020:00000080:2.0:1788361402.575972:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a9efdc800 for lustre-OST0001 00000020:00000080:2.0:1788361402.575975:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8a11f800 for lustre-OST0001 00000020:01000004:3.0:1788361403.113395:0:34145:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788361403.122051:0:34145:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788361403.122104:0:34145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361403.122171:0:34145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361403.122182:0:34145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361403.122189:0:34145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361403.122210:0:34145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788361403.122214:0:34145:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788361403.122235:0:34145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361403.122244:0:34145:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a835e1180 x1875232144187392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361418 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788361403.122255:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361403.122266:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361403.122275:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1ba5c20) 00000100:00100000:3.0:1788361403.122278:0:34145:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788361403.122284:0:34145:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 10000000:00010000:1.0:1788361403.122289:0:31268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361403.122299:0:31268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361403.122306:0:31268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361403.122307:0:34145:0:(import.c:65:import_set_state_nolock()) ffff9a8ab745c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 10000000:01000000:1.0:1788361403.122316:0:31268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361403.122320:0:31268:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788361403.122322:0:31268:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1788361403.122344:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144187648:0@lo:39:umount.0 00010000:00010000:1.0:1788361403.122349:0:31268:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361403.122356:0:31268:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361403.122375:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361403.122382:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8987623a00/0xf6a94c97d661395a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf6a94c97d6613961 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:3.0:1788361403.122390:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144187648 offset 0 length 224: 4 00010000:00010000:1.0:1788361403.122393:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361403.122396:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361403.122398:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361403.122411:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144187776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361403.122456:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361403.122687:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144187392:0@lo:400:kworker.0 00000100:00100000:3.0:1788361403.122862:0:31265:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144187776 00000100:00100000:3.0:1788361403.122868:0:31265:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144187776 00000100:00100000:3.0:1788361403.122906:0:31265:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361403.122911:0:31265:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3312:x1875232144187776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788361403.122916:0:31265:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788361403 with bad export cookie 17773821619414841347 00000100:00100000:3.0:1788361403.132642:0:31265:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3312:x1875232144187776:12345-0@lo:103:ldlm_bl.0 Request processed in 9720us (10177us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788361403.132657:0:31265:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788361403.132787:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788361403.132793:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9a8a8924e000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788361403.132796:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1788361403.138259:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.160@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788361403.138264:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788361403.138274:0:3312:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a835e2680 x1875232144187264/t0(0) o400->MGC192.168.203.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788361418 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361403.138377:0:3312:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ab7141180 x1875232144187776/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788361419 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788361403.138388:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788361403.138390:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788361403.138391:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788361403.138395:0:3312:0:(import.c:65:import_set_state_nolock()) ffff9a8a8924e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788361403.138399:0:3312:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 739 00000100:00080000:1.0:1788361403.138407:0:3312:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a8a8924e000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361403.138439:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ab7140000 x1875232144187904/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361403.138478:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a25ae0af-c16d-4164-9502-26eb1af82516:3312:1875232144187776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361403.138540:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a25ae0af-c16d-4164-9502-26eb1af82516:3310:1875232144187904:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1788361403.138593:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875232144187904 offset 0 length 520: 4 00000100:00100000:2.0:1788361403.138681:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a25ae0af-c16d-4164-9502-26eb1af82516:3314:1875232144187264:0@lo:400:kworker.0 00010000:00010000:0.0:1788361403.488245:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361404.512323:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788361405.115577:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788361405.115613:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 25769803793 is committed 00000020:00000080:3.0:1788361405.115617:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8abf243000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788361405.115646:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abf243000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788361405.115710:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8abf244800 for lustre-OST0000 00010000:00010000:1.0:1788361405.537711:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361406.561365:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361407.584295:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361407.648697:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) a25ae0af-c16d-4164-9502-26eb1af82516->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361407.648707:0:15670:0:(pinger.c:247:ptlrpc_pinger_process_import()) a25ae0af-c16d-4164-9502-26eb1af82516->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788361407.648814:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144188032:0@lo:400:kworker.0 00000400:00000100:2.0:1788361407.648866:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144188032 offset 0 length 224: 4 00010000:00010000:1.0:1788361408.608518:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361408.672660:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) a25ae0af-c16d-4164-9502-26eb1af82516->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788361408.672670:0:15670:0:(pinger.c:247:ptlrpc_pinger_process_import()) a25ae0af-c16d-4164-9502-26eb1af82516->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788361408.672856:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144188160:0@lo:400:kworker.0 00000400:00000100:1.0:1788361408.672916:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144188160 offset 0 length 224: 4 00010000:00010000:0.0:1788361409.633531:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361410.658288:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361411.680401:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361412.704357:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361413.280209:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361403/real 1788361403] req@ffff9a8ab7140000 x1875232144187904/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788361413 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361413.280244:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8ab7140000 x1875232144187904/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788361413 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361413.280255:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361403/real 1788361403] req@ffff9a8ac0a50700 x1875232144187648/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788361413 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361413.280294:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8ac0a50700 x1875232144187648/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788361413 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361413.280313:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8924e000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361413.280333:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788361413.280337:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a25ae0af-c16d-4164-9502-26eb1af82516:3310:1875232144187904:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1788361413.280344:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8ab745c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788361413.280359:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144187648:0@lo:39:umount.0 00000100:00080000:3.0:1788361413.280499:0:34145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361413.280503:0:34145:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788361413.280508:0:34145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788361413.280968:0:15670:0:(pinger.c:229:ptlrpc_pinger_process_import()) a25ae0af-c16d-4164-9502-26eb1af82516->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788361413.280974:0:15670:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788361413.280977:0:15670:0:(import.c:65:import_set_state_nolock()) ffff9a8a8924e000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361413.280982:0:15670:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 793 00000100:00080000:0.0:1788361413.280995:0:15670:0:(import.c:589:import_select_connection()) MGC192.168.203.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788361413.281001:0:15670:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a8a8924e000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361413.281028:0:15670:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a835e0700 x1875232144188288/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361413.281124:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144188416:0@lo:400:kworker.0 00000400:00000100:2.0:1788361413.281173:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144188416 offset 0 length 224: 4 00000100:00100000:1.0:1788361413.281369:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a25ae0af-c16d-4164-9502-26eb1af82516:3310:1875232144188288:0@lo:250:kworker.0 00000400:00000100:1.0:1788361413.281394:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875232144188288 offset 0 length 520: 4 00010000:00010000:3.0:1788361413.281564:0:34145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361413.281578:0:34145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361413.281586:0:34145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361413.281592:0:34145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361413.281805:0:34145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361413.281814:0:34145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361413.281822:0:34145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361413.281828:0:34145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361413.281835:0:34145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361413.281859:0:34145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788361413.281863:0:34145:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1788361413.281890:0:34145:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1788361413.281894:0:34145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788361413.281899:0:34145:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788361413.281904:0:34145:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788361413.281908:0:34145:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a8ab74619c0) has no exports 00000020:00080000:3.0:1788361413.281931:0:34145:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9a8ab74619c0) has no exports 00010000:00010000:2.0:1788361413.282739:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361413.282749:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361413.282771:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361413.282775:0:31267:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361413.282783:0:31267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361413.282791:0:31267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361413.282796:0:31267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361413.282799:0:31267:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788361413.282801:0:31267:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788361413.282813:0:31267:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a8924e000 00010000:00010000:2.0:1788361413.282817:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361413.282824:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573ec00/0xf6a94c97d6613930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613937 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361413.282837:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361413.282840:0:31267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361413.282846:0:31267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361413.282849:0:31267:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361413.282855:0:31267:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361413.282867:0:31267:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361413.282872:0:31267:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788361413.282874:0:31267:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788361413.282876:0:31267:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788361413.282880:0:31267:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a8924e000 00010000:00010000:2.0:1788361413.282883:0:31267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361413.282889:0:31267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcbe00/0xf6a94c97d6613db3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613dba expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361413.282897:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361413.282899:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361413.282900:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361413.283274:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788361413.284735:0:34145:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8985a11960 - data ffff9a8abdaf8948/ffff9a89868af400 00000020:01000000:3.0:1788361413.284919:0:34145:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a81799b40 - data ffff9a8ab5242948/ffff9a8987530400 00100000:10000000:3.0:1788361413.296590:0:34145:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788361413.327976:0:34145:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613945 00000020:00000080:0.0:1788361413.327987:0:34145:0:(genops.c:906:class_export_put()) final put ffff9a8987bd6000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788361413.327998:0:34145:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8ac05c5800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788361413.328001:0:34145:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8ac05c5800 2 00000020:01000004:0.0:1788361413.328005:0:34145:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8ac05c5800 from lustre-OST0000 00000020:00000080:0.0:1788361413.328025:0:34145:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788361413.328034:0:34145:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788361413.328037:0:34145:0:(genops.c:906:class_export_put()) final put ffff9a8987bd1000/lustre-OST0000_UUID 00000020:00000080:0.0:1788361413.328039:0:34145:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8987bd1000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788361413.328045:0:34145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:3.0:1788361413.328107:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8987bd6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1788361413.328227:0:34145:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788361413.328231:0:34145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788361413.328235:0:34145:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361413.328239:0:34145:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788361413.328245:0:34145:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9a8abf243800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788361413.328250:0:34145:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9a8ab7463380) has exports, disconnecting them 00000020:00080000:0.0:1788361413.328255:0:34145:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9a8abf243800), last request at 1788361358 00000020:00000080:0.0:1788361413.328259:0:34145:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661396f 00000020:00080000:0.0:1788361413.328268:0:34145:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8abf243800): rc 0 00000020:00000080:0.0:1788361413.328273:0:34145:0:(genops.c:906:class_export_put()) final put ffff9a8abf243800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788361413.328354:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abf243800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788361413.330261:0:34145:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788361413.330268:0:34145:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788361413.330271:0:34145:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788361413.330276:0:34145:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788361413.330415:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8ab745c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788361413.330506:0:34145:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361413.330513:0:34145:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788361413.330517:0:34145:0:(genops.c:906:class_export_put()) final put ffff9a8987bd1800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788361413.330519:0:34145:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8987bd1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788361413.330526:0:34145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788361413.330581:0:34145:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8ac05c5800 1 00000020:00000080:2.0:1788361413.330586:0:34145:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613914 00000020:00000080:2.0:1788361413.330590:0:34145:0:(genops.c:906:class_export_put()) final put ffff9a8a83e4f800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788361413.330595:0:34145:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788361413.330606:0:34145:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361413.330609:0:34145:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788361413.330612:0:34145:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9a8a90bf0000) has no exports 00000020:00000080:3.0:1788361413.330735:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e4f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788361413.348069:0:34145:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361413.348114:0:34145:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788361413.348121:0:34145:0:(genops.c:906:class_export_put()) final put ffff9a8ac05c4000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788361413.348126:0:34145:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8ac05c4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788361413.348133:0:34145:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788361413.348282:0:34145:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8ac05c4800 00000020:02000400:2.0:1788361413.348340:0:34145:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788361413.728227:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361414.753333:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361415.029367:0:34299:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788361415.038247:0:34299:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788361415.038319:0:34299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361415.038352:0:34299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361415.038360:0:34299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361415.038367:0:34299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361415.038392:0:34299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788361415.038397:0:34299:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788361415.038418:0:34299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361415.038428:0:34299:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a835e0380 x1875232144187520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361418 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361415.038447:0:34299:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ac0a50a80 x1875232144188032/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361423 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361415.038461:0:34299:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8ac0a51180 x1875232144188160/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361424 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361415.038474:0:34299:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a835e2d80 x1875232144188416/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361429 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361415.038481:0:34299:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788361415.038508:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144188160:0@lo:400:kworker.0 00000100:00080000:0.0:1788361415.038534:0:34299:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788361415.038563:0:34299:0:(import.c:65:import_set_state_nolock()) ffff9a8a856ee000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788361415.038607:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361415.038614:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361415.038622:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcae00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361415.038626:0:31268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361415.038634:0:31268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361415.038642:0:31268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361415.038648:0:31268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361415.038655:0:31268:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788361415.038657:0:31268:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788361415.038669:0:31268:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a8924e000 00010000:00010000:1.0:1788361415.038672:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361415.038679:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a89bcae00/0xf6a94c97d6613aaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613ab1 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361415.038689:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361415.038691:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361415.038692:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361415.038705:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144188544:0@lo:39:umount.0 00000400:00000100:1.0:1788361415.038743:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875232144188544 offset 0 length 224: 4 00000100:00100000:1.0:1788361415.038806:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144188032:0@lo:400:kworker.0 00000100:00100000:1.0:1788361415.038827:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144188416:0@lo:400:kworker.0 00000100:00100000:1.0:1788361415.038834:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144187520:0@lo:400:kworker.0 00010000:00010000:0.0:1788361415.776249:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361416.800305:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361417.825165:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361418.401480:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a25ae0af-c16d-4164-9502-26eb1af82516->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361418.401491:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) a25ae0af-c16d-4164-9502-26eb1af82516->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788361418.848315:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361419.872433:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361420.896267:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361421.920305:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361422.944452:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788361423.520207:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a25ae0af-c16d-4164-9502-26eb1af82516->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788361423.520222:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) a25ae0af-c16d-4164-9502-26eb1af82516->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788361423.968261:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361424.992585:0:33055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361425.248213:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361415/real 1788361415] req@ffff9a8a835e3800 x1875232144188544/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788361425 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361425.248243:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8a835e3800 x1875232144188544/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788361425 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361425.248270:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a856ee000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788361425.248289:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144188544:0@lo:39:umount.0 00000100:00080000:0.0:1788361425.248876:0:34299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788361425.248897:0:34299:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788361425.248902:0:34299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788361425.250180:0:34299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361425.250197:0:34299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361425.250204:0:34299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361425.250211:0:34299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361425.250239:0:34299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361425.250246:0:34299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361425.250254:0:34299:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361425.250260:0:34299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361425.250267:0:34299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361425.250288:0:34299:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788361425.250292:0:34299:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788361425.250311:0:34299:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788361425.250315:0:34299:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788361425.250326:0:34299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788361425.250332:0:34299:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788361425.250336:0:34299:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a8ab7464d40) has no exports 00000020:00080000:0.0:1788361425.250359:0:34299:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9a8ab7464d40) has no exports 00000020:01000000:0.0:1788361425.252157:0:34299:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a84e9f840 - data ffff9a8abda33510/ffff9a8ac1bec800 00000020:01000000:0.0:1788361425.252295:0:34299:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9a8a879c49c0 - data ffff9a8ab539ea20/ffff9a89879ecc00 00010000:00010000:2.0:1788361425.252575:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361425.252584:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361425.252594:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361425.252599:0:31268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361425.252610:0:31268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361425.252618:0:31268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361425.252623:0:31268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788361425.252625:0:31268:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788361425.252628:0:31268:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788361425.252642:0:31268:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a8924e000 00010000:00010000:2.0:1788361425.252646:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361425.252668:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841b8000/0xf6a94c97d6613a80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613a87 expref: -99 pid: 32581 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361425.252678:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361425.252682:0:31268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361425.252687:0:31268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361425.252690:0:31268:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361425.252697:0:31268:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361425.252702:0:31268:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361425.252707:0:31268:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788361425.252709:0:31268:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788361425.252711:0:31268:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788361425.252715:0:31268:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a8924e000 00010000:00010000:2.0:1788361425.252717:0:31268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361425.252723:0:31268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca400/0xf6a94c97d6613da5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613dac expref: -99 pid: 31276 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361425.252733:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361425.252734:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361425.252740:0:31268:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361425.252808:0:31267:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788361425.263140:0:34299:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788361425.283752:0:34299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613a95 00000020:00000080:1.0:1788361425.283762:0:34299:0:(genops.c:906:class_export_put()) final put ffff9a8987bd4800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788361425.283774:0:34299:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a8a10e800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788361425.283777:0:34299:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8a10e800 2 00000020:01000004:1.0:1788361425.283781:0:34299:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9a8a8a10e800 from lustre-OST0001 00000020:00000080:1.0:1788361425.283808:0:34299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361425.283818:0:34299:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788361425.283820:0:34299:0:(genops.c:906:class_export_put()) final put ffff9a8987bd6800/lustre-OST0001_UUID 00000020:00000080:1.0:1788361425.283823:0:34299:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8987bd6800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788361425.283830:0:34299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788361425.283927:0:34299:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a25ae0af-c16d-4164-9502-26eb1af82516->MGS 00010000:00010000:1.0:1788361425.283942:0:34299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e000/0xf6a94c97d6613922 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613929 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361425.283954:0:34299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e000/0xf6a94c97d6613922 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613929 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361425.283961:0:34299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788361425.283963:0:34299:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788361425.283967:0:34299:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788361425.283989:0:34299:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a8924e000 00010000:00010000:1.0:1788361425.283992:0:34299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8573e000/0xf6a94c97d6613922 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613929 expref: -99 pid: 31911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361425.284008:0:34299:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361425.284016:0:34299:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361425.284022:0:34299:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788361425.284025:0:34299:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788361425.284026:0:34299:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788361425.284035:0:34299:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9a8a8924e000 00010000:00010000:1.0:1788361425.284037:0:34299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca200/0xf6a94c97d661380a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf6a94c97d6613811 expref: -99 pid: 31261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361425.284053:0:34299:0:(import.c:65:import_set_state_nolock()) ffff9a8a8924e000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788361425.284057:0:34299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788361425.284059:0:34299:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788361425.284061:0:34299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788361425.284065:0:34299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788361425.284076:0:34299:0:(client.c:3592:ptlrpc_abort_inflight()) @@@ inflight req@ffff9a8a835e0700 x1875232144188288/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788361428 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788361425.284112:0:34299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788361425.284115:0:34299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:1.0:1788361425.284143:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a25ae0af-c16d-4164-9502-26eb1af82516:3310:1875232144188288:0@lo:250:kworker.0 10000000:01000000:1.0:1788361425.284170:0:34299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788361425.284176:0:34299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d66137f5 00000020:00000080:1.0:1788361425.284180:0:34299:0:(genops.c:906:class_export_put()) final put ffff9a8a8924d000/a25ae0af-c16d-4164-9502-26eb1af82516 00000020:01000000:1.0:1788361425.284185:0:34299:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.160@tcp (flags='') 00000020:00000080:1.0:1788361425.284193:0:34299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361425.284198:0:34299:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.160@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788361425.284202:0:34299:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9a8a90bf19c0) has no exports 00000020:00000080:3.0:1788361425.284667:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8987bd4800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788361425.284688:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8924d000/a25ae0af-c16d-4164-9502-26eb1af82516 for MGC192.168.203.160@tcp 10000000:01000000:1.0:1788361425.285171:0:31276:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788361425.285258:0:34299:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.160@tcp: client import never connected 00000100:00080000:2.0:1788361425.285262:0:34299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788361425.285266:0:34299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788361425.285269:0:34299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788361425.285272:0:34299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788361425.285341:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a8924e000 for MGC192.168.203.160@tcp 00000020:00000080:2.0:1788361425.285896:0:34299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361425.285904:0:34299:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.160@tcp (uuid a25ae0af-c16d-4164-9502-26eb1af82516) 00000020:00000080:2.0:1788361425.285909:0:34299:0:(genops.c:906:class_export_put()) final put ffff9a8a8924b000/a25ae0af-c16d-4164-9502-26eb1af82516 00000020:00000080:2.0:1788361425.285912:0:34299:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8924b000/a25ae0af-c16d-4164-9502-26eb1af82516 for MGC192.168.203.160@tcp 00000020:01000000:2.0:1788361425.285924:0:34299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.160@tcp (a25ae0af-c16d-4164-9502-26eb1af82516) 00000020:01000000:2.0:1788361425.286600:0:34299:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788361425.286606:0:34299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361425.286612:0:34299:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788361425.286618:0:34299:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9a8a856ed800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788361425.286624:0:34299:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9a8984a599c0) has exports, disconnecting them 00000020:00080000:2.0:1788361425.286629:0:34299:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9a8a856ed800), last request at 1788361366 00000020:00000080:2.0:1788361425.286633:0:34299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613abf 00000020:00080000:2.0:1788361425.286647:0:34299:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9a8a856ed800): rc 0 00000020:00000080:2.0:1788361425.286653:0:34299:0:(genops.c:906:class_export_put()) final put ffff9a8a856ed800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788361425.287431:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a856ed800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788361425.289186:0:34299:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788361425.289197:0:34299:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788361425.289202:0:34299:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788361425.289209:0:34299:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788361425.289272:0:33055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:1.0:1788361425.289332:0:15670:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8a856ee000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788361425.289589:0:31268:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788361425.289720:0:31267:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788361425.289878:0:31263:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9a8a8781da00:31263] 1 exiting: rc = 0 00000100:00100000:1.0:1788361425.289973:0:31262:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9a8a8781c800:31262] 0 exiting: rc = 1 00000100:00100000:3.0:1788361425.290049:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788361425.290370:0:31265:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9a89866c0000:31265] 1 exiting: rc = 0 00000100:00100000:1.0:1788361425.290442:0:31264:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9a8a8781dc00:31264] 0 exiting: rc = 1 00000100:00100000:3.0:1788361425.291950:0:31266:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9a89866c1a00:31266] 2 exiting: rc = 0 00000100:00100000:3.0:1788361425.293296:0:33904:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9a89851aec00:33904] 3 exiting: rc = 0 00000100:00100000:1.0:1788361425.293611:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293623:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293629:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293634:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293640:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293650:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293658:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293663:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293669:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293677:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293683:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293689:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293694:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293699:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293704:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293708:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293712:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293717:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293745:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293750:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293755:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293759:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293768:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293774:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293786:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293791:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293796:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293800:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293805:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293810:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293814:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293818:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293822:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293826:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293830:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293835:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293839:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293843:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293848:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293852:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293856:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293860:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293864:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293868:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293872:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293876:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293880:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293885:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293889:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293893:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293897:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293902:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293906:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293912:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293917:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293921:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293925:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293930:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293935:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293970:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293974:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293979:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293983:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788361425.293992:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788361425.296110:0:34299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788361425.296121:0:34299:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788361425.296127:0:34299:0:(genops.c:906:class_export_put()) final put ffff9a8985349800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788361425.296131:0:34299:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8985349800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788361425.296180:0:34299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788361425.296245:0:34299:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8a10e800 1 00000020:00000080:1.0:1788361425.296252:0:34299:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6613a79 00000020:00000080:1.0:1788361425.296257:0:34299:0:(genops.c:906:class_export_put()) final put ffff9a8abf242800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788361425.296279:0:34299:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788361425.296282:0:34299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788361425.296287:0:34299:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788361425.296290:0:34299:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9a8a90bf3380) has no exports 00000020:00000080:3.0:1788361425.296321:0:15670:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8abf242800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788361425.315790:0:34299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361425.315805:0:34299:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788361425.315810:0:34299:0:(genops.c:906:class_export_put()) final put ffff9a8a8559f000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788361425.315815:0:34299:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a8559f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788361425.315825:0:34299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788361425.315973:0:34299:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9a8a85598000 00000020:01000000:2.0:1788361425.315991:0:34299:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788361425.315995:0:34299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788361425.315999:0:34299:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788361425.316003:0:34299:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9a8985c63380) has no exports 00000020:00000080:2.0:1788361425.316041:0:34299:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788361425.316047:0:34299:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788361425.316050:0:34299:0:(genops.c:906:class_export_put()) final put ffff9a8a83e4d800/OSS_uuid 00000020:00000080:2.0:1788361425.316052:0:34299:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8a83e4d800/OSS_uuid for OSS 00000020:01000000:2.0:1788361425.316055:0:34299:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788361425.316266:0:31275:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788361425.316308:0:31913:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9a8a88369600:31913] 1 exiting: rc = 0 00000100:00100000:0.0:1788361425.316379:0:32018:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9a8a8afae600:32018] 3 exiting: rc = 0 00000100:00100000:0.0:1788361425.316425:0:31914:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9a8a88368800:31914] 2 exiting: rc = 0 00000100:00100000:2.0:1788361425.316490:0:31912:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9a898509d400:31912] 0 exiting: rc = 1 00000100:00100000:2.0:1788361425.316555:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316565:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316570:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316577:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316585:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316593:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316601:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316610:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316618:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316627:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316634:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316643:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316652:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316662:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316671:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316679:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316684:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316691:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316702:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316712:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316723:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316761:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316774:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316785:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316793:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316801:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316815:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316820:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316825:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316850:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316858:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316863:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316866:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316870:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316873:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316876:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316879:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316882:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316885:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316888:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316891:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316894:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316896:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316899:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316902:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316905:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316908:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316911:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316913:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316916:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316919:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316922:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316925:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316929:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316932:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316935:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316938:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316941:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316944:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316946:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316949:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316952:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316956:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.316959:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361425.318649:0:31916:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9a8abcbcde00:31916] 0 exiting: rc = 1 00000100:00100000:1.0:1788361425.318972:0:31917:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9a8ac05bb000:31917] 1 exiting: rc = 0 00000100:00100000:2.0:1788361425.319020:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319029:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319035:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319040:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319046:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319053:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319060:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319066:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319072:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319080:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319130:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319140:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319146:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319153:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319160:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319166:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319174:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319183:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319190:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319197:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319203:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319210:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319216:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319229:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319235:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319242:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319249:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319256:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319262:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319269:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319275:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319281:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319288:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319296:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319302:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319324:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319332:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319339:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319345:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319353:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319370:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319377:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319382:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319386:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319391:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319406:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319413:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319418:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319423:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319429:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319433:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319438:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319442:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319447:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319452:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319456:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319461:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319476:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319482:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319487:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319491:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319496:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319501:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.319506:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.320606:0:31918:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9a8abc7c2400:31918] 0 exiting: rc = 1 00000100:00100000:0.0:1788361425.320825:0:31920:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9a8abc7c2200:31920] 2 exiting: rc = 0 00000100:00100000:1.0:1788361425.321678:0:31919:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9a8a90a12200:31919] 1 exiting: rc = 0 00000100:00100000:2.0:1788361425.322262:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322275:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322283:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322290:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322299:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322318:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322327:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322337:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322379:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322389:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322395:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322553:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322560:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322565:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322571:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322576:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322581:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322586:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322591:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322597:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322602:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322608:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322614:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322620:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322626:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322634:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322640:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322645:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322650:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322656:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322661:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322669:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322690:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322697:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322702:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322707:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322713:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322719:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322724:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322730:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322809:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322814:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322819:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322824:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322830:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322835:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322841:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322846:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322851:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322856:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322861:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322867:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322873:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322880:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322885:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322891:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322897:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322902:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322908:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322913:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322918:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322935:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322956:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.322963:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329296:0:31922:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9a8abc7c3000:31922] 1 exiting: rc = 0 00000100:00100000:3.0:1788361425.329519:0:31921:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9a8abc7c3a00:31921] 0 exiting: rc = 1 00000100:00100000:2.0:1788361425.329624:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329633:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329639:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329644:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329650:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329655:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329660:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329665:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329671:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329676:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329701:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329706:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329711:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329802:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329813:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329818:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329824:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329829:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329834:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329840:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329845:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329850:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329858:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329866:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329870:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329875:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329880:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329884:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329889:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329894:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329900:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329905:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329910:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329915:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329920:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329929:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329935:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329940:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329945:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329950:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329955:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329960:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329966:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329971:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329976:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329989:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.329994:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330000:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330006:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330010:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330015:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330019:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330024:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330028:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330033:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330037:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330042:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330046:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330051:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330056:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330061:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330067:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330072:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.330077:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788361425.331376:0:31923:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9a8a996ea600:31923] 0 exiting: rc = 1 00000100:00100000:1.0:1788361425.331894:0:31924:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9a8a99628400:31924] 1 exiting: rc = 0 00000100:00100000:2.0:1788361425.331995:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332006:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332013:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332019:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332025:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332031:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332037:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332043:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332049:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332072:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332079:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332098:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332105:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332112:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332117:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332123:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332141:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332147:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332153:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332158:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332165:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332186:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332193:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332199:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332204:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332214:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332220:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332227:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332233:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332240:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332245:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332251:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332257:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332280:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332288:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332294:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332301:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332309:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332320:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332329:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332335:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332341:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332347:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332353:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332360:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332382:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332390:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332395:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332415:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332421:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332427:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332443:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332451:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332457:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332463:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332477:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332483:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332503:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332510:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332515:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332521:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332527:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332533:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788361425.332545:0:34299:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788361425.338852:0:34299:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788361434.982342:0:34916:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788361439.537617:0:35328:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788361439.537623:0:35328:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788361439.537804:0:35328:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a89852f1800 00000020:01000004:2.0:1788361439.537820:0:35328:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788361439.537827:0:35328:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788361439.537841:0:35328:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9a8985c619c0) 00000020:00000080:2.0:1788361439.537856:0:35328:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788361439.554568:0:35328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788361439.556844:0:35328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3a:0x0] (8/32) 00100000:10000000:2.0:1788361439.560705:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1788361439.560820:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:2.0:1788361439.560886:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 579: rc = 0 00100000:10000000:2.0:1788361439.560963:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1788361439.561109:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1788361439.561276:0:35328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788361439.561337:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 579: rc = 0 00100000:10000000:2.0:1788361439.561623:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 581: rc = 0 00100000:10000000:2.0:1788361439.562666:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 660: rc = 0 00100000:10000000:2.0:1788361439.562771:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 660: rc = 0 00100000:10000000:2.0:1788361439.563320:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 790: rc = 0 00100000:10000000:2.0:1788361439.563670:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361439.563931:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 790: rc = 0 00100000:10000000:2.0:1788361439.564213:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361439.564634:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361439.564851:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 790: rc = 0 00100000:10000000:2.0:1788361439.565273:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 790: rc = 0 00100000:10000000:2.0:1788361439.565612:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361439.565901:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361439.566172:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 790: rc = 0 00100000:10000000:2.0:1788361439.566446:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 790: rc = 0 00100000:10000000:2.0:1788361439.566772:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 790: rc = 0 00100000:10000000:2.0:1788361439.567211:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 311: rc = 0 00100000:10000000:2.0:1788361439.567559:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 311: rc = 0 00100000:10000000:2.0:1788361439.567805:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 311: rc = 0 00100000:10000000:2.0:1788361439.568059:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 311: rc = 0 00100000:10000000:0.0:1788361439.570455:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 311: rc = 0 00100000:10000000:0.0:1788361439.570847:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 311: rc = 0 00100000:10000000:0.0:1788361439.571111:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 311: rc = 0 00100000:10000000:0.0:1788361439.571387:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 311: rc = 0 00100000:10000000:0.0:1788361439.571946:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 311: rc = 0 00100000:10000000:0.0:1788361439.572244:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 311: rc = 0 00100000:10000000:0.0:1788361439.572584:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 311: rc = 0 00100000:10000000:0.0:1788361439.572836:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 311: rc = 0 00100000:10000000:0.0:1788361439.573183:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 311: rc = 0 00100000:10000000:0.0:1788361439.573469:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 311: rc = 0 00100000:10000000:0.0:1788361439.573768:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 311: rc = 0 00100000:10000000:0.0:1788361439.574177:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 311: rc = 0 00100000:10000000:0.0:1788361439.574520:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 311: rc = 0 00100000:10000000:0.0:1788361439.574831:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 311: rc = 0 00100000:10000000:0.0:1788361439.575554:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 311: rc = 0 00100000:10000000:0.0:1788361439.576326:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 311: rc = 0 00100000:10000000:0.0:1788361439.576601:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 311: rc = 0 00100000:10000000:0.0:1788361439.577187:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 311: rc = 0 00100000:10000000:0.0:1788361439.577587:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 311: rc = 0 00100000:10000000:0.0:1788361439.578432:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 311: rc = 0 00100000:10000000:0.0:1788361439.579769:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 311: rc = 0 00100000:10000000:0.0:1788361439.580019:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 311: rc = 0 00100000:10000000:0.0:1788361439.580316:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 311: rc = 0 00100000:10000000:0.0:1788361439.582714:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 311: rc = 0 00100000:10000000:0.0:1788361439.583983:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 311: rc = 0 00100000:10000000:0.0:1788361439.584271:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 311: rc = 0 00100000:10000000:0.0:1788361439.586724:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 311: rc = 0 00100000:10000000:0.0:1788361439.587021:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 311: rc = 0 00100000:10000000:0.0:1788361439.587486:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 392: rc = 0 00100000:10000000:0.0:1788361439.588192:0:35328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1788361439.588346:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 664: rc = 0 00100000:10000000:0.0:1788361439.588543:0:35328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1788361439.588606:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 664: rc = 0 00100000:10000000:0.0:1788361439.588794:0:35328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1788361439.588866:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 664: rc = 0 00100000:10000000:0.0:1788361439.589234:0:35328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1788361439.589304:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 661: rc = 0 00100000:10000000:2.0:1788361439.593463:0:35328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788361439.593571:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 661: rc = 0 00100000:10000000:2.0:1788361439.593970:0:35328:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788361439.594050:0:35328:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 661: rc = 0 00000020:00000080:2.0:1788361439.594330:0:35328:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788361439.594339:0:35328:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788361439.594349:0:35328:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d6614420 00000020:01000004:2.0:1788361439.594357:0:35328:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788361439.594362:0:35328:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788361439.594367:0:35328:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a89852f1800 from MGS 00000020:01000004:2.0:1788361439.594381:0:35328:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788361439.594392:0:35328:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9a8985c63380) 00000020:00000080:2.0:1788361439.594408:0:35328:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788361439.594460:0:35328:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a89852f1800 from MGS, refs=2 00080000:01000000:2.0:1788361439.594465:0:35328:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788361439.594470:0:35328:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d661442e 00000100:00100000:2.0:1788361439.594562:0:35328:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788361439.602550:0:35328:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788361439.602563:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788361439.603633:0:35328:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788361439.603641:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788361439.605347:0:35328:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361439.605532:0:35328:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788361439.605538:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788361439.606164:0:35328:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788361439.606172:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788361439.606511:0:35328:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788361439.606518:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788361439.607514:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361439.607519:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361439.607521:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361439.607850:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361439.607853:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361439.607855:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361439.608484:0:35328:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788361439.610317:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788361439.630681:0:35328:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788361439.630700:0:35328:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788361439.630703:0:35328:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788361439.631984:0:35337:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788361439.632160:0:35328:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788361439.633365:0:35328:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361439.634739:0:35328:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788361439.635053:0:35328:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361439.635250:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788361439.635256:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788361439.637578:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788361439.637593:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788361439.639019:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788361439.639029:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788361439.640982:0:35328:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788361439.641015:0:35328:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.160@tcp' 00000020:01000004:3.0:1788361439.641017:0:35328:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788361439.641052:0:35328:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.160@tcp (typ=mgc) 00000020:00000080:3.0:1788361439.641065:0:35328:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.160@tcp (ffff9a8984a5cd40) 00000100:00080000:1.0:1788361439.641178:0:35342:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788361439.641332:0:35328:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788361439.641424:0:35328:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a898666e000@MGC192.168.203.160@tcp: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361439.641561:0:35328:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.160@tcp-0 is initialized 00000040:01000000:3.0:1788361439.641568:0:35328:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788361439.642156:0:35343:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788361439.642231:0:35328:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.160@tcp (uuid dd4618f9-dd70-46a6-81c4-d61716ccf4f3) 00000020:00000080:1.0:1788361439.642248:0:35328:0:(genops.c:1406:class_connect()) connect: client dd4618f9-dd70-46a6-81c4-d61716ccf4f3, cookie 0xf6a94c97d661443c 00000100:00080000:1.0:1788361439.642259:0:35328:0:(import.c:510:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788361439.642265:0:35328:0:(import.c:624:import_select_connection()) MGC192.168.203.160@tcp: import ffff9a898666e000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361439.642296:0:35328:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ab7141500 x1875232144188672/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361439.642741:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3310:1875232144188672:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788361439.642858:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361439.642913:0:35328:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import dd4618f9-dd70-46a6-81c4-d61716ccf4f3->MGS 00000020:01000004:1.0:1788361439.642935:0:35328:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788361439.642940:0:35328:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788361439.642952:0:35328:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9a8ab7464d40) 00000020:00000080:1.0:1788361439.642963:0:35328:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788361439.643978:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144188672 00000100:00100000:2.0:1788361439.643989:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144188672 00000100:00100000:2.0:1788361439.644028:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361439.644036:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3310:x1875232144188672:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788361439.644059:0:35340:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from dd4618f9-dd70-46a6-81c4-d61716ccf4f3@0@lo t0 exp 0000000000000000 cur 829 last 0 00000020:00000080:2.0:1788361439.644217:0:35340:0:(genops.c:1406:class_connect()) connect: client dd4618f9-dd70-46a6-81c4-d61716ccf4f3, cookie 0xf6a94c97d661444a 00000100:00080000:2.0:1788361439.644347:0:35340:0:(import.c:65:import_set_state_nolock()) ffff9a8ac05c0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361439.644434:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+5:3310:x1875232144188672:12345-0@lo:250:mount.lustre.0 Request processed in 397us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.644442:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361439.644497:0:3310:0:(client.c:3115:ptlrpc_free_committed()) MGC192.168.203.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788361439.644506:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.160@tcp: connect to target with instance 0 00000100:00080000:2.0:1788361439.644514:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788361439.644518:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788361439.644522:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a898666e000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788361439.644524:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788361439.644530:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788361439.644535:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3310:1875232144188672:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788361439.656294:0:35328:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788361439.656485:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788361439.656491:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788361439.657195:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788361439.657205:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788361439.659130:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788361439.659141:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788361439.660608:0:35328:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361439.660790:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788361439.660797:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788361439.663123:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788361439.663135:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788361439.690030:0:35328:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361439.690335:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788361439.690342:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788361439.691468:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788361439.691477:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788361439.692010:0:35328:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361439.692379:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788361439.692385:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788361439.692836:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788361439.692843:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788361439.693429:0:35328:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788361439.693743:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788361439.693749:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788361439.694317:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788361439.694324:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788361439.694901:0:35328:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361439.695025:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788361439.695029:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788361439.695581:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788361439.695588:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788361439.710967:0:35328:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788361439.711171:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788361439.711178:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788361439.713128:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788361439.713137:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788361439.713882:0:35328:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788361439.713890:0:35328:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788361439.715553:0:35328:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788361439.715581:0:35328:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788361439.715588:0:35328:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788361439.715734:0:35328:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788361439.715776:0:35328:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788361439.715781:0:35328:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788361439.715783:0:35328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361439.715784:0:35328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361439.715785:0:35328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361439.715786:0:35328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361439.715788:0:35328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361439.715789:0:35328:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361439.715790:0:35328:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361439.715792:0:35328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361439.715794:0:35328:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361439.715796:0:35328:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788361439.715798:0:35328:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361439.715799:0:35328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361439.715801:0:35328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361439.715802:0:35328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361439.715803:0:35328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361439.715804:0:35328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361439.715805:0:35328:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361439.715806:0:35328:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361439.715806:0:35328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361439.715807:0:35328:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788361439.715834:0:35328:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788361439.715861:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144188800:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361439.716001:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361439.716300:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361439.716385:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144188800 00000100:00100000:1.0:1788361439.716393:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144188800 00000100:00100000:1.0:1788361439.716470:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361439.716480:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+5:35328:x1875232144188800:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788361439.716530:0:35341:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788361439.716533:0:35341:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788361439.716536:0:35341:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788361439.719627:0:35361:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788361439.723661:0:35341:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 20 20000000:01000000:1.0:1788361439.724774:0:35362:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788361439.724780:0:35362:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788361439.724783:0:35362:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788361439.724956:0:35362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788361439.725245:0:35341:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788361439.725261:0:35341:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788361439.742540:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+5:35328:x1875232144188800:12345-0@lo:253:mount.lustre.0 Request processed in 26048us (26525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361439.742563:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361439.742726:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144188800:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361439.742744:0:35328:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788361439.742748:0:35328:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361439.742750:0:35328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788361439.742752:0:35328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361439.742753:0:35328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361439.742754:0:35328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361439.742756:0:35328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361439.742758:0:35328:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788361439.742759:0:35328:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788361439.742761:0:35328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361439.742762:0:35328:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788361439.742791:0:35328:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a89852f1800 from lustre-MDT0000 10000000:01000000:3.0:1788361439.742920:0:35328:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788361439.742924:0:35328:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788361439.742929:0:35328:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9a8984a5cd40 10000000:01000000:3.0:1788361439.742934:0:35328:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788361439.742943:0:35328:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9a8984a5cd40 from 1 10000000:01000000:3.0:1788361439.742946:0:35328:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788361439.742990:0:35328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.743002:0:35328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.743012:0:35328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361439.743034:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144188928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788361439.743118:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361439.743207:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.743258:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144188928 00000100:00100000:2.0:1788361439.743265:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144188928 00000100:00100000:2.0:1788361439.743441:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361439.743454:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+5:35328:x1875232144188928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361439.743468:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361439.743485:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6614458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6614451 expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.743512:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6614458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6614451 expref: 6 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.743523:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e200/0xf6a94c97d6614458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614451 expref: 6 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.743544:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e200, rc 0) 00000100:00100000:2.0:1788361439.743646:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+6:35328:x1875232144188928:12345-0@lo:101:mount.lustre.0 Request processed in 185us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.743653:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361439.743812:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144188928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361439.743892:0:35328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614458 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.743902:0:35328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6614458 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361439.743965:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144189056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361439.743993:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361439.744072:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.744167:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144189056 00000100:00100000:2.0:1788361439.744173:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144189056 00000100:00100000:2.0:1788361439.744205:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361439.744213:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+6:35328:x1875232144189056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361439.744482:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+6:35328:x1875232144189056:12345-0@lo:501:mount.lustre.0 Request processed in 270us (488us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361439.744491:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361439.744610:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144189056:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788361439.745750:0:35328:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788361439.745772:0:35328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614458 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.745782:0:35328:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614458 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361439.745790:0:35328:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a89852f1800 10000000:01000000:0.0:1788361439.745796:0:35328:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788361439.745800:0:35328:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9a89852f1800 10000000:01000000:0.0:1788361439.745802:0:35328:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788361439.745805:0:35328:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff9a89852f1800 from 1 10000000:01000000:0.0:1788361439.745807:0:35328:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788361439.745850:0:35328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d661445f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.745856:0:35328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d661445f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.745863:0:35328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d661445f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361439.745879:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144189184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361439.745919:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361439.745947:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.746464:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144189184 00000100:00100000:2.0:1788361439.746473:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144189184 00000100:00100000:2.0:1788361439.746563:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361439.746572:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+6:35328:x1875232144189184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361439.746586:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361439.746602:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d6614466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661445f expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.746628:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d6614466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661445f expref: 7 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.746650:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e400/0xf6a94c97d6614466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661445f expref: 7 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.746659:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e400, rc 0) 00000100:00100000:2.0:1788361439.746717:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+7:35328:x1875232144189184:12345-0@lo:101:mount.lustre.0 Request processed in 147us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.746735:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361439.748341:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144189184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361439.748381:0:35328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d661445f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614466 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.748394:0:35328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d661445f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6614466 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361439.748421:0:35328:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788361439.748434:0:35328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d661445f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614466 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.748442:0:35328:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985965400/0xf6a94c97d661445f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614466 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361439.748451:0:35328:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788361439.748459:0:35328:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361439.748466:0:35328:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9a89852f1800 10000000:01000000:0.0:1788361439.748482:0:35328:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788361439.748486:0:35328:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788361439.748490:0:35328:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788361439.748526:0:35328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d661446d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.748535:0:35328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d661446d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.748543:0:35328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d661446d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361439.748567:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144189312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361439.748744:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.748790:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144189312 00000100:00100000:0.0:1788361439.748793:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361439.748799:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144189312 00000100:00100000:1.0:1788361439.748854:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788361439.748862:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+7:35328:x1875232144189312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361439.748876:0:35341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361439.748893:0:35341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841eea00/0xf6a94c97d6614474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661446d expref: -99 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.748916:0:35341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841eea00/0xf6a94c97d6614474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661446d expref: 8 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.748926:0:35341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841eea00/0xf6a94c97d6614474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661446d expref: 8 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.748934:0:35341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841eea00, rc 0) 00000100:00100000:1.0:1788361439.748972:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+8:35328:x1875232144189312:12345-0@lo:101:mount.lustre.0 Request processed in 111us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361439.748979:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361439.749008:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144189312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361439.749023:0:35328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d661446d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614474 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.749031:0:35328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d661446d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6614474 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361439.749114:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144189440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361439.749141:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361439.749169:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.749224:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144189440 00000100:00100000:2.0:1788361439.749230:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144189440 00000100:00100000:2.0:1788361439.749263:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361439.749271:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+8:35328:x1875232144189440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361439.749784:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+9:35328:x1875232144189440:12345-0@lo:501:mount.lustre.0 Request processed in 512us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.749793:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361439.750127:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144189440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361439.750173:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144189568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361439.750223:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361439.750266:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361439.750319:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144189568 00000100:00100000:1.0:1788361439.750326:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144189568 00000100:00100000:1.0:1788361439.750362:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361439.750382:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+9:35328:x1875232144189568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361439.750829:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+9:35328:x1875232144189568:12345-0@lo:503:mount.lustre.0 Request processed in 456us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361439.750838:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788361439.750866:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144189568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361439.751263:0:35363:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35363:1875232144189696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361439.751315:0:35363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361439.751503:0:35363:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.752053:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144189696 00000100:00100000:2.0:1788361439.752062:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144189696 00000100:00100000:2.0:1788361439.752159:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788361439.752172:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+9:35363:x1875232144189696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361439.752702:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+9:35363:x1875232144189696:12345-0@lo:502:llog_process_th.0 Request processed in 532us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.752713:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361439.752745:0:35363:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35363:1875232144189696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361439.752789:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361439.752803:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361439.752806:0:35363:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788361439.752813:0:35363:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788361439.752817:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361439.752833:0:35363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9a8984a599c0) 00000020:00000080:3.0:1788361439.752855:0:35363:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788361439.752861:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788361439.752942:0:35363:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788361439.752948:0:35363:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d6614482 00000020:00000080:3.0:1788361439.753395:0:35363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788361439.753402:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361439.753405:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361439.753407:0:35363:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788361439.753410:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361439.753415:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361439.753417:0:35363:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788361439.753419:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361439.753427:0:35363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9a8984a58000) 00000020:00000080:3.0:1788361439.753438:0:35363:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788361439.753442:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788361439.753444:0:35363:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788361439.753453:0:35363:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788361439.753460:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788361439.753506:0:35363:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a89852f1800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788361439.753521:0:35363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9a8984a5b380) 00000020:00000080:3.0:1788361439.753529:0:35363:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788361439.753594:0:35363:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788361439.753600:0:35363:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d6614497 00000020:00000080:3.0:1788361439.753698:0:35363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788361439.753704:0:35363:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788361439.753708:0:35363:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf6a94c97d661449e 00080000:01000000:3.0:1788361439.753715:0:35363:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788361439.753718:0:35363:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66144a5 00010000:00010000:3.0:1788361439.815293:0:35363:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788361439.815827:0:35363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 25769803890 00000001:00080000:3.0:1788361439.816046:0:35363:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788361439.816667:0:35363:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9a8a84f119c0) 00000020:00000080:3.0:1788361439.816696:0:35363:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788361439.816769:0:35363:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788361439.816778:0:35363:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66144b3 00000020:00000080:0.0:1788361439.819601:0:35363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788361439.823620:0:35363:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf6a94c97d66144ba 00000020:00000080:2.0:1788361439.823939:0:35363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788361439.823957:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361439.823965:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.823968:0:35363:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788361439.823971:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361439.823978:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.823979:0:35363:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788361439.823984:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788361439.824026:0:35363:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788361439.824039:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361439.824043:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.824044:0:35363:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788361439.824048:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788361439.824057:0:35363:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788361439.824059:0:35363:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361439.824061:0:35363:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361439.824063:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788361439.824066:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.824068:0:35363:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788361439.824070:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788361439.824074:0:35363:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788361439.824078:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.824079:0:35363:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788361439.824082:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788361439.824116:0:35363:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:2.0:1788361439.824151:0:35363:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788361439.824154:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361439.824171:0:35363:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9a8985c60000) 00000020:00000080:2.0:1788361439.824187:0:35363:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788361439.824195:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788361439.824260:0:35363:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788361439.824267:0:35363:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788361439.824273:0:35363:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66144c8 00010000:00080000:2.0:1788361439.824324:0:35363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a8a109800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:2.0:1788361439.824609:0:35363:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788361439.824982:0:35363:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788361439.825027:0:35363:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788361439.825383:0:35363:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 5, last_idx 6 00000040:00080000:2.0:1788361439.826241:0:35363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361439.826305:0:35363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].7, 64 off8640 00000040:00080000:2.0:1788361439.826399:0:35363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].1, 64 off8256 00000040:00080000:2.0:1788361439.826803:0:35367:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 7 synced_idx: 0 lgh_last_idx: 7 00000040:00080000:2.0:1788361439.826809:0:35367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x22:0x0] at index 6 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788361439.827223:0:35363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361439.827236:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788361439.827277:0:35363:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788361439.827300:0:35363:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66144cf 00000100:00080000:2.0:1788361439.827313:0:35363:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788361439.827319:0:35363:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8a8a109800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361439.827364:0:35363:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8abc897b80 x1875232144189824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361439.829033:0:35363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788361439.829148:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144189824:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788361439.829219:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144189824 offset 0 length 520: 4 00000020:01000000:2.0:1788361439.829220:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361439.829226:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.829229:0:35363:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788361439.829232:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788361439.829235:0:35363:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788361439.829236:0:35363:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361439.829238:0:35363:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788361439.829239:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788361439.829241:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.829242:0:35363:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788361439.829245:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788361439.829249:0:35363:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788361439.829253:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.829254:0:35363:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788361439.829257:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788361439.829261:0:35363:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:2.0:1788361439.829285:0:35363:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788361439.829288:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788361439.829304:0:35363:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9a8985c64d40) 00000020:00000080:2.0:1788361439.829325:0:35363:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788361439.829331:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788361439.829428:0:35363:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788361439.829434:0:35363:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788361439.829442:0:35363:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf6a94c97d66144dd 00010000:00080000:2.0:1788361439.829478:0:35363:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8abc48a800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:2.0:1788361439.829889:0:35363:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788361439.830174:0:35363:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788361439.830198:0:35363:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788361439.830782:0:35363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361439.830847:0:35363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].7, 64 off8640 00000040:00080000:2.0:1788361439.830905:0:35363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].1, 64 off8256 00000040:00080000:2.0:1788361439.832704:0:35369:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361439.832712:0:35369:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2a:0x0] at index 7 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788361439.833770:0:35363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788361439.833781:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788361439.833971:0:35363:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788361439.833991:0:35363:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66144e4 00000100:00080000:2.0:1788361439.834000:0:35363:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788361439.834004:0:35363:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8abc48a800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361439.834059:0:35363:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8abc895c00 x1875232144189952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788361439.834115:0:35363:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788361439.834169:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361439.834172:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.834174:0:35363:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788361439.834177:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361439.834180:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.834181:0:35363:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788361439.834183:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788361439.834185:0:35363:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788361439.834186:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361439.834189:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.834190:0:35363:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788361439.834192:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361439.834199:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.834200:0:35363:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788361439.834212:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788361439.834243:0:35363:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35363:1875232144190080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361439.834318:0:35363:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361439.834384:0:35363:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9e8c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361439.834435:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144190080 00000100:00100000:1.0:1788361439.834449:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144190080 00000100:00100000:0.0:1788361439.834473:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144189952:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788361439.834510:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875232144189952 offset 0 length 520: 4 00000100:00100000:1.0:1788361439.834626:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788361439.834639:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+9:35363:x1875232144190080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788361439.835041:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+9:35363:x1875232144190080:12345-0@lo:502:llog_process_th.0 Request processed in 405us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361439.835050:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788361439.835990:0:35363:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35363:1875232144190080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788361439.836042:0:35363:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361439.836053:0:35363:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361439.836055:0:35363:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788361439.836063:0:35363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788361439.836384:0:35328:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788361439.836411:0:35328:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788361439.836437:0:35328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d661446d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614474 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.836449:0:35328:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985964000/0xf6a94c97d661446d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614474 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361439.836460:0:35328:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a89852f1800 from 1 10000000:01000000:0.0:1788361439.836464:0:35328:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788361439.836515:0:35328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.836525:0:35328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.836538:0:35328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361439.836895:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144190208:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361439.836960:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361439.837006:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144190208 00000100:00100000:1.0:1788361439.837007:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.837014:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144190208 00000100:00100000:2.0:1788361439.837055:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788361439.837062:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+9:35328:x1875232144190208:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361439.837074:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361439.837124:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d66144f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66144eb expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.837221:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d66144f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66144eb expref: 10 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.837231:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d66144f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66144eb expref: 10 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.837238:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fe00, rc 0) 00000100:00100000:2.0:1788361439.837278:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+10:35328:x1875232144190208:12345-0@lo:101:mount.lustre.0 Request processed in 217us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.837284:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361439.837350:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144190208:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361439.837365:0:35328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.837443:0:35328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361439.838041:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144190336:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788361439.838080:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361439.838259:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144190336 00000100:00100000:2.0:1788361439.838264:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144190336 00000100:00100000:2.0:1788361439.838307:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361439.838313:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+10:35328:x1875232144190336:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788361439.838329:0:35341:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788361439.838336:0:35341:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788361439.838567:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+10:35328:x1875232144190336:12345-0@lo:256:mount.lustre.0 Request processed in 252us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.838575:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788361439.838706:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361439.838726:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144190336:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788361439.840007:0:35328:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788361439.840044:0:35328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.840057:0:35328:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361439.840079:0:35328:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a89852f1800 from 1 10000000:01000000:1.0:1788361439.840129:0:35328:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788361439.841456:0:35328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.841739:0:35328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.841752:0:35328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361439.841839:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144190464:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361439.841922:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.841979:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.842352:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144190464 00000100:00100000:2.0:1788361439.842361:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144190464 00000100:00100000:2.0:1788361439.842437:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361439.842453:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+10:35328:x1875232144190464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361439.842469:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361439.842495:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6614500 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66144f9 expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.842523:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6614500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66144f9 expref: 11 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.842535:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6614500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66144f9 expref: 11 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.842543:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:2.0:1788361439.842589:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35328:x1875232144190464:12345-0@lo:101:mount.lustre.0 Request processed in 144us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.842594:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361439.842722:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144190464:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361439.842737:0:35328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.842743:0:35328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361439.842859:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144190592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361439.842882:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.842909:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.843007:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144190592 00000100:00100000:2.0:1788361439.843013:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144190592 00000100:00100000:2.0:1788361439.843047:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361439.843054:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35328:x1875232144190592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361439.844291:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35328:x1875232144190592:12345-0@lo:501:mount.lustre.0 Request processed in 1234us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.844303:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361439.844331:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144190592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361439.844457:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144190720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361439.844633:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.844722:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361439.844758:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144190720 00000100:00100000:3.0:1788361439.844829:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144190720 00000100:00100000:3.0:1788361439.844901:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361439.844911:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35328:x1875232144190720:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361439.845378:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35328:x1875232144190720:12345-0@lo:503:mount.lustre.0 Request processed in 457us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361439.845387:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361439.845641:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144190720:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361439.846345:0:35371:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35371:1875232144190848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361439.846592:0:35371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361439.846663:0:35371:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a848d83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.846707:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144190848 00000100:00100000:2.0:1788361439.846714:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144190848 00000100:00100000:2.0:1788361439.846859:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361439.846870:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35371:x1875232144190848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361439.847236:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35371:x1875232144190848:12345-0@lo:502:llog_process_th.0 Request processed in 367us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.847243:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788361439.847334:0:35371:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35371:1875232144190848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361439.847387:0:35371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361439.847399:0:35371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361439.847402:0:35371:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788361439.847412:0:35371:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a89852f1800 00000020:00000080:3.0:1788361439.847415:0:35371:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361439.847430:0:35371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361439.847433:0:35371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361439.847434:0:35371:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788361439.847437:0:35371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361439.847439:0:35371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361439.847440:0:35371:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788361439.847444:0:35371:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a89852f1800 00000020:00000080:3.0:1788361439.847446:0:35371:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361439.847540:0:35371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361439.847544:0:35371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361439.847545:0:35371:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788361439.847548:0:35371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361439.847550:0:35371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361439.847551:0:35371:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788361439.847555:0:35371:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a89852f1800 00000020:00000080:3.0:1788361439.847557:0:35371:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788361439.847602:0:35371:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35371:1875232144190976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361439.847642:0:35371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.848046:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144190976 00000100:00100000:1.0:1788361439.848054:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144190976 00000100:00100000:1.0:1788361439.848113:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361439.848123:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35371:x1875232144190976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361439.848264:0:35371:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361439.848362:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35371:x1875232144190976:12345-0@lo:502:llog_process_th.0 Request processed in 240us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361439.848380:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788361439.848602:0:35371:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35371:1875232144190976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788361439.848630:0:35371:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361439.848636:0:35371:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361439.848638:0:35371:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788361439.848644:0:35371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788361439.848846:0:35328:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788361439.848868:0:35328:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361439.848962:0:35328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.848975:0:35328:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361439.849024:0:35328:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361439.849026:0:35328:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a89852f1800 10000000:01000000:1.0:1788361439.849030:0:35328:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a89852f1800 10000000:01000000:1.0:1788361439.849033:0:35328:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361439.849039:0:35328:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a89852f1800 from 1 10000000:01000000:1.0:1788361439.849042:0:35328:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361439.849073:0:35328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841eec00/0xf6a94c97d6614507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.849082:0:35328:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841eec00/0xf6a94c97d6614507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.849140:0:35328:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841eec00/0xf6a94c97d6614507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361439.849165:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144191104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361439.849206:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.849230:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361439.849287:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144191104 00000100:00100000:3.0:1788361439.849302:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144191104 00000100:00100000:3.0:1788361439.849343:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361439.849352:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35328:x1875232144191104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361439.849364:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361439.849392:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab65ce400/0xf6a94c97d661450e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6614507 expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.849415:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab65ce400/0xf6a94c97d661450e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6614507 expref: 12 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.849425:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab65ce400/0xf6a94c97d661450e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614507 expref: 12 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.849434:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce400, rc 0) 00000100:00100000:3.0:1788361439.849467:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35328:x1875232144191104:12345-0@lo:101:mount.lustre.0 Request processed in 118us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361439.849488:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361439.849670:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144191104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361439.849683:0:35328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841eec00/0xf6a94c97d6614507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661450e expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.849693:0:35328:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841eec00/0xf6a94c97d6614507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661450e expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361439.849754:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144191232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361439.849798:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.849823:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361439.849922:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144191232 00000100:00100000:3.0:1788361439.849927:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144191232 00000100:00100000:3.0:1788361439.849966:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361439.849974:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35328:x1875232144191232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361439.850306:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35328:x1875232144191232:12345-0@lo:501:mount.lustre.0 Request processed in 332us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361439.850315:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361439.850431:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144191232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361439.850463:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144191360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361439.850520:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.850543:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361439.850955:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144191360 00000100:00100000:3.0:1788361439.850961:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144191360 00000100:00100000:3.0:1788361439.851001:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361439.851009:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35328:x1875232144191360:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361439.851244:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35328:x1875232144191360:12345-0@lo:503:mount.lustre.0 Request processed in 234us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361439.851253:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361439.851358:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144191360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361439.851921:0:35373:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35373:1875232144191488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361439.851977:0:35373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361439.852006:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144191488 00000100:00100000:3.0:1788361439.852011:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144191488 00000100:00100000:3.0:1788361439.852052:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361439.852060:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35373:x1875232144191488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361439.852318:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35373:x1875232144191488:12345-0@lo:502:llog_process_th.0 Request processed in 258us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361439.852327:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361439.852385:0:35373:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361439.852401:0:35373:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35373:1875232144191488:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788361439.852836:0:35373:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788361439.852858:0:35373:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9a8a84f14d40) 00000020:00000080:3.0:1788361439.852885:0:35373:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788361439.853082:0:35373:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a89852f1800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788361439.853114:0:35373:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a89852f1800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788361439.853118:0:35373:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a89852f1800 4 00010000:00080000:3.0:1788361439.853154:0:35373:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a8377b800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361439.861333:0:35373:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788361439.861627:0:35373:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788361439.861682:0:35373:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788361439.861703:0:35373:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf6a94c97d661451c 00000100:00080000:3.0:1788361439.861717:0:35373:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361439.861732:0:35373:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a8a8377b800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361439.861853:0:35373:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0a52680 x1875232144191616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361439.861890:0:35373:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788361439.862764:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144191616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361439.862856:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.862918:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144191616 00000100:00100000:1.0:1788361439.862930:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144191616 00000100:00100000:1.0:1788361439.862980:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361439.862990:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144191616:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788361439.863120:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144191616:12345-0@lo:38:llog_process_th.0 Request processed in 130us (263us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788361439.863130:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361439.863184:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788361439.863194:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8377b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788361439.863199:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788361439.863204:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144191616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361439.863401:0:35373:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35373:1875232144191744:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788361439.863592:0:35373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361439.863683:0:35373:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.864426:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144191744 00000100:00100000:2.0:1788361439.864434:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144191744 00000100:00100000:2.0:1788361439.864609:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788361439.864620:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35373:x1875232144191744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788361439.865137:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35373:x1875232144191744:12345-0@lo:502:llog_process_th.0 Request processed in 517us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.865146:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361439.865152:0:35373:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35373:1875232144191744:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788361439.865190:0:35373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788361439.865523:0:35328:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788361439.865620:0:35328:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788361439.865779:0:35328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841eec00/0xf6a94c97d6614507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661450e expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.865792:0:35328:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841eec00/0xf6a94c97d6614507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661450e expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788361439.865848:0:35328:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788361439.865851:0:35328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361439.865853:0:35328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361439.865855:0:35328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361439.865856:0:35328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361439.865858:0:35328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361439.865860:0:35328:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361439.865862:0:35328:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788361439.865864:0:35328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361439.865865:0:35328:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788361439.865869:0:35328:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788361439.865872:0:35328:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361439.865873:0:35328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788361439.865874:0:35328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361439.865876:0:35328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361439.865877:0:35328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361439.865878:0:35328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361439.865886:0:35328:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788361439.865887:0:35328:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788361439.865888:0:35328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361439.865889:0:35328:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788361439.865916:0:35328:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788361439.865936:0:35328:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144191872:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788361439.865991:0:35328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.866030:0:35328:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f493c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361439.866164:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144191872 00000100:00100000:2.0:1788361439.866172:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144191872 00000100:00100000:2.0:1788361439.866217:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788361439.866225:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35328:x1875232144191872:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361439.866265:0:35341:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788361439.866281:0:35341:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788361439.914307:0:35341:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788361439.914331:0:35341:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788361439.914948:0:35361:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788361439.914955:0:35361:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788361439.914979:0:35361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.915000:0:35361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d66144f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66144eb expref: 12 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.915007:0:35361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.915053:0:35361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d66144f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66144eb expref: 12 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361439.915067:0:35361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d66144f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66144eb expref: 12 pid: 35339 timeout: 929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361439.915110:0:35361:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35361:1875232144192000:0@lo:104: 00000100:00100000:1.0:1788361439.915205:0:35361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361439.915260:0:35361:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361439.915418:0:35329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144192000 00000100:00100000:0.0:1788361439.915428:0:35329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144192000 00000100:00100000:0.0:1788361439.915486:0:35329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361439.915497:0:35329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+3:35361:x1875232144192000:12345-0@lo:104: 00010000:00010000:0.0:1788361439.915530:0:35329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.915602:0:35329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361439.915610:0:35329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+3:35361:x1875232144192000:12345-0@lo:104: Request processed in 115us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361439.915617:0:35329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361439.915661:0:35361:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35361:1875232144192000:0@lo:104: 00010000:00010000:0.0:1788361439.915684:0:35361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.915952:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361439.915960:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.915968:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965c00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361439.915972:0:35335:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.915981:0:35335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361439.915990:0:35335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361439.915996:0:35335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361439.916033:0:35335:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.916040:0:35335:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361439.916082:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.916116:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66144eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66144f2 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361439.916135:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361439.916137:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361439.916139:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361439.916175:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144192128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361439.916216:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361439.916301:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144192128 00000100:00100000:2.0:1788361439.916313:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144192128 00010000:00010000:2.0:1788361439.916337:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d66144f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66144eb expref: 13 pid: 35339 timeout: 929 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361439.916378:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361439.916386:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+13:3312:x1875232144192128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361439.916398:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361439.916404:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d66144f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66144eb expref: 13 pid: 35339 timeout: 929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916414:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d66144f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66144eb expref: 13 pid: 35339 timeout: 929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916429:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1fe00/0xf6a94c97d66144f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66144eb expref: 13 pid: 35339 timeout: 929 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916442:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916451:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361439.916465:0:35331:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001511177s 00010000:00010000:2.0:1788361439.916470:0:35331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916477:0:35331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916483:0:35331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916499:0:35331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916505:0:35331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ee600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361439.916508:0:35331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916515:0:35331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916535:0:35331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361439.916546:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361439.916589:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:3312:x1875232144192128:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361439.916596:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788361439.916652:0:35361:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.916660:0:35361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361439.916666:0:35361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d6614523 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361439.916848:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144192128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361439.922863:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35328:x1875232144191872:12345-0@lo:253:mount.lustre.0 Request processed in 56624us (56857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361439.922885:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788361439.922916:0:35328:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35328:1875232144191872:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788361439.922939:0:35328:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788361439.922944:0:35328:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788361439.922946:0:35328:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788361439.922948:0:35328:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361439.922949:0:35328:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361439.922951:0:35328:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361439.922952:0:35328:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361439.922954:0:35328:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788361439.922955:0:35328:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788361439.922958:0:35328:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361439.923188:0:35328:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788361439.923212:0:35328:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788361439.937542:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361439.937723:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361439.938023:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361439.938263:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361439.938555:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361439.938715:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788361439.939743:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361439.939932:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788361439.940355:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361439.940490:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788361439.940758:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788361439.940924:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788361439.967033:0:35328:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 21474836520 00000040:01000000:3.0:1788361439.967497:0:35328:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788361439.967868:0:35384:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788361439.967948:0:35384:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788361439.969649:0:35383:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 21474836520 00000020:00080000:1.0:1788361439.969662:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000040:00080000:3.0:1788361439.970346:0:35384:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788361439.970453:0:35384:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788361439.970458:0:35384:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788361439.973571:0:35328:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788361439.973735:0:35328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788361439.974174:0:35328:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788361439.974183:0:35328:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788361439.974320:0:35328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361439.975687:0:35328:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788361439.976459:0:35328:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788361439.976526:0:35328:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788361439.977108:0:35328:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 5, last_idx 6 00080000:10000000:0.0:1788361439.978053:0:35328:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3b:0x0] (8/8/4) registered 00000001:00000004:3.0:1788361439.992057:0:35328:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000001:00080000:3.0:1788361440.021856:0:35328:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788361440.021903:0:35328:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa998c14f7988 00100000:10000000:3.0:1788361440.021914:0:35328:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788361440.022629:0:35328:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788361440.022669:0:35328:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788361440.022688:0:35328:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788361440.022711:0:35328:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788361440.672634:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788361440.928237:0:35343:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788361440.928269:0:35343:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a89852f1800 from 21 10000000:01000000:2.0:1788361440.928277:0:35343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788361440.928338:0:35343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361440.928352:0:35343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361440.928376:0:35343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361440.928381:0:35380:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:3.0:1788361440.928390:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788361440.928410:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144192256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361440.928514:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361440.928623:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f6aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361440.928735:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144192256 00000100:00100000:0.0:1788361440.928745:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144192256 00000100:00100000:0.0:1788361440.928796:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361440.928806:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35343:x1875232144192256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361440.928820:0:35340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361440.928835:0:35340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6614531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d661452a expref: -99 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361440.928859:0:35340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6614531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d661452a expref: 12 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361440.928870:0:35340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6614531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661452a expref: 12 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361440.928879:0:35340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965e00, rc 0) 00000100:00100000:0.0:1788361440.928928:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35343:x1875232144192256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361440.928934:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000040:00080000:3.0:1788361440.929423:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:3.0:1788361440.929434:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000100:00100000:2.0:1788361440.931528:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144192256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788361440.931564:0:35343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361440.931578:0:35343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361440.931681:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144192384:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788361440.931775:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361440.931814:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144192384 00000100:00100000:2.0:1788361440.931821:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f6aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361440.931824:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144192384 00000100:00100000:1.0:1788361440.931891:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788361440.931902:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35343:x1875232144192384:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788361440.931928:0:35341:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788361440.931950:0:35341:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788361440.931953:0:35341:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 21 00000100:00100000:1.0:1788361440.933517:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35343:x1875232144192384:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1607us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361440.933534:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361440.933555:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144192384:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788361440.933620:0:35343:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788361440.933631:0:35343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361440.933654:0:35343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361441.696238:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361441.957573:0:35380:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:1.0:1788361441.957584:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361441.957630:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 3 count 3 00000040:00080000:1.0:1788361441.957636:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 7 count 2 00000001:02000400:2.0:1788361442.601189:0:35626:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788361442.720198:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361443.745294:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788361444.366955:0:35776:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff7ec03e0 20000000:00000080:3.0:1788361444.366972:0:35776:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a8ac1e85800 uarg=0000000000000000 20000000:01000000:3.0:1788361444.367006:0:35776:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788361444.367013:0:35776:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788361444.367018:0:35776:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788361444.368559:0:35777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788361444.368714:0:35776:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788361444.368723:0:35776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788361444.368742:0:35776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361444.368762:0:35776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6614500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66144f9 expref: 11 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361444.368780:0:35776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361444.368822:0:35776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6614500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66144f9 expref: 11 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361444.368838:0:35776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6614500 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66144f9 expref: 11 pid: 35339 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361444.368853:0:35776:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:35776:1875232144192512:0@lo:104: 00000100:00100000:0.0:1788361444.368920:0:35776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361444.368985:0:35776:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8986bf1480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361444.369046:0:35329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144192512 00000100:00100000:3.0:1788361444.369053:0:35329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144192512 00000100:00100000:3.0:1788361444.369116:0:35329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361444.369126:0:35329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+3:35776:x1875232144192512:12345-0@lo:104: 00010000:00010000:3.0:1788361444.369141:0:35329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361444.369280:0:35776:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:35776:1875232144192512:0@lo:104: 00010000:00010000:0.0:1788361444.369304:0:35776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361444.369367:0:35329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788361444.369374:0:35329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+3:35776:x1875232144192512:12345-0@lo:104: Request processed in 250us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361444.369382:0:35329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788361444.369957:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361444.369966:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361444.369984:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841efe00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361444.369988:0:35334:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361444.369997:0:35334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361444.370004:0:35334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361444.370010:0:35334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788361444.370054:0:35334:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361444.370061:0:35334:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361444.370104:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361444.370112:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a841efe00/0xf6a94c97d66144f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6614500 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361444.370141:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361444.370143:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361444.370145:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361444.370167:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361444.370177:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144192640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361444.370217:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361444.370296:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144192640 00000100:00100000:1.0:1788361444.370302:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144192640 00010000:00010000:1.0:1788361444.370328:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6614500 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66144f9 expref: 12 pid: 35339 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361444.370378:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361444.370388:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:3314:x1875232144192640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361444.370403:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361444.370410:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6614500 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66144f9 expref: 12 pid: 35339 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370422:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6614500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66144f9 expref: 12 pid: 35339 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370436:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d6614500 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66144f9 expref: 12 pid: 35339 timeout: 934 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370451:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370458:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370473:0:35333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370480:0:35333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370487:0:35333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370505:0:35333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370511:0:35333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361444.370515:0:35333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370523:0:35333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370543:0:35333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361444.370553:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361444.370643:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:3314:x1875232144192640:12345-0@lo:103:ldlm_bl.0 Request processed in 257us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361444.370650:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788361444.370953:0:35776:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361444.370964:0:35776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361444.370971:0:35776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614538 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361444.371801:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144192640:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788361444.768246:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788361445.024391:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361445.024398:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788361445.024402:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361445.024405:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788361445.024408:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788361445.024412:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788361445.024415:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a8a8377b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361445.024429:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9a8a8377b800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1788361445.024450:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144192768:0@lo:400:kworker.0 00000100:00100000:3.0:1788361445.024454:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0a52300 x1875232144192896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361445.024529:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361445.024602:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144192768 00000100:00100000:2.0:1788361445.024610:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144192768 00000100:00100000:1.0:1788361445.024627:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144192896:0@lo:38:kworker.0 00000100:00100000:2.0:1788361445.024656:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788361445.024668:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:3314:x1875232144192768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361445.024679:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361445.024727:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144192896 00000100:00100000:3.0:1788361445.024732:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144192896 00000100:00100000:2.0:1788361445.024732:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:3314:x1875232144192768:12345-0@lo:400:kworker.0 Request processed in 64us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361445.024743:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788361445.024754:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361445.024759:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1875232144192896:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788361445.024778:0:35347:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 835 last 0 00000020:00000080:3.0:1788361445.024806:0:35347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf6a94c97d661453f 00000004:00100000:3.0:1788361445.024819:0:35347:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788361445.024829:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144192768:0@lo:400:kworker.0 00000100:00080000:3.0:1788361445.024928:0:35347:0:(import.c:65:import_set_state_nolock()) ffff9a8987188800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361445.024964:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875232144192896:12345-0@lo:38:kworker.0 Request processed in 203us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361445.024970:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788361445.025064:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9a8ac0a52300 x1875232144192896/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788361445.025077:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 7 00000100:00080000:1.0:1788361445.025102:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788361445.025107:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788361445.025109:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8377b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788361445.025114:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875232144192896:0@lo:38:kworker.0 10000000:01000000:0.0:1788361445.472220:0:35343:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361445.472229:0:35343:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a89852f1800 from 10 10000000:01000000:0.0:1788361445.472233:0:35343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361445.472293:0:35343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361445.472311:0:35343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361445.472322:0:35343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361445.472368:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144193024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361445.472775:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361445.472831:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361445.472936:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144193024 00000100:00100000:1.0:1788361445.472944:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144193024 00000100:00100000:1.0:1788361445.473042:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788361445.473062:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+11:35343:x1875232144193024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361445.473114:0:35341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361445.473130:0:35341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841ef600/0xf6a94c97d661454d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6614546 expref: -99 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361445.473157:0:35341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841ef600/0xf6a94c97d661454d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6614546 expref: 12 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361445.473168:0:35341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841ef600/0xf6a94c97d661454d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614546 expref: 12 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361445.473179:0:35341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef600, rc 0) 00000100:00100000:1.0:1788361445.473620:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35343:x1875232144193024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 560us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361445.473629:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788361445.473706:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144193024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361445.473723:0:35343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361445.473734:0:35343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361445.473859:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144193152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361445.473887:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361445.474758:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac05fe480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361445.474895:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144193152 00000100:00100000:2.0:1788361445.474902:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144193152 00000100:00100000:2.0:1788361445.474948:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788361445.474957:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35343:x1875232144193152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361445.475236:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35343:x1875232144193152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361445.475246:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788361445.475264:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144193152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361445.475319:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144193280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361445.475498:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361445.475555:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361445.475587:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144193280 00000100:00100000:1.0:1788361445.475592:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144193280 00000100:00100000:1.0:1788361445.475621:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788361445.475627:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35343:x1875232144193280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361445.475870:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35343:x1875232144193280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 242us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361445.475877:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788361445.475934:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144193280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788361445.477073:0:35855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788361445.477614:0:35343:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788361445.477631:0:35343:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361445.477641:0:35343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361445.477652:0:35343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361445.792176:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788361446.686504:0:35979:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788361446.686509:0:35979:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788361446.686837:0:35979:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8a8a12b000 00000020:01000004:1.0:1788361446.686862:0:35979:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788361446.686873:0:35979:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788361446.686886:0:35979:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9a8ab7460000) 00000020:00000080:1.0:1788361446.686900:0:35979:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788361446.700895:0:35979:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788361446.701202:0:35979:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788361446.702430:0:35979:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788361446.702750:0:35979:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788361446.703009:0:35979:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xf:0x0] (8/32) 00100000:10000000:1.0:1788361446.703465:0:35979:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1788361446.703565:0:35979:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1788361446.703801:0:35979:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:0.0:1788361446.705445:0:35979:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 720: rc = 0 00100000:10000000:0.0:1788361446.705799:0:35979:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 720: rc = 0 00100000:10000000:0.0:1788361446.706065:0:35979:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 720: rc = 0 00100000:10000000:0.0:1788361446.706350:0:35979:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 720: rc = 0 00100000:10000000:0.0:1788361446.706665:0:35979:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 720: rc = 0 00100000:10000000:0.0:1788361446.706881:0:35979:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 720: rc = 0 00000020:00000080:0.0:1788361446.708402:0:35979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788361446.708414:0:35979:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788361446.708424:0:35979:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d661455b 00000020:01000004:0.0:1788361446.708431:0:35979:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788361446.708451:0:35979:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788361446.708455:0:35979:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788361446.708461:0:35979:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788361446.708465:0:35979:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788361446.708476:0:35979:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9a8a90bf4d40) 00000020:00000080:0.0:1788361446.708485:0:35979:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788361446.710225:0:35979:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361446.710399:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788361446.710405:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788361446.714209:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788361446.714221:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788361446.717292:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788361446.717305:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788361446.718467:0:35979:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361446.718634:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788361446.718640:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788361446.719374:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788361446.719381:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788361446.732489:0:35979:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361446.732799:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788361446.732821:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788361446.733999:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788361446.734008:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788361446.734776:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788361446.734783:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788361446.736731:0:35979:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361446.736892:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788361446.736897:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788361446.737475:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788361446.737482:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788361446.768295:0:35979:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788361446.768494:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788361446.768500:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788361446.773470:0:35979:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788361446.773490:0:35979:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788361446.774445:0:35979:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788361446.774468:0:35979:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788361446.774475:0:35979:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788361446.782651:0:35979:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788361446.782688:0:35979:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788361446.782692:0:35979:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788361446.782693:0:35979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361446.782695:0:35979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361446.782697:0:35979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361446.782698:0:35979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361446.782699:0:35979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361446.782701:0:35979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361446.782702:0:35979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361446.782703:0:35979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361446.782707:0:35979:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788361446.782709:0:35979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361446.782710:0:35979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361446.782711:0:35979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361446.782712:0:35979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361446.782713:0:35979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361446.782714:0:35979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361446.782715:0:35979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361446.782716:0:35979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361446.782717:0:35979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361446.782743:0:35979:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788361446.782760:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144193408:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788361446.782831:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361446.782971:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361446.784335:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144193408 00000100:00100000:0.0:1788361446.784345:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144193408 00000100:00100000:0.0:1788361446.784403:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788361446.784412:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35979:x1875232144193408:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361446.784463:0:35339:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788361446.784466:0:35339:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788361446.784470:0:35339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788361446.794425:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35979:x1875232144193408:12345-0@lo:253:mount.lustre.0 Request processed in 10005us (11583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361446.794440:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788361446.794524:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144193408:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788361446.794539:0:35979:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788361446.794543:0:35979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361446.794544:0:35979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788361446.794545:0:35979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361446.794547:0:35979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361446.794548:0:35979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361446.794550:0:35979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361446.794551:0:35979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361446.794554:0:35979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361446.794555:0:35979:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788361446.794576:0:35979:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8a8a12b000 from lustre-OST0000 10000000:01000000:1.0:1788361446.794665:0:35979:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788361446.794669:0:35979:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788361446.794676:0:35979:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8984a5cd40 local copy 00010000:00010000:1.0:1788361446.794687:0:35979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614458 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361446.794895:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144193536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361446.794928:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361446.795005:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361446.795048:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144193536 00000100:00100000:0.0:1788361446.795054:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144193536 00000100:00100000:0.0:1788361446.795162:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788361446.795171:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35979:x1875232144193536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361446.795342:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35979:x1875232144193536:12345-0@lo:501:mount.lustre.0 Request processed in 172us (412us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361446.795355:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788361446.795423:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144193536:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788361446.795436:0:35979:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788361446.795579:0:35979:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788361446.795599:0:35979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614458 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.795617:0:35979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614458 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361446.795639:0:35979:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8a8a12b000 10000000:01000000:1.0:1788361446.795644:0:35979:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788361446.795648:0:35979:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9a8984a5cd40 10000000:01000000:1.0:1788361446.795650:0:35979:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788361446.795654:0:35979:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9a8984a5cd40 from 1 10000000:01000000:1.0:1788361446.795656:0:35979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788361446.795680:0:35979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee800/0xf6a94c97d6614569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.795689:0:35979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee800/0xf6a94c97d6614569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.795698:0:35979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee800/0xf6a94c97d6614569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361446.795710:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144193664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361446.795736:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361446.795858:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144193664 00000100:00100000:2.0:1788361446.795865:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144193664 00000100:00100000:1.0:1788361446.795872:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361446.796067:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788361446.796078:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+12:35979:x1875232144193664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361446.796181:0:35341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361446.796196:0:35341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab65cfe00/0xf6a94c97d6614570 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6614569 expref: -99 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.796220:0:35341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab65cfe00/0xf6a94c97d6614570 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6614569 expref: 13 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.796238:0:35341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab65cfe00/0xf6a94c97d6614570 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614569 expref: 13 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.796248:0:35341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cfe00, rc 0) 00000100:00100000:3.0:1788361446.796338:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+13:35979:x1875232144193664:12345-0@lo:101:mount.lustre.0 Request processed in 262us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361446.796344:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788361446.796396:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144193664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361446.796409:0:35979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee800/0xf6a94c97d6614569 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614570 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.796417:0:35979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee800/0xf6a94c97d6614569 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6614570 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361446.796442:0:35979:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788361446.796488:0:35979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee800/0xf6a94c97d6614569 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614570 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.796496:0:35979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee800/0xf6a94c97d6614569 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614570 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361446.796502:0:35979:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788361446.796506:0:35979:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361446.796510:0:35979:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788361446.796512:0:35979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788361446.796695:0:35979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee000/0xf6a94c97d6614577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.796702:0:35979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee000/0xf6a94c97d6614577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.796711:0:35979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee000/0xf6a94c97d6614577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361446.796725:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144193792:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361446.796752:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361446.796821:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361446.796886:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144193792 00000100:00100000:3.0:1788361446.796891:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144193792 00000100:00100000:3.0:1788361446.796928:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361446.796935:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+13:35979:x1875232144193792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788361446.796944:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361446.796952:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab65ce600/0xf6a94c97d661457e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6614577 expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.796968:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab65ce600/0xf6a94c97d661457e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6614577 expref: 14 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.796976:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab65ce600/0xf6a94c97d661457e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614577 expref: 14 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.796982:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce600, rc 0) 00000100:00100000:3.0:1788361446.797128:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+14:35979:x1875232144193792:12345-0@lo:101:mount.lustre.0 Request processed in 192us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361446.797135:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788361446.797204:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144193792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361446.797214:0:35979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee000/0xf6a94c97d6614577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661457e expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.797223:0:35979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee000/0xf6a94c97d6614577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661457e expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361446.798260:0:35979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 14 count 14 00000040:00080000:1.0:1788361446.799371:0:35979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361446.799661:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:1.0:1788361446.799720:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:1.0:1788361446.799754:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:1.0:1788361446.799796:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:1.0:1788361446.799826:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:1.0:1788361446.799853:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:1.0:1788361446.799890:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:1.0:1788361446.799918:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:1.0:1788361446.799944:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 80 off9712 00000040:00080000:1.0:1788361446.799980:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9936 00000040:00080000:1.0:1788361446.800009:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 224 off10160 00000040:00080000:1.0:1788361446.800047:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 120 off10280 00000040:00080000:1.0:1788361446.800221:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].13, 224 off10504 00000040:00080000:1.0:1788361446.800230:0:35979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 14 00000100:00100000:1.0:1788361446.800305:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144193920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361446.800376:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361446.800451:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361446.800490:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144193920 00000100:00100000:3.0:1788361446.800497:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144193920 00000100:00100000:3.0:1788361446.800551:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788361446.800559:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+14:35979:x1875232144193920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361446.800989:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+14:35979:x1875232144193920:12345-0@lo:501:mount.lustre.0 Request processed in 430us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361446.800997:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361446.801067:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144193920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361446.801123:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194048:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361446.801164:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361446.801224:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361446.801257:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144194048 00000100:00100000:3.0:1788361446.801261:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144194048 00000100:00100000:3.0:1788361446.801288:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788361446.801294:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+14:35979:x1875232144194048:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361446.801684:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+14:35979:x1875232144194048:12345-0@lo:503:mount.lustre.0 Request processed in 389us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361446.801692:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788361446.801754:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194048:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788361446.802304:0:35979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788361446.802702:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361446.802759:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361446.802839:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361446.802879:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144194176 00000100:00100000:3.0:1788361446.802885:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144194176 00000100:00100000:3.0:1788361446.802927:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788361446.802935:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+14:35979:x1875232144194176:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361446.803158:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+14:35979:x1875232144194176:12345-0@lo:502:mount.lustre.0 Request processed in 223us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361446.803165:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788361446.803372:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788361446.803582:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:1.0:1788361446.803726:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:1.0:1788361446.803764:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:1.0:1788361446.803807:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:1.0:1788361446.803842:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:1.0:1788361446.803876:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:1.0:1788361446.803921:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:1.0:1788361446.803956:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:1.0:1788361446.803989:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 80 off9712 00000040:00080000:1.0:1788361446.804036:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9936 00000040:00080000:1.0:1788361446.804073:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 224 off10160 00000040:00080000:1.0:1788361446.804313:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 120 off10280 00000100:00100000:1.0:1788361446.804358:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194304:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361446.804407:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361446.804476:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361446.804520:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144194304 00000100:00100000:3.0:1788361446.804526:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144194304 00000100:00100000:3.0:1788361446.804659:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788361446.804667:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+14:35979:x1875232144194304:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361446.804833:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+14:35979:x1875232144194304:12345-0@lo:502:mount.lustre.0 Request processed in 167us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361446.804840:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788361446.804928:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361446.804996:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].13, 224 off10504 00000040:00080000:2.0:1788361446.805005:0:35979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788361446.805881:0:35993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788361446.805889:0:35993:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788361446.805895:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361446.805897:0:35993:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788361446.805902:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788361446.805914:0:35993:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9a8ab7463380) 00000020:00000080:1.0:1788361446.805934:0:35993:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788361446.805938:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788361446.806000:0:35993:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a8a12b000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788361446.806006:0:35993:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788361446.806013:0:35993:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf6a94c97d661458c 00010000:00010000:1.0:1788361446.809458:0:35993:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788361446.810022:0:35993:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 25769803793 00080000:10000000:1.0:1788361446.811788:0:35993:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x10:0x0] (8/8/4) registered 00000020:00000080:1.0:1788361446.814464:0:35993:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788361446.814474:0:35993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361446.814480:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361446.814482:0:35993:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788361446.814486:0:35993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788361446.814488:0:35993:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788361446.814489:0:35993:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361446.814491:0:35993:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788361446.814492:0:35993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788361446.814494:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361446.814496:0:35993:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788361446.814498:0:35993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361446.814500:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361446.814502:0:35993:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788361446.814504:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788361446.814506:0:35993:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788361446.814508:0:35993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361446.814510:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361446.814511:0:35993:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788361446.814513:0:35993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788361446.814515:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361446.814516:0:35993:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788361446.814519:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788361446.814568:0:35993:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788361446.814571:0:35993:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788361446.814572:0:35993:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788361446.814575:0:35993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 14 count 14 00000020:01000000:0.0:1788361446.815692:0:35979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788361446.815723:0:35979:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788361446.815747:0:35979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee000/0xf6a94c97d6614577 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661457e expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.815759:0:35979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841ee000/0xf6a94c97d6614577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661457e expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361446.815766:0:35979:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a8a12b000 from 1 10000000:01000000:0.0:1788361446.815770:0:35979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361446.815808:0:35979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.815816:0:35979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.815826:0:35979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361446.815849:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361446.815909:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361446.815949:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361446.816014:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144194432 00000100:00100000:2.0:1788361446.816020:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144194432 00000100:00100000:2.0:1788361446.816065:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788361446.816073:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+14:35979:x1875232144194432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361446.816109:0:35340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361446.816122:0:35340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d661459a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6614593 expref: -99 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.816146:0:35340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d661459a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6614593 expref: 15 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.816157:0:35340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d661459a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614593 expref: 15 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.816166:0:35340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f400, rc 0) 00000100:00100000:2.0:1788361446.816204:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144194432:12345-0@lo:101:mount.lustre.0 Request processed in 131us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361446.816211:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788361446.816752:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361446.816768:0:35979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.816778:0:35979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361446.818393:0:35979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000040:00080000:0.0:1788361446.818830:0:35979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361446.819073:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:0.0:1788361446.819141:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:0.0:1788361446.819200:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:0.0:1788361446.819243:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:0.0:1788361446.819286:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:0.0:1788361446.819436:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:0.0:1788361446.819476:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 224 off9536 00000040:00080000:0.0:1788361446.819511:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 128 off9664 00000040:00080000:0.0:1788361446.819578:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9888 00000040:00080000:0.0:1788361446.819639:0:35979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 9 count 10 00000100:00100000:0.0:1788361446.819711:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361446.819773:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361446.819821:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361446.819879:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144194560 00000100:00100000:3.0:1788361446.819886:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144194560 00000100:00100000:3.0:1788361446.819962:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788361446.819971:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144194560:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361446.820208:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144194560:12345-0@lo:501:mount.lustre.0 Request processed in 238us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361446.820217:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1788361446.820291:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361446.820373:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361446.820404:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361446.820438:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361446.820494:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30600 going to sleep for 11 seconds 00000100:00100000:3.0:1788361446.820523:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144194688 00000100:00100000:3.0:1788361446.820527:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144194688 00000100:00100000:3.0:1788361446.820553:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788361446.820559:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144194688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361446.820762:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144194688:12345-0@lo:503:mount.lustre.0 Request processed in 201us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361446.820769:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788361446.820927:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194688:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788361446.821441:0:35979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361446.821493:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361446.821531:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361446.821560:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361446.822073:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144194816 00000100:00100000:1.0:1788361446.822079:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144194816 00000100:00100000:1.0:1788361446.822133:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788361446.822141:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144194816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361446.822346:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144194816:12345-0@lo:502:mount.lustre.0 Request processed in 205us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361446.822353:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788361446.822566:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361446.822882:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:0.0:1788361446.822925:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:0.0:1788361446.822965:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:0.0:1788361446.822994:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:0.0:1788361446.823021:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000040:00080000:0.0:1788361446.823068:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:0.0:1788361446.823302:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 224 off9536 00000040:00080000:0.0:1788361446.823345:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 128 off9664 00000100:00100000:0.0:1788361446.823380:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194944:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361446.823424:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361446.823487:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361446.823532:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144194944 00000100:00100000:1.0:1788361446.823536:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144194944 00000100:00100000:1.0:1788361446.823599:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788361446.823606:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144194944:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361446.823746:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144194944:12345-0@lo:502:mount.lustre.0 Request processed in 140us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361446.823752:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788361446.823816:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144194944:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361446.823888:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9888 00000040:00080000:0.0:1788361446.823897:0:35979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788361446.824646:0:35997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361446.824655:0:35997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361446.824658:0:35997:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788361446.824664:0:35997:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a8a12b000 00000020:00000080:3.0:1788361446.824667:0:35997:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361446.824674:0:35997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361446.824677:0:35997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361446.824678:0:35997:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788361446.824680:0:35997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361446.824683:0:35997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361446.824684:0:35997:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788361446.824687:0:35997:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8a8a12b000 00000020:00000080:3.0:1788361446.824689:0:35997:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361446.824784:0:35997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361446.824789:0:35997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361446.824790:0:35997:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788361446.824800:0:35997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788361446.824803:0:35997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361446.824805:0:35997:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788361446.824808:0:35997:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8a8a12b000 00000020:00000080:3.0:1788361446.824810:0:35997:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788361446.825354:0:35997:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788361446.825359:0:35997:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361446.825360:0:35997:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788361446.825363:0:35997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 10 count 10 00000020:01000000:1.0:1788361446.826684:0:35979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788361446.826725:0:35979:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361446.827682:0:35979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.827697:0:35979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361446.827750:0:35979:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788361446.827753:0:35979:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8a8a12b000 10000000:01000000:1.0:1788361446.827756:0:35979:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8a8a12b000 10000000:01000000:1.0:1788361446.827760:0:35979:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788361446.827765:0:35979:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8a8a12b000 from 1 10000000:01000000:1.0:1788361446.827767:0:35979:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788361446.827803:0:35979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841efc00/0xf6a94c97d66145a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.827811:0:35979:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a841efc00/0xf6a94c97d66145a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.827829:0:35979:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a841efc00/0xf6a94c97d66145a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361446.827853:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195072:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788361446.827919:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361446.827963:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361446.828030:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144195072 00000100:00100000:0.0:1788361446.828037:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144195072 00000100:00100000:0.0:1788361446.828082:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788361446.830523:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144195072:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361446.830546:0:35340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361446.830568:0:35340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964400/0xf6a94c97d66145a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66145a1 expref: -99 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.830675:0:35340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964400/0xf6a94c97d66145a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66145a1 expref: 16 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.830688:0:35340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964400/0xf6a94c97d66145a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66145a1 expref: 16 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.830699:0:35340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964400, rc 0) 00000100:00100000:0.0:1788361446.830782:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35979:x1875232144195072:12345-0@lo:101:mount.lustre.0 Request processed in 272us (2862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361446.830791:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788361446.832742:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195072:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361446.832774:0:35979:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a841efc00/0xf6a94c97d66145a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66145a8 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.832787:0:35979:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a841efc00/0xf6a94c97d66145a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66145a8 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361446.833434:0:35979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000040:00080000:1.0:1788361446.837589:0:35979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788361446.837931:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:1.0:1788361446.837976:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:1.0:1788361446.838006:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:1.0:1788361446.838050:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:1.0:1788361446.838114:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:1.0:1788361446.838168:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:1.0:1788361446.838205:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:1.0:1788361446.838241:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:1.0:1788361446.838289:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:1.0:1788361446.838759:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:1.0:1788361446.838804:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:1.0:1788361446.838858:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:1.0:1788361446.838895:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:1.0:1788361446.838938:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:1.0:1788361446.838977:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:1.0:1788361446.839021:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:1.0:1788361446.839054:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:1.0:1788361446.839206:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:1.0:1788361446.839245:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:1.0:1788361446.839273:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:1.0:1788361446.839312:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:1.0:1788361446.839354:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:1.0:1788361446.839381:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:1.0:1788361446.839429:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:1.0:1788361446.839465:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 128 off12440 00000040:00080000:1.0:1788361446.839514:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12664 00000040:00080000:1.0:1788361446.840149:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12888 00000040:00080000:1.0:1788361446.840208:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off12968 00000040:00080000:1.0:1788361446.840246:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13192 00000040:00080000:1.0:1788361446.842758:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13416 00000040:00080000:1.0:1788361446.842856:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13504 00000040:00080000:1.0:1788361446.842911:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13632 00000040:00080000:1.0:1788361446.842945:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13776 00000040:00080000:1.0:1788361446.842987:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13904 00000040:00080000:1.0:1788361446.843020:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14128 00000040:00080000:1.0:1788361446.843081:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14352 00000040:00080000:1.0:1788361446.843726:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14432 00000040:00080000:1.0:1788361446.843757:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14656 00000040:00080000:1.0:1788361446.843802:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14880 00000040:00080000:1.0:1788361446.843833:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 120 off15000 00000040:00080000:1.0:1788361446.843933:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 224 off15224 00000040:00080000:1.0:1788361446.843941:0:35979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 41 count 42 00000100:00100000:1.0:1788361446.844036:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195200:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361446.844702:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361446.844757:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144195200 00000100:00100000:1.0:1788361446.844769:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144195200 00000100:00100000:1.0:1788361446.844852:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361446.844860:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35979:x1875232144195200:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788361446.845067:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35979:x1875232144195200:12345-0@lo:501:mount.lustre.0 Request processed in 207us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361446.845075:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788361446.848460:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361446.848501:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195200:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788361446.848558:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788361446.848703:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361446.848738:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361446.848795:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144195328 00000100:00100000:3.0:1788361446.848802:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144195328 00000100:00100000:3.0:1788361446.848854:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788361446.848863:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35979:x1875232144195328:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361446.849045:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35979:x1875232144195328:12345-0@lo:503:mount.lustre.0 Request processed in 182us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361446.849054:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788361446.849214:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195328:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788361446.852115:0:35979:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788361446.852205:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361446.852280:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361446.852339:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361446.852402:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144195456 00000100:00100000:1.0:1788361446.852409:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144195456 00000100:00100000:1.0:1788361446.852454:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361446.852462:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35979:x1875232144195456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361446.853707:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35979:x1875232144195456:12345-0@lo:502:mount.lustre.0 Request processed in 1242us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361446.853717:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788361446.854349:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361446.854708:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:2.0:1788361446.854770:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:2.0:1788361446.854806:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:2.0:1788361446.854855:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:2.0:1788361446.854892:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:2.0:1788361446.854961:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:2.0:1788361446.854999:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:2.0:1788361446.855030:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:2.0:1788361446.855079:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:2.0:1788361446.855211:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:2.0:1788361446.855239:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:2.0:1788361446.855280:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:2.0:1788361446.855311:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:2.0:1788361446.855353:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:2.0:1788361446.855402:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:2.0:1788361446.855440:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:2.0:1788361446.855473:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:2.0:1788361446.855521:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:2.0:1788361446.855555:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:2.0:1788361446.855659:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:2.0:1788361446.855717:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:2.0:1788361446.855775:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:2.0:1788361446.855811:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:2.0:1788361446.855858:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:2.0:1788361446.855894:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 128 off12440 00000040:00080000:2.0:1788361446.855928:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12664 00000040:00080000:2.0:1788361446.855974:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12888 00000040:00080000:2.0:1788361446.856010:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off12968 00000040:00080000:2.0:1788361446.856045:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13192 00000040:00080000:2.0:1788361446.856203:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13416 00000040:00080000:2.0:1788361446.856242:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13504 00000040:00080000:2.0:1788361446.856277:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13632 00000040:00080000:2.0:1788361446.856311:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13776 00000040:00080000:2.0:1788361446.856371:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13904 00000040:00080000:2.0:1788361446.856404:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14128 00000040:00080000:2.0:1788361446.856447:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14352 00000040:00080000:2.0:1788361446.856484:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14432 00000040:00080000:2.0:1788361446.856538:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14656 00000040:00080000:2.0:1788361446.856669:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14880 00000040:00080000:2.0:1788361446.856713:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 120 off15000 00000100:00100000:2.0:1788361446.856764:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361446.856842:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361446.856933:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361446.856978:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144195584 00000100:00100000:3.0:1788361446.856986:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144195584 00000100:00100000:3.0:1788361446.857040:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788361446.857049:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35979:x1875232144195584:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361446.857539:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35979:x1875232144195584:12345-0@lo:502:mount.lustre.0 Request processed in 490us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361446.857548:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788361446.858035:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361446.858149:0:35979:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 224 off15224 00000040:00080000:0.0:1788361446.858165:0:35979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788361446.862148:0:36002:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788361446.862166:0:36002:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9a8a90bf3380) 00000020:00000080:0.0:1788361446.862192:0:36002:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788361446.862381:0:36002:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8a8a12b000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788361446.862386:0:36002:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8a8a12b000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788361446.862389:0:36002:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8a8a12b000 3 00010000:00080000:0.0:1788361446.863034:0:36002:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a8a9efcf000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.160@tcp at head 00010000:00010000:0.0:1788361446.867172:0:36002:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788361446.867285:0:36002:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788361446.868918:0:36002:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788361446.868936:0:36002:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf6a94c97d66145b6 00000100:00080000:0.0:1788361446.869755:0:36002:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788361446.869762:0:36002:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9a8a9efcf000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361446.869796:0:36002:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a835e1c00 x1875232144195712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788361446.869825:0:36002:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788361446.869908:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144195712:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788361446.869983:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361446.870058:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144195712 00000100:00100000:0.0:1788361446.870065:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144195712 00000100:00100000:0.0:1788361446.870136:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361446.870144:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1875232144195712:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788361446.870168:0:35346:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 836 last 0 00000020:00000080:0.0:1788361446.870212:0:35346:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf6a94c97d66145bd 00000004:00100000:0.0:1788361446.870229:0:35346:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788361446.870259:0:35346:0:(import.c:65:import_set_state_nolock()) ffff9a8ac1c6b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361446.870318:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875232144195712:12345-0@lo:38:llog_process_th.0 Request processed in 174us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361446.870339:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788361446.870375:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a835e1c00 x1875232144195712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361456 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361446.870386:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361446.870398:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 7 00000100:00080000:2.0:1788361446.870406:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788361446.870411:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788361446.870414:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a9efcf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788361446.870420:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1875232144195712:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788361446.870506:0:36002:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 42 count 42 00000020:01000000:2.0:1788361446.870691:0:35979:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788361446.870719:0:35979:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361446.870741:0:35979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a841efc00/0xf6a94c97d66145a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66145a8 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.870752:0:35979:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a841efc00/0xf6a94c97d66145a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66145a8 expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361446.870762:0:35928:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361446.870768:0:35928:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788361446.870772:0:35928:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361446.870774:0:35928:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:2.0:1788361446.870796:0:35979:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788361446.870799:0:35979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361446.870801:0:35979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361446.870802:0:35979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361446.870804:0:35979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361446.870805:0:35979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361446.870807:0:35979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361446.870810:0:35979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361446.870811:0:35979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788361446.870816:0:35979:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788361446.870819:0:35979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788361446.870821:0:35979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788361446.870822:0:35979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788361446.870823:0:35979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788361446.870825:0:35979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788361446.870827:0:35979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788361446.870828:0:35979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788361446.870829:0:35979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788361446.870831:0:35979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788361446.870855:0:35979:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788361446.870867:0:35979:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788361446.870912:0:35979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361446.870945:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144195968 00000100:00100000:2.0:1788361446.870949:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144195968 00000100:00100000:2.0:1788361446.870981:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361446.870988:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35979:x1875232144195968:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361446.871009:0:35341:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788361446.871021:0:35341:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788361446.871174:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361446.871184:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144195840:0@lo:400:kworker.0 00000100:00100000:0.0:1788361446.871218:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361446.871255:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144195840 00000100:00100000:0.0:1788361446.871260:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144195840 00000100:00100000:0.0:1788361446.871286:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361446.871294:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144195840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361446.871343:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144195840:12345-0@lo:400:kworker.0 Request processed in 51us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361446.871350:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788361446.871381:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a50e00 x1875232144195840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361446.871392:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144195840:0@lo:400:kworker.0 00000100:00100000:3.0:1788361446.871706:0:35979:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbee40 going to sleep for 11 seconds 20000000:01000000:1.0:1788361446.916596:0:35341:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788361446.916621:0:35341:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788361446.916657:0:35361:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361446.916663:0:35361:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361446.916697:0:35361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.916717:0:35361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6614531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d661452a expref: 16 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.916746:0:35361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.916784:0:35361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6614531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d661452a expref: 16 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.916798:0:35361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6614531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d661452a expref: 16 pid: 35340 timeout: 936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361446.916814:0:35361:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35361:1875232144196096:0@lo:104: 00000100:00100000:0.0:1788361446.916878:0:35361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361446.916921:0:35361:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361446.916949:0:35330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144196096 00000100:00100000:1.0:1788361446.916957:0:35330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144196096 00000100:00100000:1.0:1788361446.917062:0:35330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788361446.917071:0:35330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+3:35361:x1875232144196096:12345-0@lo:104: 00010000:00010000:1.0:1788361446.917105:0:35330:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361446.917178:0:35330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788361446.917184:0:35330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+3:35361:x1875232144196096:12345-0@lo:104: Request processed in 115us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361446.917191:0:35330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788361446.917344:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361446.917354:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.917371:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fc00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:3.0:1788361446.917376:0:35334:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.917383:0:35334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788361446.917391:0:35334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361446.917396:0:35334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788361446.917434:0:35334:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.917441:0:35334:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788361446.917462:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.917469:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1fc00/0xf6a94c97d661452a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d6614531 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361446.917484:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361446.917486:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361446.917488:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361446.917926:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144196224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361446.917961:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361446.918021:0:35361:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35361:1875232144196096:0@lo:104: 00000100:00100000:2.0:1788361446.918061:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144196224 00000100:00100000:2.0:1788361446.918068:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144196224 00010000:00010000:2.0:1788361446.918103:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6614531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661452a expref: 17 pid: 35340 timeout: 936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361446.918137:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361446.918146:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:3312:x1875232144196224:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361446.918147:0:35332:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788361446.918159:0:35332:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788361446.918162:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361446.918170:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6614531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d661452a expref: 17 pid: 35340 timeout: 936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918181:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6614531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d661452a expref: 17 pid: 35340 timeout: 936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918196:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985965e00/0xf6a94c97d6614531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d661452a expref: 17 pid: 35340 timeout: 936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918210:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918218:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361446.918296:0:35331:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001633969s 00010000:00010000:0.0:1788361446.918297:0:35361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918302:0:35331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.918313:0:35361:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918314:0:35331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361446.918334:0:35361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918338:0:35331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918348:0:35331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918355:0:35331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361446.918360:0:35331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918369:0:35331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918378:0:35331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918444:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964a00/0xf6a94c97d66145c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361446.918464:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361446.918508:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:3312:x1875232144196224:12345-0@lo:103:ldlm_bl.0 Request processed in 363us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361446.918516:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361446.918563:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144196224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361446.929134:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35979:x1875232144195968:12345-0@lo:253:mount.lustre.0 Request processed in 58140us (58215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361446.929146:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788361446.929379:0:35979:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35979:1875232144195968:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361446.929392:0:35979:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788361446.929394:0:35979:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361446.929407:0:35979:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788361446.929408:0:35979:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361446.929409:0:35979:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361446.929410:0:35979:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361446.929410:0:35979:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361446.929412:0:35979:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361446.929413:0:35979:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361446.929414:0:35979:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788361446.929430:0:35979:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788361446.930065:0:35979:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361446.930255:0:35979:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361446.930523:0:35979:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361446.930714:0:35979:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361446.930938:0:35979:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361446.931143:0:35979:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788361446.932605:0:35979:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771072 00002000:00080000:3.0:1788361446.970123:0:35979:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788361446.970133:0:35979:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788361446.970169:0:35979:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788361446.970225:0:35979:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788361446.970240:0:35979:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788361446.970265:0:35979:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788361447.841215:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788361447.968182:0:35343:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788361447.968190:0:35343:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a89852f1800 from 22 10000000:01000000:2.0:1788361447.968194:0:35343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788361447.968239:0:35343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361447.968249:0:35343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361447.968259:0:35343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361447.968283:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144196352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361447.968357:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361447.968418:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8837dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361447.968446:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144196352 00000100:00100000:0.0:1788361447.968461:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144196352 00000100:00100000:3.0:1788361447.968541:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788361447.968553:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+15:35343:x1875232144196352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361447.968570:0:35340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361447.968585:0:35340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8ab65cfc00/0xf6a94c97d66145d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66145cb expref: -99 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361447.968610:0:35340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8ab65cfc00/0xf6a94c97d66145d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66145cb expref: 16 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361447.968622:0:35340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8ab65cfc00/0xf6a94c97d66145d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66145cb expref: 16 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361447.968642:0:35340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cfc00, rc 0) 00000100:00100000:3.0:1788361447.968692:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35343:x1875232144196352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361447.968699:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788361447.969180:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144196352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361447.969196:0:35343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361447.969205:0:35343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361447.969257:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144196480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788361447.969289:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361447.969328:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361447.969372:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144196480 00000100:00100000:3.0:1788361447.969377:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144196480 00000100:00100000:3.0:1788361447.969410:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788361447.969416:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35343:x1875232144196480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788361447.969430:0:35341:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788361447.969444:0:35341:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788361447.969447:0:35341:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 22 00000100:00100000:3.0:1788361447.969522:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35343:x1875232144196480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361447.969528:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788361447.969557:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144196480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788361447.969617:0:35343:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788361447.969624:0:35343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361447.969632:0:35343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361448.864362:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361449.888201:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361449.952193:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361439/real 1788361439] req@ffff9a8abc895c00 x1875232144189952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361449 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361449.952226:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8abc895c00 x1875232144189952/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361449 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361449.952237:0:3310:0:(client.c:2493:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788361439/real 1788361439] req@ffff9a8abc897b80 x1875232144189824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361449 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361449.952249:0:3310:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9a8abc897b80 x1875232144189824/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788361449 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788361449.952267:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361449.952307:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788361449.952312:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144189952:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788361449.952319:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a109800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361449.952324:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788361449.952327:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144189824:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788361449.952529:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144196608:0@lo:400:kworker.0 00000100:00100000:2.0:1788361449.952591:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361449.952662:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361449.952668:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788361449.952677:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a109800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361449.952682:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 829 00000100:00080000:3.0:1788361449.952687:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361449.952693:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9a8a8a109800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361449.952715:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0a50e00 x1875232144196736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361449.952729:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788361449.952732:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788361449.952733:0:36:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788361449.952736:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 829 00000100:00080000:3.0:1788361449.952739:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788361449.952742:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8abc48a800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361449.952757:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0a52d80 x1875232144196864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788361449.952792:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361449.952799:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144196992:0@lo:400:kworker.0 00000100:00100000:2.0:1788361449.952827:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361449.952882:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144196608 00000100:00100000:2.0:1788361449.952889:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144196608 00000100:00100000:2.0:1788361449.952930:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788361449.952938:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:3313:x1875232144196608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361449.952987:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:3313:x1875232144196608:12345-0@lo:400:kworker.0 Request processed in 49us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361449.952993:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788361449.953023:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144196736:0@lo:8:kworker.0 00000100:00100000:2.0:1788361449.953053:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361449.953069:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144196864:0@lo:8:kworker.0 00000100:00100000:2.0:1788361449.953114:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361449.953159:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144196608:0@lo:400:kworker.0 00000100:00100000:2.0:1788361449.953193:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144196736 00000100:00100000:2.0:1788361449.953197:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144196736 00000100:00100000:2.0:1788361449.953220:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144196864 00000100:00100000:2.0:1788361449.953224:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144196864 00000100:00100000:2.0:1788361449.953234:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361449.953239:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144196736:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788361449.953263:0:35980:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 839 last 0 00000020:00000080:2.0:1788361449.953290:0:35980:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d66145d9 00002000:00100000:2.0:1788361449.953319:0:35980:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9a8a8675f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788361449.953324:0:35980:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788361449.953327:0:35980:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788361449.953629:0:35980:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788361449.953651:0:35980:0:(import.c:65:import_set_state_nolock()) ffff9a8a86759800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361449.953691:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144196736:12345-0@lo:8:kworker.0 Request processed in 450us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361449.953697:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361449.953711:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361449.953715:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144196864:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788361449.953726:0:35980:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788361449.954922:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144197120:0@lo:400:kworker.0 00000100:00100000:3.0:1788361449.954973:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361449.955013:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144196992 00000100:00100000:3.0:1788361449.955019:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144196992 00000100:00100000:3.0:1788361449.955071:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144197120 00000100:00100000:3.0:1788361449.955113:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144197120 00000100:00100000:3.0:1788361449.955144:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361449.955150:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144196992:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361449.955152:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361449.955190:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144196992:12345-0@lo:400:kworker.0 Request processed in 39us (2362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361449.955883:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788361449.955905:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361449.955919:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144197120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361449.955973:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144197120:12345-0@lo:400:kworker.0 Request processed in 44us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361449.955979:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788361449.956022:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a52a00 x1875232144197120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361449.956056:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144197120:0@lo:400:kworker.0 00010000:00080000:3.0:1788361449.956108:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a52300 x1875232144196992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361449.956118:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144196992:0@lo:400:kworker.0 00010000:00080000:3.0:1788361449.956218:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a50e00 x1875232144196736/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361449.956227:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788361449.956240:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 7 00000100:00080000:3.0:1788361449.956265:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788361449.956277:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788361449.956279:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8a8a109800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788361449.956309:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788361449.956315:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144196736:0@lo:8:kworker.0 00000040:00080000:0.0:1788361449.956344:0:35367:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x22:0x0] index 5 count 2 00000004:00080000:3.0:1788361449.956364:0:35368:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0xa3:0x0] 00000100:00100000:3.0:1788361449.956381:0:35368:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35368:1875232144197504:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788361449.956409:0:35368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788361449.956413:0:35367:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361449.956417:0:35367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x28:0x0] at index 7 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788361449.956426:0:35368:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361449.956438:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144197248:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788361449.956451:0:35367:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788361449.956475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361449.956517:0:35982:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788361449.956524:0:35982:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788361449.956536:0:35983:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788361449.956543:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144197504 00000100:00100000:3.0:1788361449.956554:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144197504 00000100:00100000:3.0:1788361449.956582:0:35983:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788361449.956594:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144197248 00000100:00100000:3.0:1788361449.956596:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144197248 00000004:00080000:0.0:1788361449.956690:0:35367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 839971603258ns, next at 0ns, rc = 0 00000100:00080000:3.0:1788361449.956697:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361449.956708:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144197376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361449.956742:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361449.956858:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788361449.956866:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:35368:x1875232144197504:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788361449.958670:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144197376 00000100:00100000:1.0:1788361449.958683:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144197376 00000100:00100000:1.0:1788361449.958734:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788361449.958742:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3313:x1875232144197376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361449.958777:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361449.958850:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3313:x1875232144197376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361449.958857:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788361449.958899:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a50e00 x1875232144197376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788361449.958919:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144197376:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788361449.959663:0:36286:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788361449.959671:0:36286:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -30 00002000:02000040:3.0:1788361449.959676:0:36286:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:164 to 0x240000400:193) 00000100:00100000:2.0:1788361449.973129:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1875232144196864:12345-0@lo:8:kworker.0 Request processed in 19404us (20006us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788361449.973141:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361449.973180:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361449.973194:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144197248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788361449.973228:0:35980:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:163 count 1 00000100:00100000:2.0:1788361449.973516:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144197248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 328us (17040us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361449.973522:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788361449.974660:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361449.974667:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788361449.974672:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144196864:0@lo:8:kworker.0 00000004:00080000:2.0:1788361449.974725:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a835e1f80, transno 0 00000004:00080000:2.0:1788361449.974731:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a835e1f80/1, rc -2, transno 0 00000100:00100000:2.0:1788361449.974749:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144197248:0@lo:6:osp-syn-0-0.0 00000040:00080000:2.0:1788361449.975482:0:35367:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 6, last_idx 7 00000040:00080000:2.0:1788361449.975560:0:35367:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x22:0x0] at index 6 of catalog [0x1:0x2:0x0] 00002000:00010000:3.0:1788361449.985542:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.985556:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66145e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.985575:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=839s v=(0 0) 00010000:00010000:3.0:1788361449.985580:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.985587:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66145e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.985606:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66145e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.985628:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66145e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.985636:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66145e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.985655:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361449.986244:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.986251:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d66145e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.986260:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.986264:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.986268:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d66145e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.986277:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d66145e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.986286:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d66145e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.986294:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d66145e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.986328:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361449.986340:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361449.986346:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66145e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.986351:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361449.986355:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361449.986359:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66145e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.986369:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66145e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.986386:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66145e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.986393:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d66145e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.986409:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.986411:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.986412:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361449.986550:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361449.986557:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d66145e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.986565:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361449.986568:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d66145e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.986576:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d66145e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.986589:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d66145e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.986595:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d66145e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.986609:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361449.986615:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361449.986617:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361449.986622:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361449.986623:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361449.986889:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.986895:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d66145ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.986905:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbf:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.987221:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.987228:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d66145ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987239:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d66145ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987249:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d66145ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987256:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d66145ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987270:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361449.987278:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361449.987282:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d66145ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987289:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361449.987293:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d66145ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987313:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d66145ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987324:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d66145ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987342:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d66145ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987356:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.987358:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.987360:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361449.987755:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.987762:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d66145f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987771:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbe:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.987774:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.987778:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d66145f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987788:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d66145f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987797:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d66145f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987804:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d66145f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987819:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361449.987827:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361449.987838:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d66145f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987845:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361449.987849:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d66145f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987857:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d66145f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987868:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d66145f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987876:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d66145f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.987890:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.987892:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.987893:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361449.989499:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.989514:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d66145fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.989531:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbd:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.989536:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.989542:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d66145fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.989569:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d66145fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.989582:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d66145fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.989590:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d66145fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.989932:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361449.989938:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361449.989947:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d66145fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361449.989959:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361449.989964:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d66145fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361449.989974:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d66145fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361449.990000:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d66145fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361449.990013:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d66145fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361449.990106:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361449.990108:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361449.990110:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361449.991318:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.991328:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614603 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.991343:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbc:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.991348:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.991353:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.991368:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.991377:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.991396:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.991414:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361449.991427:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361449.991432:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.991440:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361449.991444:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.991454:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.991469:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614603 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.991478:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614603 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.991496:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.991498:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.991500:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361449.992588:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.992606:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661460a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.992619:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbb:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.992623:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.992628:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661460a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.992640:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661460a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.992650:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661460a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.992659:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661460a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.992680:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361449.993066:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.993072:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d6614611 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.993080:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xba:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.993083:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.993106:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d6614611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.993116:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d6614611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.993131:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d6614611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.994177:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361449.994188:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661460a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.994199:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361449.994204:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661460a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.994215:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661460a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.994238:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661460a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.994245:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d661460a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361449.994274:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361449.994275:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361449.994277:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.994683:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d6614611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.994709:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361449.995820:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.995833:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614618 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.995850:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb9:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.995855:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.995861:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.995875:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.995885:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.995897:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.995928:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361449.995940:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361449.995945:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d6614611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.995953:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361449.995957:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d6614611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.995967:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d6614611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.995985:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d6614611 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.995993:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d6614611 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.996012:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361449.996016:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.996023:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361449.996026:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.996045:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614618 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.996177:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614618 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.996185:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614618 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.996325:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.996329:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.996332:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.996360:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361449.997360:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.997370:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d661461f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.997488:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb8:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.997493:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.997498:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d661461f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.997511:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d661461f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.997521:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d661461f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.997536:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d661461f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.997552:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361449.997562:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361449.997567:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d661461f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.997573:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361449.997577:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d661461f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.997650:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d661461f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.997667:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d661461f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.997673:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d661461f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.997688:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.997690:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.997692:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361449.998664:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.998682:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614626 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.998695:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb7:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.998698:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.998703:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.998715:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.998724:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.998732:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.998746:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361449.998757:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361449.998762:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.998768:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361449.998773:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.998781:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.998800:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614626 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.998807:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614626 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.998823:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.998824:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.998826:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361449.999659:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361449.999668:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d661462d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.999679:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb6:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361449.999683:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361449.999688:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d661462d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.999701:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d661462d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.999711:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d661462d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.999719:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d661462d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.999748:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361449.999759:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361449.999765:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d661462d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.999773:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361449.999778:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d661462d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.999787:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d661462d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.999801:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d661462d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.999809:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d661462d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361449.999825:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.999827:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361449.999830:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361450.001928:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.001943:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614634 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.001959:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb5:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.001969:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.001975:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.001991:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.002001:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.002009:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.002025:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361450.003832:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361450.003844:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361450.003856:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1589400) 00002000:00010000:3.0:1788361450.003860:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361450.003862:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.003870:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661463b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361450.003878:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614634 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.003885:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb4:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.003890:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.003897:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661463b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361450.003904:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614634 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.003910:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661463b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361450.003915:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614634 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.003926:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661463b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.003942:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661463b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361450.003943:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361450.003947:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361450.003950:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.003964:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361450.004053:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.004061:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661463b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.004121:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.004127:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661463b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.004137:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661463b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.004151:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661463b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.004158:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661463b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.004180:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.004183:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.004185:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788361450.005872:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788361450.005969:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.006567:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614642 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.006586:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb3:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.006590:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.006596:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.006673:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.006686:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.006759:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.006785:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361450.007017:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.007025:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.007036:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.007041:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.007052:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614642 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.007081:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614642 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.007120:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f5c68ac/0xf6a94c97d6614642 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.007140:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.007143:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.007147:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361450.007617:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.007632:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d6614649 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.007642:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb2:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.007645:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.007650:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d6614649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.007660:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d6614649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.007669:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d6614649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.007676:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d6614649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.007707:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361450.007714:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361450.007722:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d6614649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361450.007731:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361450.007735:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d6614649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361450.007743:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d6614649 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361450.007756:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d6614649 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361450.007764:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083313025/0xf6a94c97d6614649 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361450.007783:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361450.007786:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361450.007788:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361450.008147:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.008154:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614650 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.008164:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb1:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.008167:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.008172:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.008181:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.008201:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.008210:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.008231:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361450.008250:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.008258:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.008266:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.008269:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.008278:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614650 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.008291:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614650 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.008308:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000031bb8470/0xf6a94c97d6614650 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.008341:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.008344:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.008347:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361450.009233:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.009242:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000556d3342/0xf6a94c97d6614657 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.009253:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb0:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.009256:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.009261:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000556d3342/0xf6a94c97d6614657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.009273:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000556d3342/0xf6a94c97d6614657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.009282:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000556d3342/0xf6a94c97d6614657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.009425:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000556d3342/0xf6a94c97d6614657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.009511:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361450.009981:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.009987:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d661465e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.009995:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.009998:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.010002:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d661465e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.010011:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d661465e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.010019:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d661465e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.010026:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d661465e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.010173:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361450.010181:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000556d3342/0xf6a94c97d6614657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.010190:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cee00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.010195:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000556d3342/0xf6a94c97d6614657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.010204:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000556d3342/0xf6a94c97d6614657 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.010220:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000556d3342/0xf6a94c97d6614657 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.010227:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000556d3342/0xf6a94c97d6614657 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.010248:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.010251:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d661465e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.010258:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.010268:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d661465e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.010282:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d661465e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.010430:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d661465e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.010439:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.010440:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.010443:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361450.010489:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.010500:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361450.010505:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d661465e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361450.011072:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.011079:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6614665 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.011202:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.011206:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.011212:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6614665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.011222:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6614665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.011232:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6614665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.011240:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6614665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.011296:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361450.011945:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.011953:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661466c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.011962:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xad:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.011966:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.011970:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661466c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.011980:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661466c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.011998:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661466c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.012006:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661466c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.012494:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361450.012502:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6614665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.012511:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.012515:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6614665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.012524:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6614665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.012540:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6614665 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.012548:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd55209b/0xf6a94c97d6614665 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.012578:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.012582:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661466c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.012588:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.012590:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661466c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.012598:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661466c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.012619:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661466c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.012627:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.012629:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.012631:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.013059:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361450.013065:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd96202f/0xf6a94c97d661466c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361450.013922:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.013930:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d6614673 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.013942:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xac:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.013946:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.013951:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d6614673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.013963:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d6614673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.013972:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d6614673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.013991:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d6614673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.014049:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.014056:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d6614673 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.014064:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.014069:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d6614673 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.014111:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d6614673 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.014126:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d6614673 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.014135:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.014137:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.014139:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361450.014205:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.014245:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361450.014251:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000616faace/0xf6a94c97d6614673 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361450.014850:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.014857:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d661467a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.014867:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xab:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.014870:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.014875:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d661467a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.014885:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d661467a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.014893:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d661467a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.014900:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d661467a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.014928:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361450.014938:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361450.014942:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d661467a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.015039:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361450.015043:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d661467a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.015053:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d661467a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.015066:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d661467a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.015074:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac5f558/0xf6a94c97d661467a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.015118:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.015121:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.015123:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788361450.016538:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.016549:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6614681 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.016563:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaa:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.016573:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.016578:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6614681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.016591:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6614681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.016601:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6614681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.016620:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6614681 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.016670:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788361450.017236:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.017242:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614688 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.017252:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa9:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.017255:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.017259:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.017268:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.017277:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.017426:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.017665:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788361450.017672:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6614681 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.017680:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.017685:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6614681 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.017701:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6614681 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.017717:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6614681 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.017724:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e1095dc/0xf6a94c97d6614681 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.017751:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.017754:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.017759:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.017762:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.017768:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614688 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.017775:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614688 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.017781:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.017782:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.017783:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.017878:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361450.017883:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6614688 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361450.018335:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.018342:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661468f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.018350:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa8:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.018354:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.018369:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661468f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.018380:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661468f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.018388:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661468f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.018395:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661468f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.018601:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.018675:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661468f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.018683:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.018686:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661468f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.018764:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661468f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.018776:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661468f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.018784:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.018786:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.018788:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.018847:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361450.018852:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d661468f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361450.019304:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.019311:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6614696 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.019320:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa7:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.019323:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.019328:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6614696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.019336:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6614696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.019343:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6614696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.019350:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6614696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.019510:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.019516:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6614696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.019524:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.019528:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6614696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.019536:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6614696 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.019548:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6614696 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.019555:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.019557:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.019558:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.019683:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361450.019689:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6614696 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361450.020157:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.020163:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d79ee19a/0xf6a94c97d661469d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.020172:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa6:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.020175:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.020180:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d79ee19a/0xf6a94c97d661469d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.020189:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d79ee19a/0xf6a94c97d661469d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.020197:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d79ee19a/0xf6a94c97d661469d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.020204:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d79ee19a/0xf6a94c97d661469d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.020441:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.020447:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d79ee19a/0xf6a94c97d661469d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.020455:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcae00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.020459:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d79ee19a/0xf6a94c97d661469d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.020467:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d79ee19a/0xf6a94c97d661469d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.020480:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d79ee19a/0xf6a94c97d661469d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.020488:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.020490:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.020491:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.020552:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361450.020557:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d79ee19a/0xf6a94c97d661469d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361450.021120:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.021126:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c62114b7/0xf6a94c97d66146a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.021145:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa5:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.021148:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.021153:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c62114b7/0xf6a94c97d66146a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.021162:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c62114b7/0xf6a94c97d66146a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.021171:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c62114b7/0xf6a94c97d66146a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.021179:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c62114b7/0xf6a94c97d66146a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.021224:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.021230:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c62114b7/0xf6a94c97d66146a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.021238:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.021242:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c62114b7/0xf6a94c97d66146a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.021250:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c62114b7/0xf6a94c97d66146a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.021273:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c62114b7/0xf6a94c97d66146a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.021281:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.021283:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.021416:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.021475:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361450.021480:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c62114b7/0xf6a94c97d66146a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361450.022172:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361450.022179:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d66146ab lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.022190:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa4:0x0].0x0 since=840s v=(0 0) 00010000:00010000:3.0:1788361450.022194:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361450.022198:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d66146ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.022221:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d66146ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.022231:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d66146ab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361450.022239:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d66146ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.022424:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361450.022431:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d66146ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.022439:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361450.022443:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d66146ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.022451:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d66146ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.022464:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d66146ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.022473:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.022475:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361450.022477:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361450.022512:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788361450.022517:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002eaf90f2/0xf6a94c97d66146ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361450.022679:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788361450.022904:0:36286:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:163 00000100:00100000:3.0:1788361450.023040:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:35368:x1875232144197504:12345-0@lo:5:osp-pre-0-0.0 Request processed in 66171us (66625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361450.023050:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361450.023243:0:35368:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35368:1875232144197504:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788361450.023258:0:35368:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0xc1:0x0] from OST, last_created [0x240000400:0xc1:0x0]last_used is [0x240000400:0xa3:0x0] 00000100:00100000:3.0:1788361450.023599:0:35368:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35368:1875232144197632:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788361450.023766:0:35368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361450.023843:0:35368:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361450.023892:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144197632 00000100:00100000:2.0:1788361450.023898:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144197632 00000100:00100000:3.0:1788361450.024037:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361450.024046:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:35368:x1875232144197632:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788361450.024128:0:35983:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 194 00000100:00100000:2.0:1788361450.029868:0:35368:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:35368:1875232144197632:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788361450.029886:0:35368:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0xc1:0x0]-[0x240000400:0xe1:0x0] 00000100:00100000:3.0:1788361450.029934:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:35368:x1875232144197632:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5887us (6165us total) trans 30064771073 rc 0/0 00000100:00100000:3.0:1788361450.029953:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:02000400:0.0:1788361450.618174:0:36351:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788361450.912242:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361451.168426:0:35380:0:(llog.c:805:llog_process_thread()) index: 6, lh_last_idx: 6 synced_idx: 6 lgh_last_idx: 6 00000040:00080000:2.0:1788361451.168439:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361451.169677:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x26:0x0] index 2 count 1 00000040:00080000:2.0:1788361451.169764:0:35380:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x26:0x0] at index 6 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361451.169881:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 6 count 1 00010000:00010000:2.0:1788361451.938463:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788361452.248452:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788361452.248474:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771073 is committed 00010000:00010000:2.0:1788361452.960708:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361453.985212:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788361454.268759:0:36653:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788361454.268763:0:36653:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788361454.268863:0:36653:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9a8ac1c6e000 00000020:01000004:0.0:1788361454.268879:0:36653:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788361454.268893:0:36653:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788361454.268908:0:36653:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9a8a90bf19c0) 00000020:00000080:0.0:1788361454.268936:0:36653:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788361454.286443:0:36653:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788361454.286742:0:36653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788361454.287873:0:36653:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788361454.288255:0:36653:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788361454.288555:0:36653:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xf:0x0] (8/32) 00100000:10000000:1.0:1788361454.288986:0:36653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 589: rc = 0 00100000:10000000:1.0:1788361454.289082:0:36653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 589: rc = 0 00100000:10000000:1.0:1788361454.289339:0:36653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 589: rc = 0 00100000:10000000:1.0:1788361454.289849:0:36653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 776: rc = 0 00100000:10000000:1.0:1788361454.290333:0:36653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 776: rc = 0 00100000:10000000:1.0:1788361454.290584:0:36653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 776: rc = 0 00100000:10000000:1.0:1788361454.290842:0:36653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 776: rc = 0 00100000:10000000:1.0:1788361454.293490:0:36653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 776: rc = 0 00100000:10000000:1.0:1788361454.293801:0:36653:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 776: rc = 0 00000020:00000080:1.0:1788361454.294495:0:36653:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788361454.294510:0:36653:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788361454.294525:0:36653:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d66146b9 00000020:01000004:1.0:1788361454.294535:0:36653:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788361454.294560:0:36653:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788361454.294565:0:36653:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788361454.294571:0:36653:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788361454.294595:0:36653:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788361454.294600:0:36653:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788361454.303411:0:36653:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788361454.303460:0:36653:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.160@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788361454.303465:0:36653:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788361454.303467:0:36653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788361454.303469:0:36653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361454.303470:0:36653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361454.303471:0:36653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361454.303473:0:36653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361454.303474:0:36653:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361454.303476:0:36653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361454.303477:0:36653:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361454.303482:0:36653:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788361454.303484:0:36653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788361454.303486:0:36653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788361454.303487:0:36653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361454.303488:0:36653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361454.303489:0:36653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361454.303490:0:36653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361454.303491:0:36653:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361454.303493:0:36653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361454.303494:0:36653:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788361454.303541:0:36653:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788361454.303566:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144197760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788361454.303650:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361454.303796:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361454.303867:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144197760 00000100:00100000:0.0:1788361454.303878:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144197760 00000100:00100000:0.0:1788361454.304004:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788361454.304016:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:36653:x1875232144197760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788361454.304056:0:35339:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788361454.304059:0:35339:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788361454.304064:0:35339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788361454.335720:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:36653:x1875232144197760:12345-0@lo:253:mount.lustre.0 Request processed in 31693us (32056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361454.335738:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788361454.335757:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144197760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788361454.335776:0:36653:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788361454.335780:0:36653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788361454.335782:0:36653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788361454.335783:0:36653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788361454.335785:0:36653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788361454.335786:0:36653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788361454.335787:0:36653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788361454.335789:0:36653:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788361454.335791:0:36653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788361454.335792:0:36653:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788361454.335817:0:36653:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9a8ac1c6e000 from lustre-OST0001 10000000:01000000:1.0:1788361454.335850:0:36653:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788361454.335854:0:36653:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788361454.335864:0:36653:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9a8984a5cd40 local copy 00010000:00010000:1.0:1788361454.335994:0:36653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614458 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361454.336546:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144197888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361454.336586:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.336668:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361454.336740:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144197888 00000100:00100000:3.0:1788361454.336748:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144197888 00000100:00100000:3.0:1788361454.336803:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788361454.336814:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:36653:x1875232144197888:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361454.337136:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:36653:x1875232144197888:12345-0@lo:501:mount.lustre.0 Request processed in 324us (549us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361454.337143:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788361454.337257:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144197888:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788361454.337288:0:36653:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788361454.337393:0:36653:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788361454.337408:0:36653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614458 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.337416:0:36653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8ab65cf200/0xf6a94c97d6614451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614458 expref: -99 pid: 35328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361454.337440:0:36653:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9a8ac1c6e000 10000000:01000000:0.0:1788361454.337443:0:36653:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788361454.337448:0:36653:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788361454.337451:0:36653:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361454.337456:0:36653:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788361454.337460:0:36653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788361454.337489:0:36653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d66146c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.337512:0:36653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d66146c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.337522:0:36653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d66146c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361454.337534:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361454.337561:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.337592:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361454.337752:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144198016 00000100:00100000:2.0:1788361454.337756:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144198016 00000100:00100000:2.0:1788361454.337787:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788361454.337794:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:36653:x1875232144198016:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361454.337814:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361454.337829:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d66146c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66146c0 expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.337850:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d66146c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66146c0 expref: 17 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.337857:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1fc00/0xf6a94c97d66146c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66146c0 expref: 17 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.337870:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1fc00, rc 0) 00000100:00100000:2.0:1788361454.337958:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:36653:x1875232144198016:12345-0@lo:101:mount.lustre.0 Request processed in 161us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361454.337965:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788361454.337990:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361454.338003:0:36653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d66146c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66146c7 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.338013:0:36653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d66146c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66146c7 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361454.338748:0:36653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 11 count 11 00000040:00080000:0.0:1788361454.339743:0:36653:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361454.339997:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:0.0:1788361454.340041:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 128 off8544 00000040:00080000:0.0:1788361454.340075:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 112 off8656 00000040:00080000:0.0:1788361454.340190:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8880 00000040:00080000:0.0:1788361454.340229:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 224 off9104 00000040:00080000:0.0:1788361454.340265:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 80 off9184 00000040:00080000:0.0:1788361454.340330:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9408 00000040:00080000:0.0:1788361454.340367:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 224 off9632 00000040:00080000:0.0:1788361454.340416:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 120 off9752 00000040:00080000:0.0:1788361454.340499:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off9976 00000040:00080000:0.0:1788361454.340516:0:36653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 10 count 11 00000100:00100000:0.0:1788361454.340620:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361454.340697:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.340950:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361454.340997:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144198144 00000100:00100000:3.0:1788361454.341006:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144198144 00000100:00100000:3.0:1788361454.341117:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788361454.341128:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:36653:x1875232144198144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361454.341531:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:36653:x1875232144198144:12345-0@lo:501:mount.lustre.0 Request processed in 405us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361454.341541:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788361454.341654:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361454.341694:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198272:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361454.341740:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361454.342123:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144198272 00000100:00100000:2.0:1788361454.342139:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144198272 00000100:00100000:0.0:1788361454.342144:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361454.342188:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788361454.342198:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:36653:x1875232144198272:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361454.342775:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:36653:x1875232144198272:12345-0@lo:503:mount.lustre.0 Request processed in 577us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361454.342784:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788361454.342859:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198272:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788361454.343677:0:36653:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361454.343763:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361454.343818:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.343858:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361454.343896:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144198400 00000100:00100000:2.0:1788361454.343903:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144198400 00000100:00100000:1.0:1788361454.343967:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788361454.343982:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:36653:x1875232144198400:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361454.344611:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:36653:x1875232144198400:12345-0@lo:502:mount.lustre.0 Request processed in 633us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361454.344622:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788361454.344719:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788361454.344988:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:2.0:1788361454.345048:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 128 off8544 00000040:00080000:2.0:1788361454.345141:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 112 off8656 00000040:00080000:2.0:1788361454.345198:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8880 00000040:00080000:2.0:1788361454.345238:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 224 off9104 00000040:00080000:2.0:1788361454.345285:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 80 off9184 00000040:00080000:2.0:1788361454.345333:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9408 00000040:00080000:2.0:1788361454.345369:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 224 off9632 00000040:00080000:2.0:1788361454.345418:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 120 off9752 00000100:00100000:2.0:1788361454.345458:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788361454.345509:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361454.345543:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361454.345597:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144198528 00000100:00100000:3.0:1788361454.345603:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144198528 00000100:00100000:3.0:1788361454.345643:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788361454.345650:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:36653:x1875232144198528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361454.345797:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:36653:x1875232144198528:12345-0@lo:502:mount.lustre.0 Request processed in 147us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361454.345810:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788361454.345838:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198528:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361454.346124:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off9976 00000040:00080000:3.0:1788361454.346137:0:36653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788361454.354201:0:36654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788361454.354218:0:36654:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788361454.354227:0:36654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788361454.354230:0:36654:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788361454.354238:0:36654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788361454.354257:0:36654:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9a8a84f10000) 00000020:00000080:3.0:1788361454.354299:0:36654:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788361454.354308:0:36654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788361454.354393:0:36654:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8ac1c6e000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788361454.354403:0:36654:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788361454.354412:0:36654:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf6a94c97d66146d5 00010000:00010000:3.0:1788361454.359780:0:36654:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788361454.362235:0:36654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 25769803784 00080000:10000000:2.0:1788361454.364849:0:36654:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x10:0x0] (8/8/4) registered 00000020:00000080:2.0:1788361454.371755:0:36654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788361454.371774:0:36654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361454.371783:0:36654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.371786:0:36654:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788361454.371796:0:36654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361454.371801:0:36654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.371802:0:36654:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788361454.371806:0:36654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788361454.371808:0:36654:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788361454.371810:0:36654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361454.371813:0:36654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.371814:0:36654:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788361454.371816:0:36654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361454.371818:0:36654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.371820:0:36654:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788361454.371823:0:36654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788361454.372024:0:36654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361454.372029:0:36654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.372030:0:36654:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788361454.372034:0:36654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 11 count 11 00000020:01000000:0.0:1788361454.372541:0:36653:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788361454.372574:0:36653:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788361454.372605:0:36653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d66146c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66146c7 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.372618:0:36653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985965a00/0xf6a94c97d66146c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66146c7 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361454.372625:0:36653:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8ac1c6e000 from 1 10000000:01000000:0.0:1788361454.372628:0:36653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361454.372671:0:36653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.372688:0:36653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.372701:0:36653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361454.372730:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198656:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361454.372814:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361454.373376:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144198656 00000100:00100000:2.0:1788361454.373389:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144198656 00000100:00100000:2.0:1788361454.373454:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788361454.373465:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:36653:x1875232144198656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361454.373487:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361454.373504:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66146e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66146dc expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.373531:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66146e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66146dc expref: 18 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.373543:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66146e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66146dc expref: 18 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.373554:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e800, rc 0) 00000100:00100000:2.0:1788361454.373605:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144198656:12345-0@lo:101:mount.lustre.0 Request processed in 142us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361454.373619:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788361454.374050:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361454.374082:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198656:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788361454.374116:0:36653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.374125:0:36653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361454.375194:0:36653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 10 count 10 00000040:00080000:0.0:1788361454.375677:0:36653:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788361454.376046:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].1, 224 off8416 00000040:00080000:0.0:1788361454.376147:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].2, 112 off8528 00000040:00080000:0.0:1788361454.376209:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].3, 224 off8752 00000040:00080000:0.0:1788361454.376266:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].4, 224 off8976 00000040:00080000:0.0:1788361454.376324:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].5, 112 off9088 00000040:00080000:0.0:1788361454.376382:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].6, 224 off9312 00000040:00080000:0.0:1788361454.376468:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].7, 224 off9536 00000040:00080000:0.0:1788361454.376527:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].8, 128 off9664 00000040:00080000:0.0:1788361454.376636:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x25:0x0].9, 224 off9888 00000040:00080000:0.0:1788361454.376647:0:36653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 9 count 10 00000100:00100000:0.0:1788361454.376759:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361454.376842:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.376961:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361454.377220:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144198784 00000100:00100000:3.0:1788361454.377230:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144198784 00000100:00100000:3.0:1788361454.377344:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788361454.377356:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144198784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361454.377624:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144198784:12345-0@lo:501:mount.lustre.0 Request processed in 269us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361454.377631:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788361454.377723:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788361454.377772:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788361454.377818:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.377990:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361454.378034:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144198912 00000100:00100000:1.0:1788361454.378039:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144198912 00000100:00100000:1.0:1788361454.378073:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788361454.378081:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144198912:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788361454.378374:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144198912:12345-0@lo:503:mount.lustre.0 Request processed in 294us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361454.378381:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788361454.378541:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144198912:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788361454.379542:0:36653:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788361454.379650:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361454.379712:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.379803:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361454.379935:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144199040 00000100:00100000:3.0:1788361454.379942:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144199040 00000100:00100000:3.0:1788361454.380042:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788361454.380053:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144199040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361454.380357:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144199040:12345-0@lo:502:mount.lustre.0 Request processed in 306us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361454.380372:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788361454.380465:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361454.380779:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].1, 224 off8416 00000040:00080000:0.0:1788361454.380834:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].2, 112 off8528 00000040:00080000:0.0:1788361454.380899:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].3, 224 off8752 00000040:00080000:0.0:1788361454.380937:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].4, 224 off8976 00000040:00080000:0.0:1788361454.380972:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].5, 112 off9088 00000040:00080000:0.0:1788361454.381027:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].6, 224 off9312 00000040:00080000:0.0:1788361454.381077:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].7, 224 off9536 00000040:00080000:0.0:1788361454.381190:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].8, 128 off9664 00000100:00100000:0.0:1788361454.381234:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361454.381297:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.381570:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361454.381637:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144199168 00000100:00100000:1.0:1788361454.381645:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144199168 00000100:00100000:1.0:1788361454.381694:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788361454.381704:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144199168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361454.382015:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144199168:12345-0@lo:502:mount.lustre.0 Request processed in 312us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361454.382023:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788361454.382232:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788361454.382364:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x26:0x0].9, 224 off9888 00000040:00080000:0.0:1788361454.382398:0:36653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788361454.385419:0:36658:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361454.385438:0:36658:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.385441:0:36658:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788361454.385450:0:36658:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8ac1c6e000 00000020:00000080:2.0:1788361454.385454:0:36658:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788361454.385465:0:36658:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361454.385468:0:36658:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.385469:0:36658:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788361454.385472:0:36658:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361454.385474:0:36658:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.385476:0:36658:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788361454.385479:0:36658:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9a8ac1c6e000 00000020:00000080:2.0:1788361454.385481:0:36658:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788361454.385560:0:36658:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361454.385564:0:36658:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.385566:0:36658:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788361454.385569:0:36658:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788361454.385571:0:36658:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.385573:0:36658:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788361454.385576:0:36658:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9a8ac1c6e000 00000020:00000080:2.0:1788361454.385579:0:36658:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788361454.385614:0:36658:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788361454.385617:0:36658:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788361454.385619:0:36658:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788361454.385623:0:36658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x26:0x0] index 10 count 10 00000020:01000000:0.0:1788361454.387125:0:36653:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788361454.387176:0:36653:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361454.387200:0:36653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.387215:0:36653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361454.387285:0:36653:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788361454.387289:0:36653:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9a8ac1c6e000 10000000:01000000:0.0:1788361454.387293:0:36653:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9a8ac1c6e000 10000000:01000000:0.0:1788361454.387298:0:36653:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788361454.387304:0:36653:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9a8ac1c6e000 from 1 10000000:01000000:0.0:1788361454.387307:0:36653:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788361454.387353:0:36653:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66146ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.387362:0:36653:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66146ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.387374:0:36653:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66146ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361454.387406:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788361454.387495:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.387547:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361454.387575:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144199296 00000100:00100000:1.0:1788361454.387586:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144199296 00000100:00100000:1.0:1788361454.387657:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788361454.387670:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144199296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788361454.387685:0:35340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361454.387702:0:35340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841ef400/0xf6a94c97d66146f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d66146ea expref: -99 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361454.387732:0:35340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841ef400/0xf6a94c97d66146f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d66146ea expref: 19 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361454.387744:0:35340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841ef400/0xf6a94c97d66146f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66146ea expref: 19 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361454.387753:0:35340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef400, rc 0) 00000100:00100000:1.0:1788361454.387807:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:36653:x1875232144199296:12345-0@lo:101:mount.lustre.0 Request processed in 139us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361454.387816:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788361454.387933:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788361454.387950:0:36653:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66146ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66146f1 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.387960:0:36653:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66146ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d66146f1 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361454.388701:0:36653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 42 count 42 00000040:00080000:2.0:1788361454.392408:0:36653:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361454.392793:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].1, 224 off8416 00000040:00080000:2.0:1788361454.392843:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].2, 120 off8536 00000040:00080000:2.0:1788361454.393011:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].3, 168 off8704 00000040:00080000:2.0:1788361454.393082:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].4, 224 off8928 00000040:00080000:2.0:1788361454.393151:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].5, 224 off9152 00000040:00080000:2.0:1788361454.393217:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].6, 120 off9272 00000040:00080000:2.0:1788361454.393259:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].7, 168 off9440 00000040:00080000:2.0:1788361454.393313:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].8, 224 off9664 00000040:00080000:2.0:1788361454.393364:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].9, 224 off9888 00000040:00080000:2.0:1788361454.393403:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].10, 120 off10008 00000040:00080000:2.0:1788361454.393437:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].11, 224 off10232 00000040:00080000:2.0:1788361454.393485:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].12, 224 off10456 00000040:00080000:2.0:1788361454.393521:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].13, 88 off10544 00000040:00080000:2.0:1788361454.393556:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].14, 128 off10672 00000040:00080000:2.0:1788361454.393603:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].15, 144 off10816 00000040:00080000:2.0:1788361454.393640:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].16, 160 off10976 00000040:00080000:2.0:1788361454.393672:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].17, 224 off11200 00000040:00080000:2.0:1788361454.393721:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].18, 224 off11424 00000040:00080000:2.0:1788361454.393759:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].19, 80 off11504 00000040:00080000:2.0:1788361454.395976:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].20, 224 off11728 00000040:00080000:2.0:1788361454.396219:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].21, 224 off11952 00000040:00080000:2.0:1788361454.396291:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].22, 88 off12040 00000040:00080000:2.0:1788361454.396341:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].23, 128 off12168 00000040:00080000:2.0:1788361454.396407:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].24, 144 off12312 00000040:00080000:2.0:1788361454.396456:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].25, 128 off12440 00000040:00080000:2.0:1788361454.396511:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].26, 224 off12664 00000040:00080000:2.0:1788361454.396594:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].27, 224 off12888 00000040:00080000:2.0:1788361454.396652:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].28, 80 off12968 00000040:00080000:2.0:1788361454.396718:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].29, 224 off13192 00000040:00080000:2.0:1788361454.396795:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].30, 224 off13416 00000040:00080000:2.0:1788361454.396854:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].31, 88 off13504 00000040:00080000:3.0:1788361454.401191:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].32, 128 off13632 00000040:00080000:3.0:1788361454.401257:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].33, 144 off13776 00000040:00080000:3.0:1788361454.401381:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].34, 128 off13904 00000040:00080000:3.0:1788361454.401444:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].35, 224 off14128 00000040:00080000:3.0:1788361454.401514:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].36, 224 off14352 00000040:00080000:3.0:1788361454.401566:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].37, 80 off14432 00000040:00080000:3.0:1788361454.401622:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].38, 224 off14656 00000040:00080000:3.0:1788361454.402025:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].39, 224 off14880 00000040:00080000:3.0:1788361454.402111:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].40, 120 off15000 00000040:00080000:3.0:1788361454.402260:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x27:0x0].41, 224 off15224 00000040:00080000:3.0:1788361454.402284:0:36653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 41 count 42 00000100:00100000:3.0:1788361454.402442:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361454.402538:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361454.402604:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144199424 00000100:00100000:3.0:1788361454.402613:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144199424 00000100:00100000:3.0:1788361454.402679:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788361454.402690:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:36653:x1875232144199424:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361454.402962:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:36653:x1875232144199424:12345-0@lo:501:mount.lustre.0 Request processed in 272us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361454.403437:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788361454.403498:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361454.403532:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788361454.403578:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199552:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361454.403619:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361454.403649:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144199552 00000100:00100000:3.0:1788361454.403658:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144199552 00000100:00100000:3.0:1788361454.403686:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788361454.403696:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:36653:x1875232144199552:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788361454.403890:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:36653:x1875232144199552:12345-0@lo:503:mount.lustre.0 Request processed in 197us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361454.403898:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788361454.403931:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361454.403943:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199552:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788361454.405006:0:36653:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788361454.405171:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361454.405235:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361454.405289:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144199680 00000100:00100000:3.0:1788361454.405295:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144199680 00000100:00100000:3.0:1788361454.405343:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788361454.405352:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:36653:x1875232144199680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788361454.405595:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:36653:x1875232144199680:12345-0@lo:502:mount.lustre.0 Request processed in 243us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361454.405602:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788361454.405654:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361454.405677:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361454.406028:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].1, 224 off8416 00000040:00080000:0.0:1788361454.406331:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].2, 120 off8536 00000040:00080000:0.0:1788361454.406387:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].3, 168 off8704 00000040:00080000:0.0:1788361454.406448:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].4, 224 off8928 00000040:00080000:0.0:1788361454.406504:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].5, 224 off9152 00000040:00080000:0.0:1788361454.406581:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].6, 120 off9272 00000040:00080000:0.0:1788361454.406622:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].7, 168 off9440 00000040:00080000:0.0:1788361454.406655:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].8, 224 off9664 00000040:00080000:0.0:1788361454.406722:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].9, 224 off9888 00000040:00080000:0.0:1788361454.406762:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].10, 120 off10008 00000040:00080000:0.0:1788361454.406793:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].11, 224 off10232 00000040:00080000:0.0:1788361454.406833:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].12, 224 off10456 00000040:00080000:0.0:1788361454.406879:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].13, 88 off10544 00000040:00080000:0.0:1788361454.406914:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].14, 128 off10672 00000040:00080000:0.0:1788361454.406968:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].15, 144 off10816 00000040:00080000:0.0:1788361454.407005:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].16, 160 off10976 00000040:00080000:0.0:1788361454.407038:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].17, 224 off11200 00000040:00080000:0.0:1788361454.407111:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].18, 224 off11424 00000040:00080000:0.0:1788361454.407157:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].19, 80 off11504 00000040:00080000:0.0:1788361454.407196:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].20, 224 off11728 00000040:00080000:0.0:1788361454.407259:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].21, 224 off11952 00000040:00080000:0.0:1788361454.407311:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].22, 88 off12040 00000040:00080000:0.0:1788361454.407352:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].23, 128 off12168 00000040:00080000:0.0:1788361454.407410:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].24, 144 off12312 00000040:00080000:0.0:1788361454.407475:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].25, 128 off12440 00000040:00080000:0.0:1788361454.407516:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].26, 224 off12664 00000040:00080000:0.0:1788361454.407596:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].27, 224 off12888 00000040:00080000:0.0:1788361454.407657:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].28, 80 off12968 00000040:00080000:0.0:1788361454.407700:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].29, 224 off13192 00000040:00080000:0.0:1788361454.407770:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].30, 224 off13416 00000040:00080000:0.0:1788361454.407825:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].31, 88 off13504 00000040:00080000:0.0:1788361454.407886:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].32, 128 off13632 00000040:00080000:0.0:1788361454.407956:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].33, 144 off13776 00000040:00080000:0.0:1788361454.408045:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].34, 128 off13904 00000040:00080000:0.0:1788361454.408122:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].35, 224 off14128 00000040:00080000:0.0:1788361454.408169:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].36, 224 off14352 00000040:00080000:0.0:1788361454.408227:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].37, 80 off14432 00000040:00080000:0.0:1788361454.408315:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].38, 224 off14656 00000040:00080000:0.0:1788361454.408412:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].39, 224 off14880 00000040:00080000:0.0:1788361454.408461:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].40, 120 off15000 00000100:00100000:0.0:1788361454.408526:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788361454.408626:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.408749:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361454.410845:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144199808 00000100:00100000:1.0:1788361454.410864:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144199808 00000100:00100000:1.0:1788361454.410935:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788361454.410947:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:36653:x1875232144199808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788361454.411347:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:36653:x1875232144199808:12345-0@lo:502:mount.lustre.0 Request processed in 402us (2720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361454.411366:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788361454.411893:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144199808:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788361454.412045:0:36653:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x28:0x0].41, 224 off15224 00000040:00080000:3.0:1788361454.412076:0:36653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788361454.413493:0:36663:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788361454.413513:0:36663:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9a8a84f13380) 00000020:00000080:3.0:1788361454.413549:0:36663:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788361454.413743:0:36663:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9a8ac1c6e000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788361454.413748:0:36663:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9a8ac1c6e000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788361454.413752:0:36663:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9a8ac1c6e000 3 00010000:00080000:3.0:1788361454.413784:0:36663:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9a898609b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1788361454.417592:0:36663:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788361454.417725:0:36663:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788361454.417771:0:36663:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788361454.417786:0:36663:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf6a94c97d66146ff 00000100:00080000:3.0:1788361454.417800:0:36663:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788361454.417806:0:36663:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9a898609b000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1788361454.417849:0:36663:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8ac0a50000 x1875232144199936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788361454.417916:0:36663:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788361454.418018:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144199936:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788361454.418192:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361454.418277:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144199936 00000100:00100000:3.0:1788361454.418285:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144199936 00000100:00100000:3.0:1788361454.418323:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361454.418332:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1875232144199936:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788361454.418359:0:35345:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 844 last 0 00000020:00000080:3.0:1788361454.418406:0:35345:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf6a94c97d6614706 00000004:00100000:3.0:1788361454.418421:0:35345:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788361454.418460:0:35345:0:(import.c:65:import_set_state_nolock()) ffff9a8a86759000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788361454.418524:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875232144199936:12345-0@lo:38:llog_process_th.0 Request processed in 192us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361454.418532:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788361454.418584:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8ac0a50000 x1875232144199936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788361464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361454.418597:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361454.418605:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 7 00000100:00080000:2.0:1788361454.418615:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788361454.418621:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788361454.418624:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a898609b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788361454.418632:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1875232144199936:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788361454.418677:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361454.418683:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788361454.418686:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361454.418691:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 839 00000100:00080000:0.0:1788361454.418695:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788361454.418699:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8abc48a800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1788361454.418705:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361454.418720:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144200064:0@lo:400:kworker.0 00000100:00100000:0.0:1788361454.418731:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a835e1880 x1875232144200192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788361454.418760:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361454.418853:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144200064 00000100:00100000:2.0:1788361454.418858:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144200064 00000100:00100000:3.0:1788361454.418884:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144200320:0@lo:400:kworker.0 00000100:00100000:3.0:1788361454.418919:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361454.418924:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788361454.418933:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144200064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361454.418945:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361454.418953:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144200448:0@lo:400:kworker.0 00000100:00100000:3.0:1788361454.418986:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361454.418993:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144200064:12345-0@lo:400:kworker.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361454.419002:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361454.419019:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144200320 00000100:00100000:3.0:1788361454.419023:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144200320 00000100:00100000:3.0:1788361454.419045:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144200448 00000100:00080000:2.0:1788361454.419045:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361454.419068:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771073 gen 2 00000100:00100000:2.0:1788361454.419080:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144200064:0@lo:400:kworker.0 00000100:00100000:2.0:1788361454.419125:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144200192:0@lo:8:kworker.0 00000100:00100000:2.0:1788361454.419152:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361454.419177:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144200448 00000100:00100000:2.0:1788361454.419183:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144200192 00000100:00100000:2.0:1788361454.419188:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144200192 00000100:00100000:3.0:1788361454.419212:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788361454.419221:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144200320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361454.419222:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361454.419233:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144200192:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788361454.419304:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144200192:12345-0@lo:8:kworker.0 Request processed in 71us (151us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788361454.419313:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144200320:12345-0@lo:400:kworker.0 Request processed in 92us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361454.419314:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361454.419325:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788361454.419339:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361454.419344:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788361454.419351:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144200448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361454.419359:0:3310:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788361454.419366:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788361454.419371:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788361454.419375:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144200192:0@lo:8:kworker.0 00000100:00100000:3.0:1788361454.419383:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144200448:12345-0@lo:400:kworker.0 Request processed in 31us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361454.419389:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:3.0:1788361454.419559:0:36663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x28:0x0] index 42 count 42 00010000:00080000:0.0:1788361454.419697:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a835e3480 x1875232144200320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361454.419709:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144200320:0@lo:400:kworker.0 00010000:00080000:0.0:1788361454.419736:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9a8a835e0700 x1875232144200448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361454.419746:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144200448:0@lo:400:kworker.0 00000020:01000000:2.0:1788361454.419757:0:36653:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788361454.419795:0:36653:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788361454.419815:0:36653:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66146ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66146f1 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.419827:0:36653:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8985965c00/0xf6a94c97d66146ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d66146f1 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788361454.419936:0:36653:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788361454.419939:0:36653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361454.419941:0:36653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361454.419943:0:36653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361454.419944:0:36653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361454.419946:0:36653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361454.419948:0:36653:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361454.419950:0:36653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361454.419952:0:36653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361454.419957:0:36653:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788361454.419964:0:36653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788361454.419966:0:36653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361454.419967:0:36653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361454.419968:0:36653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361454.419969:0:36653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361454.419971:0:36653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361454.419972:0:36653:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361454.419973:0:36653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361454.419974:0:36653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788361454.419994:0:36653:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788361454.420008:0:36653:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144200576:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788361454.420265:0:36653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361454.420309:0:36653:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361454.420449:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144200576 00000100:00100000:2.0:1788361454.420455:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144200576 00000100:00100000:2.0:1788361454.420492:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788361454.420502:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:36653:x1875232144200576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788361454.420530:0:35339:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788361454.420547:0:35339:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788361454.443521:0:35339:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788361454.443545:0:35339:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788361454.443605:0:35361:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788361454.443611:0:35361:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788361454.443636:0:35361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.443656:0:35361:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8ab65cfc00/0xf6a94c97d66145d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66145cb expref: 19 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.443690:0:35361:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.443736:0:35361:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8ab65cfc00/0xf6a94c97d66145d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66145cb expref: 19 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.443750:0:35361:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8ab65cfc00/0xf6a94c97d66145d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66145cb expref: 19 pid: 35340 timeout: 944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361454.443769:0:35361:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35361:1875232144200704:0@lo:104: 00000100:00100000:0.0:1788361454.443851:0:35361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361454.443912:0:35361:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361454.444554:0:35330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144200704 00000100:00100000:2.0:1788361454.444565:0:35330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144200704 00000100:00100000:2.0:1788361454.444629:0:35330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361454.444640:0:35330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+3:35361:x1875232144200704:12345-0@lo:104: 00010000:00010000:2.0:1788361454.444667:0:35330:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.444747:0:35330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788361454.444754:0:35330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+3:35361:x1875232144200704:12345-0@lo:104: Request processed in 116us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361454.444761:0:35330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788361454.444786:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361454.444792:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.444800:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:2.0:1788361454.444804:0:35335:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.444814:0:35335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788361454.444822:0:35335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788361454.444829:0:35335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788361454.444864:0:35335:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.444871:0:35335:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788361454.444896:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.444903:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1f000/0xf6a94c97d66145cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66145d2 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.444928:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361454.444930:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361454.444932:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361454.444947:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144200832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361454.444981:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361454.445031:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144200832 00000100:00100000:2.0:1788361454.445035:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144200832 00010000:00010000:2.0:1788361454.445055:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8ab65cfc00/0xf6a94c97d66145d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66145cb expref: 20 pid: 35340 timeout: 944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361454.445077:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361454.445113:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+20:3313:x1875232144200832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361454.445126:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361454.445131:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8ab65cfc00/0xf6a94c97d66145d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66145cb expref: 20 pid: 35340 timeout: 944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.445142:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8ab65cfc00/0xf6a94c97d66145d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66145cb expref: 20 pid: 35340 timeout: 944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.445159:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.445166:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788361454.445179:0:35331:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001633969s 00010000:00010000:2.0:1788361454.445183:0:35331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.445200:0:35331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.445208:0:35331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.445214:0:35331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.445221:0:35331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361454.445225:0:35331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.445232:0:35331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.445241:0:35331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361454.445250:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361454.445290:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+20:3313:x1875232144200832:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361454.445297:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361454.445334:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144200832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788361454.445419:0:35361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8ab65cfc00/0xf6a94c97d66145d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66145cb expref: 19 pid: 35340 timeout: 944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361454.445433:0:35361:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:35361:1875232144200704:0@lo:104: 00010000:00010000:0.0:1788361454.445451:0:35361:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.445461:0:35361:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.445471:0:35361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361454.445479:0:35361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964600/0xf6a94c97d661470d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 35361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361454.453139:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:36653:x1875232144200576:12345-0@lo:253:mount.lustre.0 Request processed in 32624us (32859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361454.453159:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788361454.453417:0:36653:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:36653:1875232144200576:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788361454.453437:0:36653:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788361454.453440:0:36653:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788361454.453442:0:36653:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788361454.453444:0:36653:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788361454.453445:0:36653:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788361454.453447:0:36653:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788361454.453448:0:36653:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788361454.453450:0:36653:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788361454.453451:0:36653:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788361454.453453:0:36653:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788361454.453476:0:36653:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788361454.454008:0:36653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361454.454475:0:36653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361454.454747:0:36653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361454.454898:0:36653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788361454.455050:0:36653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788361454.455402:0:36653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788361454.456615:0:36653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771072 00002000:00080000:2.0:1788361454.500544:0:36653:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788361454.500580:0:36653:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788361454.500629:0:36653:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788361454.500706:0:36653:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788361454.500725:0:36653:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788361454.500768:0:36653:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788361455.008437:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361455.264246:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144200960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361455.264344:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361455.264456:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144200960 00000100:00100000:2.0:1788361455.264466:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144200960 00000100:00100000:2.0:1788361455.264527:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361455.264744:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144200960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361455.264792:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361455.264860:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144200960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361455.264869:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361455.264938:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144200960:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788361455.778309:0:35343:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788361455.778316:0:35343:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff9a89852f1800 from 23 10000000:01000000:2.0:1788361455.778321:0:35343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788361455.778365:0:35343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d6614714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361455.778376:0:35343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d6614714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361455.778388:0:35343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d6614714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361455.778415:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144201088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788361455.778490:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361455.778534:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361455.778594:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144201088 00000100:00100000:1.0:1788361455.778601:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144201088 00000100:00100000:1.0:1788361455.778656:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788361455.778665:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:35343:x1875232144201088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361455.778680:0:35341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361455.778694:0:35341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d661471b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6614714 expref: -99 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361455.778719:0:35341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d661471b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6614714 expref: 19 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361455.778730:0:35341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841ee600/0xf6a94c97d661471b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614714 expref: 19 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361455.778740:0:35341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ee600, rc 0) 00000100:00100000:1.0:1788361455.778790:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:35343:x1875232144201088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361455.778797:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788361455.779013:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144201088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361455.779037:0:35343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d6614714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661471b expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361455.779061:0:35343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d6614714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d661471b expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361455.779216:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144201216:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788361455.779251:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361455.779279:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85659780 going to sleep for 11 seconds 00000100:00100000:2.0:1788361455.779381:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144201216 00000100:00100000:2.0:1788361455.779386:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144201216 00000100:00100000:2.0:1788361455.779419:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788361455.779427:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:35343:x1875232144201216:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788361455.779443:0:35339:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788361455.779458:0:35339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788361455.779460:0:35339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 23 00000100:00100000:2.0:1788361455.779646:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:35343:x1875232144201216:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 219us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361455.779652:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788361455.779701:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144201216:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788361455.779765:0:35343:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788361455.779773:0:35343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d6614714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661471b expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361455.779782:0:35343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8df1ec00/0xf6a94c97d6614714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d661471b expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361456.032481:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361457.056197:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361458.083454:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361458.376694:0:37004:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788361459.105131:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361459.707364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361459.707463:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130646656 00000100:00100000:2.0:1788361459.707473:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130646656 00000100:00100000:2.0:1788361459.708777:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:2.0:1788361459.708787:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2348:x1875232130646656:12345-192.168.203.60@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788361459.708818:0:35340:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from bd12fa5b-f901-4872-ad58-55985ec8f4aa@192.168.203.60@tcp t0 exp 0000000000000000 cur 849 last 0 00000020:00000080:2.0:1788361459.708845:0:35340:0:(genops.c:1406:class_connect()) connect: client bd12fa5b-f901-4872-ad58-55985ec8f4aa, cookie 0xf6a94c97d6614722 00000100:00080000:2.0:1788361459.708996:0:35340:0:(import.c:65:import_set_state_nolock()) ffff9a8a856ef000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361459.709080:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+5:2348:x1875232130646656:12345-192.168.203.60@tcp:250:mount.lustre.0 Request processed in 292us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361459.709105:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:0.0:1788361459.710815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361459.712159:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130646784 00000100:00100000:1.0:1788361459.712189:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130646784 00000100:00100000:1.0:1788361459.712250:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:1.0:1788361459.712260:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+5:30898:x1875232130646784:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788361459.712277:0:35341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361459.712295:0:35341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841ef000/0xf6a94c97d6614729 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f1c6 expref: -99 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.712326:0:35341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841ef000/0xf6a94c97d6614729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1c6 expref: 6 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.713252:0:35341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841ef000/0xf6a94c97d6614729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1c6 expref: 6 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.713266:0:35341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef000, rc 0) 00000100:00100000:1.0:1788361459.713327:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+6:30898:x1875232130646784:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 1068us (2524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361459.713474:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:3.0:1788361459.716226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361459.716623:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130646912 00000100:00100000:2.0:1788361459.716638:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130646912 00000100:00100000:2.0:1788361459.716688:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:2.0:1788361459.716699:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+6:30898:x1875232130646912:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788361459.717151:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+6:30898:x1875232130646912:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 453us (932us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361459.717160:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788361459.719126:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361459.719411:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130647040 00000100:00100000:1.0:1788361459.719420:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130647040 00000100:00100000:1.0:1788361459.719476:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:1.0:1788361459.719485:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+6:30898:x1875232130647040:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788361459.719502:0:35341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361459.719523:0:35341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841ef200/0xf6a94c97d6614730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f1cd expref: -99 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.719553:0:35341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841ef200/0xf6a94c97d6614730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1cd expref: 7 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.719566:0:35341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841ef200/0xf6a94c97d6614730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1cd expref: 7 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.719589:0:35341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef200, rc 0) 00000100:00100000:1.0:1788361459.720031:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+7:30898:x1875232130647040:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 546us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361459.720039:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:0.0:1788361459.724906:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361459.725753:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130647168 00000100:00100000:2.0:1788361459.725764:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130647168 00000100:00100000:2.0:1788361459.725819:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:2.0:1788361459.725829:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+7:30898:x1875232130647168:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788361459.726608:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+8:30898:x1875232130647168:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 776us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361459.726617:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:2.0:1788361459.728708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361459.728800:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130647296 00000100:00100000:1.0:1788361459.728808:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130647296 00000100:00100000:1.0:1788361459.728860:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:1.0:1788361459.728870:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+8:30898:x1875232130647296:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788361459.729203:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+8:30898:x1875232130647296:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 333us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361459.729212:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1788361459.731960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361459.733693:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130647424 00000100:00100000:2.0:1788361459.733706:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130647424 00000100:00100000:2.0:1788361459.733771:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:2.0:1788361459.733780:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+8:30916:x1875232130647424:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788361459.735632:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+8:30916:x1875232130647424:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 1835us (3661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361459.735645:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:0.0:1788361459.749374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361459.749465:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130647552 00000100:00100000:3.0:1788361459.749475:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130647552 00000100:00100000:3.0:1788361459.749540:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:3.0:1788361459.749550:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+8:30916:x1875232130647552:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788361459.749815:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+8:30916:x1875232130647552:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 266us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361459.749824:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:3.0:1788361459.755589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361459.755857:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130647680 00000100:00100000:2.0:1788361459.755866:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130647680 00000100:00100000:2.0:1788361459.755917:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:2.0:1788361459.755927:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+8:30898:x1875232130647680:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788361459.755956:0:35340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361459.755974:0:35340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a8df1f800/0xf6a94c97d6614737 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f1f7 expref: -99 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.756002:0:35340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a8df1f800/0xf6a94c97d6614737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1f7 expref: 9 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.756013:0:35340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a8df1f800/0xf6a94c97d6614737 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1f7 expref: 9 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.756023:0:35340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f800, rc 0) 00000100:00100000:2.0:1788361459.756077:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+9:30898:x1875232130647680:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 151us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361459.756123:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1788361459.759339:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361459.759445:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130647808 00000100:00100000:3.0:1788361459.759454:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130647808 00000100:00100000:3.0:1788361459.759551:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:3.0:1788361459.759562:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+9:30898:x1875232130647808:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788361459.759588:0:35339:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788361459.759611:0:35339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788361459.759616:0:35339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788361459.759619:0:35339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788361459.759621:0:35339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 23 00000100:00100000:3.0:1788361459.760991:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+9:30898:x1875232130647808:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 1427us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361459.761001:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1788361459.763250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361459.763347:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130647936 00000100:00100000:3.0:1788361459.763357:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130647936 00000100:00100000:3.0:1788361459.763447:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:3.0:1788361459.763457:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+9:30898:x1875232130647936:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361459.763474:0:35340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361459.763491:0:35340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcbe00/0xf6a94c97d661473e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f1fe expref: -99 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.763537:0:35340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcbe00/0xf6a94c97d661473e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1fe expref: 10 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.763549:0:35340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bcbe00/0xf6a94c97d661473e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1fe expref: 10 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.763558:0:35340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcbe00, rc 0) 00000100:00100000:3.0:1788361459.763617:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+10:30898:x1875232130647936:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 162us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361459.763624:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:0.0:1788361459.765043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361459.765444:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130648064 00000100:00100000:3.0:1788361459.765452:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130648064 00000100:00100000:3.0:1788361459.765538:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788361459.765548:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+10:30898:x1875232130648064:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788361459.765864:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+10:30898:x1875232130648064:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 317us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361459.765873:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:0.0:1788361459.767333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361459.767378:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130648192 00000100:00100000:3.0:1788361459.767385:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130648192 00000100:00100000:3.0:1788361459.767430:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1788361459.767439:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+10:30898:x1875232130648192:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788361459.767739:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+10:30898:x1875232130648192:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 299us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361459.767747:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:2.0:1788361459.771313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361459.771653:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130648320 00000100:00100000:3.0:1788361459.771674:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130648320 00000100:00100000:3.0:1788361459.771727:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1788361459.771735:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+10:30920:x1875232130648320:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788361459.772126:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+10:30920:x1875232130648320:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 352us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361459.772135:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:0.0:1788361459.776191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361459.776623:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130648448 00000100:00100000:1.0:1788361459.776634:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130648448 00000100:00100000:1.0:1788361459.776739:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1788361459.776749:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+10:30920:x1875232130648448:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361459.777012:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+10:30920:x1875232130648448:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 263us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361459.777022:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:0.0:1788361459.779603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361459.779902:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130648576 00000100:00100000:3.0:1788361459.779911:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130648576 00000100:00100000:3.0:1788361459.779958:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361459.779966:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1875232130648576:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788361459.779999:0:35347:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp t0 exp 0000000000000000 cur 849 last 0 00000020:00000080:3.0:1788361459.780051:0:35347:0:(genops.c:1406:class_connect()) connect: client c05f3090-241b-43d5-9787-08721e3d4333, cookie 0xf6a94c97d6614745 00000004:00100000:3.0:1788361459.780110:0:35347:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788361459.780118:0:35347:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 7, last_transno is 30064771072 00000100:00080000:2.0:1788361459.808102:0:35347:0:(import.c:65:import_set_state_nolock()) ffff9a8a856ef800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361459.808304:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2348:x1875232130648576:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 28336us (28707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361459.808320:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361459.811435:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361459.811541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361459.811948:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130648704 00000100:00100000:0.0:1788361459.811959:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130648704 00000100:00100000:0.0:1788361459.812042:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130648832 00000100:00100000:0.0:1788361459.812046:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130648832 00000100:00080000:2.0:1788361459.812062:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361459.812069:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361459.812082:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:0:x1875232130648704:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788361459.812175:0:35345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1788361459.812490:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:0:x1875232130648704:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 185us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.812500:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361459.812517:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361459.812524:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:30898:x1875232130648832:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788361459.812536:0:35345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1788361459.812574:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:30898:x1875232130648832:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 50us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.812581:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361459.814405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361459.814565:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130648960 00000100:00100000:0.0:1788361459.814574:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130648960 00000100:00100000:0.0:1788361459.814655:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361459.814664:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:30898:x1875232130648960:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788361459.814743:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:30898:x1875232130648960:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 79us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.815168:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788361459.817886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361459.818479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361459.818521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361459.818604:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130649088 00000100:00100000:1.0:1788361459.818613:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130649088 00000100:00100000:3.0:1788361459.818619:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130649344 00000100:00100000:3.0:1788361459.818623:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130649344 00000100:00100000:1.0:1788361459.818645:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130649216 00000100:00100000:1.0:1788361459.818647:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130649216 00000100:00100000:3.0:1788361459.818659:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361459.818668:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:30898:x1875232130649344:12345-192.168.203.60@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788361459.818671:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361459.818675:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2348:x1875232130649088:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788361459.818701:0:36286:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp t0 exp 0000000000000000 cur 849 last 0 00000020:00000080:1.0:1788361459.818742:0:36286:0:(genops.c:1406:class_connect()) connect: client c05f3090-241b-43d5-9787-08721e3d4333, cookie 0xf6a94c97d661474c 00002000:00100000:1.0:1788361459.818765:0:36286:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c05f3090-241b-43d5-9787-08721e3d4333/ffff9a8aae464800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788361459.818802:0:36286:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788361459.818970:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1788361459.818976:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875232130649216:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788361459.818991:0:35980:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp t0 exp 0000000000000000 cur 849 last 0 00000020:00000080:0.0:1788361459.819008:0:35980:0:(genops.c:1406:class_connect()) connect: client c05f3090-241b-43d5-9787-08721e3d4333, cookie 0xf6a94c97d6614753 00002000:00100000:0.0:1788361459.819018:0:35980:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c05f3090-241b-43d5-9787-08721e3d4333/ffff9a89860a5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788361459.819031:0:35980:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788361459.819138:0:36286:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788361459.819165:0:36286:0:(import.c:65:import_set_state_nolock()) ffff9a8aae466800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361459.819241:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2348:x1875232130649088:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 552us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361459.819249:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000004:00080000:3.0:1788361459.819794:0:35348:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1062us 00002000:00080000:0.0:1788361459.820012:0:35980:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788361459.820032:0:35980:0:(import.c:65:import_set_state_nolock()) ffff9a89860a1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361459.820303:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:2348:x1875232130649216:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 1323us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.820312:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000004:00200000:0.0:1788361459.829307:0:35348:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1788361459.829482:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:30898:x1875232130649344:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 10810us (10999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.829498:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00080000:0.0:1788361459.872293:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788361459.872300:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788361459.872304:0:8:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788361459.872318:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9a8abc48a800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1788361459.872339:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9a8a835e2d80 x1875232144201600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788361459.872443:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144201472:0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.872514:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361459.872571:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788361459.872578:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144201344:0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.872606:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361459.872632:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144201984:0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.872658:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361459.872682:0:3310:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144201600:0@lo:8:kworker.0 00000100:00100000:0.0:1788361459.872718:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361459.872747:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144201728:0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.872769:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361459.872785:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361459.872791:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144201856:0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.872810:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361459.872840:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144201984 00000100:00100000:0.0:1788361459.872846:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144201984 00000100:00100000:0.0:1788361459.872889:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144201728 00000100:00100000:0.0:1788361459.872893:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144201728 00000100:00100000:0.0:1788361459.872904:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144201856 00000100:00100000:0.0:1788361459.872907:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144201856 00000100:00100000:0.0:1788361459.872922:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361459.872930:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144201984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.872982:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144201984:12345-0@lo:400:kworker.0 Request processed in 52us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.872989:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361459.873005:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361459.873011:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144201728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.873041:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144201728:12345-0@lo:400:kworker.0 Request processed in 30us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.873046:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361459.873057:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788361459.873063:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144201856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.873111:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144201856:12345-0@lo:400:kworker.0 Request processed in 47us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.873116:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788361459.873143:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144201472 00000100:00100000:0.0:1788361459.873147:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144201472 00000100:00100000:0.0:1788361459.873174:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144201600 00000100:00100000:0.0:1788361459.873177:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144201600 00000100:00100000:0.0:1788361459.873192:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361459.873198:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144201472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.873241:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144201472:12345-0@lo:400:kworker.0 Request processed in 32us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.873247:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788361459.873259:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361459.873262:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1875232144201600:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788361459.873284:0:35982:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 849 last 0 00000020:00000080:0.0:1788361459.873311:0:35982:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf6a94c97d661475a 00002000:00100000:0.0:1788361459.873325:0:35982:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9a89860a4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113802 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788361459.873329:0:35982:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788361459.873333:0:35982:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788361459.873519:0:35982:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788361459.873543:0:35982:0:(import.c:65:import_set_state_nolock()) ffff9a89860a3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361459.873581:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875232144201600:12345-0@lo:8:kworker.0 Request processed in 316us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.873588:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788361459.873608:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361459.873612:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788361459.873635:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a835e2d80 x1875232144201600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788361479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788361459.873648:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 7 00000100:00080000:0.0:1788361459.873653:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788361459.873664:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788361459.873666:0:3310:0:(import.c:65:import_set_state_nolock()) ffff9a8abc48a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788361459.873681:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788361459.873686:0:3310:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1875232144201600:0@lo:8:kworker.0 00000004:00080000:0.0:1788361459.873709:0:35369:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788361459.874116:0:35369:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 849889029466ns, next at 0ns, rc = 0 00010000:00080000:0.0:1788361459.874168:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a835e1180 x1875232144201856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361459.874177:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144201856:0@lo:400:kworker.0 00010000:00080000:0.0:1788361459.874187:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a835e2680 x1875232144201728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361459.874195:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144201728:0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.874227:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144201344 00000100:00100000:0.0:1788361459.874242:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144201344 00000100:00100000:0.0:1788361459.874271:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788361459.874279:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144201344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.874316:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144201344:12345-0@lo:400:kworker.0 Request processed in 38us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.874322:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788361459.874356:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144201344:0@lo:400:kworker.0 00010000:00080000:0.0:1788361459.874368:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a835e1880 x1875232144201984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788361475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788361459.874376:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144201984:0@lo:400:kworker.0 00000100:00100000:0.0:1788361459.874388:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144201472:0@lo:400:kworker.0 00000004:00080000:0.0:1788361459.874468:0:35370:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0xa4:0x0] 00000100:00100000:0.0:1788361459.874485:0:35370:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35370:1875232144202240:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788361459.874512:0:35370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361459.874529:0:35370:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a868f8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361459.874546:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144202240 00000100:00100000:0.0:1788361459.874549:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144202240 00000100:00100000:0.0:1788361459.874575:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361459.874582:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:35370:x1875232144202240:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788361459.875714:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361459.875731:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144202112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361459.875779:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361459.875828:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144202112 00000100:00100000:2.0:1788361459.875833:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144202112 00000100:00100000:2.0:1788361459.875864:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361459.875871:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144202112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361459.875890:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361459.875932:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144202112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361459.875938:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788361459.875972:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9a8a835e0380 x1875232144202112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788361475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361459.875987:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144202112:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1788361459.885719:0:36286:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788361459.885731:0:36286:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 193 -> diff = -29 00002000:02000040:2.0:1788361459.885737:0:36286:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:165 to 0x280000400:193) 00002000:00010000:2.0:1788361459.904760:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.904773:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6614761 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.904791:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.904796:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.904803:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6614761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.904821:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6614761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.904833:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6614761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.904848:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6614761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.904864:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361459.904877:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361459.904884:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6614761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.904892:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361459.904896:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6614761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.904905:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6614761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.904925:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6614761 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.904933:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d6614761 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.904951:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.904953:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.904955:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.906125:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.906141:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6614768 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906152:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.906156:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.906161:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6614768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906173:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6614768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906182:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6614768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906189:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6614768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906204:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361459.906214:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361459.906218:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6614768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906225:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361459.906458:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6614768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906470:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6614768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906491:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6614768 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906509:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055e214ca/0xf6a94c97d6614768 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906526:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.906528:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.906530:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.906934:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.906940:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661476f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906949:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.906953:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.906958:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661476f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906967:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661476f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906976:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661476f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.906983:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661476f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.907014:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361459.907328:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361459.907335:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661476f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.907343:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361459.907347:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661476f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.907355:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661476f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.907370:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661476f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.907377:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d661476f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.907392:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.907399:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.907401:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.907907:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.907913:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6614776 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.907921:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.907924:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.907928:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6614776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.907935:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6614776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.907942:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6614776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.907948:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6614776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.907960:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361459.907968:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361459.907972:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6614776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.907978:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361459.907985:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6614776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.907992:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6614776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908000:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6614776 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908007:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000512baea7/0xf6a94c97d6614776 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908017:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.908018:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.908020:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.908391:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.908398:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661477d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908406:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.908408:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.908413:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661477d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908421:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661477d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908428:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661477d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908442:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661477d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908457:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361459.908466:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361459.908470:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661477d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908476:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361459.908479:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661477d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908486:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661477d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908597:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661477d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908606:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d661477d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.908621:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.908623:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.908625:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.909013:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.909026:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6614784 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.909035:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.909038:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.909042:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6614784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.909051:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6614784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.909059:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6614784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.909066:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6614784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.909082:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361459.909532:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361459.909539:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6614784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.909547:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361459.909551:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6614784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.909559:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6614784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.909571:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6614784 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.909578:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d6614784 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.909594:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.909596:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.909597:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.909945:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xbb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.909951:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661478b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.909961:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.909964:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xbb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.909968:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661478b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.909978:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661478b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.909992:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661478b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.909998:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661478b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.910011:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361459.910020:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361459.910024:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661478b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.910031:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361459.910034:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661478b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.910042:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661478b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.910052:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661478b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.910059:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006e29336/0xf6a94c97d661478b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xbb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.910072:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.910079:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.910080:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.911118:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.911126:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6614792 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.911138:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.911142:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xba:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.911147:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6614792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.911158:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6614792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.911167:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6614792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.911174:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6614792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.911189:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361459.911198:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361459.911203:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6614792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.911210:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361459.911214:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6614792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.911758:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6614792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.911778:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6614792 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.911844:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029467e1c/0xf6a94c97d6614792 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.911867:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.911869:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.911871:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.912602:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.912611:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6614799 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.912622:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.912626:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.912631:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6614799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.912643:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6614799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.912652:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6614799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.912665:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6614799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.912683:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361459.913376:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.913384:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66147a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.913394:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.913398:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.913402:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66147a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.913412:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66147a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.913421:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66147a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.913429:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66147a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.913451:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788361459.913562:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361459.913571:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6614799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.913592:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361459.913597:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6614799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.913606:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6614799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.913626:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6614799 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.913635:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cf2118b/0xf6a94c97d6614799 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.913730:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361459.913736:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66147a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.913743:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cec00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361459.913746:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66147a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.913754:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66147a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.913765:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66147a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.913778:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e1095dc/0xf6a94c97d66147a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.913792:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361459.913794:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361459.913796:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.914191:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.914198:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d66147a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.914213:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.914216:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.914221:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d66147a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.914241:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d66147a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.914250:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d66147a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.914258:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d66147a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.914281:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361459.914527:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361459.914533:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d66147a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.914541:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361459.914545:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d66147a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.914560:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d66147a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.914572:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d66147a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.914580:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007075c01d/0xf6a94c97d66147a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.914595:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.914597:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.914598:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.914893:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.914900:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66147ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.914909:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.914913:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.914917:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66147ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.914926:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66147ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.914946:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66147ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.914954:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66147ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.914977:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361459.915571:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.915579:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66147b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.915587:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.915590:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.915595:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66147b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.915605:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66147b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.915613:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66147b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.915621:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66147b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.915634:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361459.915644:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66147ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.915655:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361459.915655:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361459.915662:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66147ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.915669:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361459.915672:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66147ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.915675:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66147b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.915691:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361459.915695:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66147b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.915698:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66147ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.915706:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66147b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.915710:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bac5f558/0xf6a94c97d66147ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.915728:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66147b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.915736:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.915737:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000616faace/0xf6a94c97d66147b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.915746:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.915751:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.915760:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.915764:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.915767:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.915910:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.917765:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.917774:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66147bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.917846:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.917856:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.917861:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66147bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.917874:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66147bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.917883:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66147bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.917890:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66147bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.917906:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361459.918199:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361459.918206:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66147bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.918215:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cea00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361459.918219:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66147bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.918229:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66147bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.918255:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66147bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.918262:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083313025/0xf6a94c97d66147bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.918280:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.918282:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.918284:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.919137:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.919145:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d66147c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.919156:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.919160:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.919165:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d66147c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.919176:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d66147c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.919185:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d66147c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.919200:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d66147c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.919216:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361459.920050:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.920057:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d66147ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.920068:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb2:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.920072:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.920076:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d66147ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.920104:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d66147ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.920114:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d66147ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.920121:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d66147ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.920137:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788361459.920430:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361459.920439:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d66147c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.920458:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361459.920464:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d66147c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.920473:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d66147c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.920491:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d66147c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.920505:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd96202f/0xf6a94c97d66147c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.920534:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361459.920537:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d66147ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.920543:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361459.920546:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d66147ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.920553:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d66147ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.920564:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d66147ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.920571:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000442c5634/0xf6a94c97d66147ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.920583:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.920585:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.920587:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.920594:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.921061:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.921068:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66147d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.921112:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb1:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.921116:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb1:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.921121:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66147d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.921132:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66147d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.921140:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66147d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.921147:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66147d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.921164:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361459.921268:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361459.921276:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66147d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.921286:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361459.921290:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66147d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.921307:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66147d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.921320:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66147d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.921328:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd55209b/0xf6a94c97d66147d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.921349:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.921352:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.921353:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.921742:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.921749:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d66147d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.921758:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.921761:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb0:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.921765:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d66147d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.921773:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d66147d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.921792:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d66147d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.921799:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d66147d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.921820:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361459.922214:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xaf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.922219:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d66147df lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.922228:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.922242:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.922247:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d66147df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.922256:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d66147df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.922263:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d66147df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.922271:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d66147df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.922294:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788361459.922322:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361459.922329:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d66147d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.922339:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cee00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361459.922344:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d66147d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.922353:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d66147d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.922369:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d66147d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.922389:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000556d3342/0xf6a94c97d66147d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.922407:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361459.922411:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d66147df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.922418:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfa00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361459.922421:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d66147df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.922429:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d66147df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.922441:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d66147df lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.922450:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031bb8470/0xf6a94c97d66147df lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.922467:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.922468:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.922472:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.922474:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.923842:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.923852:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66147e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.923864:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.923867:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xae:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.923873:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66147e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.923886:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66147e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.923895:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66147e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.923904:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66147e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.923927:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361459.924347:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.924576:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d66147ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.924586:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.924597:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xad:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.924603:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d66147ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.924614:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d66147ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.924623:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d66147ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.924631:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d66147ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.924650:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000001:00100000:1.0:1788361459.924696:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788361459.924707:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c05f3090-241b-43d5-9787-08721e3d4333 00010000:00010000:3.0:1788361459.924980:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788361459.924988:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66147e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.924997:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361459.925002:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66147e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.925011:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66147e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.925028:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66147e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.925035:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f5c68ac/0xf6a94c97d66147e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.925081:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361459.925104:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d66147ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.925127:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361459.925130:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d66147ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.925137:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d66147ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.925148:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d66147ed lrc: 1/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.925156:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce16f992/0xf6a94c97d66147ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0xad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.925171:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361459.925173:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361459.925175:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.925432:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.925905:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.925913:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d66147f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.925924:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.925928:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xac:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.925932:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d66147f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.925942:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d66147f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.925950:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d66147f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.925965:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d66147f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.926018:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361459.926489:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.926496:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66147fb lrc: 3/0,1 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.926505:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.926519:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xab:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.926523:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66147fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.926533:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66147fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.926542:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66147fb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.926549:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66147fb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.926689:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361459.926697:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d66147f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.926706:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361459.926710:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d66147f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.926720:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d66147f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.926736:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d66147f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.926743:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dba0d25d/0xf6a94c97d66147f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.926762:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361459.926766:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66147fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.926773:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361459.926776:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66147fb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.926784:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66147fb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.926806:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66147fb lrc: 2/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.926814:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.926815:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.926817:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.926851:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361459.926857:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042689c93/0xf6a94c97d66147fb lrc: 0/0,0 mode: --/PW res: [0x280000400:0xab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361459.926894:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.927328:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xaa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.927335:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614802 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.927344:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.927348:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xaa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.927353:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.927363:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.927502:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.927567:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.927610:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788361459.928018:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.928025:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d6614809 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.928033:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.928036:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.928047:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d6614809 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.928058:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d6614809 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.928066:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d6614809 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.928073:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d6614809 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.928131:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788361459.928138:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.928146:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361459.928151:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.928160:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.928174:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614802 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.928181:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614802 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xaa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.928197:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361459.928200:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d6614809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.928217:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361459.928220:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d6614809 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.928229:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d6614809 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.928250:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d6614809 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.928259:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.928261:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361459.928263:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361459.928333:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788361459.928338:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d6614809 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.929459:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.929499:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.929506:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6614810 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.929692:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.929696:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.929702:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6614810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.929715:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6614810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.929736:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6614810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.929743:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6614810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.930956:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361459.930966:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361459.930976:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6614810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.930988:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361459.930993:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6614810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.931004:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6614810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.931025:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6614810 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.931033:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004e1ec07/0xf6a94c97d6614810 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.931053:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.931055:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.931057:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788361459.931068:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:1.0:1788361459.931125:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c05f3090-241b-43d5-9787-08721e3d4333 00002000:00010000:2.0:1788361459.931659:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.931666:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6614817 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.931679:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.931683:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.931689:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6614817 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.931700:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6614817 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.931709:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6614817 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.931718:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6614817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.931755:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361459.931934:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361459.931940:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6614817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.931949:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361459.931961:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6614817 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.931970:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6614817 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.931985:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6614817 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.931993:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000537803fb/0xf6a94c97d6614817 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.932013:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.932016:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.932018:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.932496:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.932503:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d661481e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.932512:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.932516:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.932520:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d661481e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.932529:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d661481e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.932537:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d661481e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.932544:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d661481e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.932566:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361459.932688:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361459.932695:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d661481e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.932704:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361459.932708:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d661481e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.932718:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d661481e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.932732:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d661481e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.932747:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9872fbc/0xf6a94c97d661481e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.932765:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.932768:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.932770:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788361459.933266:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361459.933273:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6614825 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.933283:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa5:0x0].0x0 since=849s v=(0 0) 00010000:00010000:2.0:1788361459.933292:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361459.933297:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6614825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.933307:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6614825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.933316:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6614825 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.933324:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6614825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361459.933338:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788361459.933507:0:36286:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:164 00000100:00100000:2.0:1788361459.933601:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:35370:x1875232144202240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 59015us (59084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361459.933611:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361459.933710:0:35370:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35370:1875232144202240:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788361459.933727:0:35370:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0xc1:0x0] from OST, last_created [0x280000400:0xc1:0x0]last_used is [0x280000400:0xa4:0x0] 00000100:00100000:0.0:1788361459.933774:0:35370:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35370:1875232144202368:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788361459.933874:0:35370:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361459.933918:0:35370:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85f49cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361459.933953:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144202368 00000100:00100000:2.0:1788361459.933960:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144202368 00000100:00100000:2.0:1788361459.934001:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788361459.934008:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:35370:x1875232144202368:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788361459.934151:0:35980:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 194 00010000:00010000:1.0:1788361459.934298:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361459.934307:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6614825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.934319:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361459.934325:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6614825 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.934336:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6614825 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.934353:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6614825 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.934361:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6614825 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361459.934384:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.934386:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361459.934388:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361459.941852:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:35370:x1875232144202368:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7836us (7970us total) trans 30064771073 rc 0/0 00000100:00100000:0.0:1788361459.941867:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361459.941899:0:35370:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35370:1875232144202368:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788361459.941917:0:35370:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0xc1:0x0]-[0x280000400:0xe1:0x0] 00000100:00100000:3.0:1788361459.954429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361459.955837:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130649472 00000100:00100000:0.0:1788361459.955849:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130649472 00000100:00100000:0.0:1788361459.955936:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361459.955947:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+5:30942:x1875232130649472:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:0.0:1788361459.955970:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361459.956001:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d661482c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f228 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.956078:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614833 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.956135:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.956153:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361459.956357:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361459.956362:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361459.956467:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614833 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.956496:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d661482c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f228 expref: 7 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.956513:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614833 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f228 expref: 6 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361459.956522:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361459.956525:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361459.956528:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965800, rc 0) 00000100:00100000:0.0:1788361459.956588:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:30942:x1875232130649472:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 643us (2326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361459.956601:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:1.0:1788361460.128943:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361460.384903:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144202496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361460.384974:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361460.385107:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144202496 00000100:00100000:2.0:1788361460.385116:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144202496 00000100:00100000:2.0:1788361460.385173:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361460.385183:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144202496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361460.385222:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361460.385294:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144202496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361460.385302:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361460.385397:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144202496:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361461.152339:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361461.409793:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788361461.556236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361461.556343:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130649600 00000100:00100000:0.0:1788361461.556354:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130649600 00000100:00100000:0.0:1788361461.556424:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361461.556434:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c05f3090-241b-43d5-9787-08721e3d4333+6:30994:x1875232130649600:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:0.0:1788361461.556472:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361461.556558:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c05f3090-241b-43d5-9787-08721e3d4333+6:30994:x1875232130649600:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 125us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.556566:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00080000:2.0:1788361461.557642:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361461.561110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361461.561204:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130649728 00000100:00100000:0.0:1788361461.561214:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130649728 00000100:00100000:0.0:1788361461.561291:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361461.561301:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c05f3090-241b-43d5-9787-08721e3d4333+5:30994:x1875232130649728:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:0.0:1788361461.561340:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361461.561429:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:c05f3090-241b-43d5-9787-08721e3d4333+5:30994:x1875232130649728:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 129us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.561441:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00080000:2.0:1788361461.561517:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361461.662818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361461.662923:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130649856 00000100:00100000:3.0:1788361461.662934:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130649856 00000100:00100000:3.0:1788361461.662998:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:3.0:1788361461.663009:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+10:31029:x1875232130649856:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788361461.663031:0:35341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361461.663054:0:35341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d661483a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f22f expref: -99 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361461.663127:0:35341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d661483a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f22f expref: 11 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361461.663141:0:35341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bcae00/0xf6a94c97d661483a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f22f expref: 11 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361461.663153:0:35341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcae00, rc 0) 00000100:00100000:3.0:1788361461.663228:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:31029:x1875232130649856:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 212us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361461.663236:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:1.0:1788361461.666347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361461.666471:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130649984 00000100:00100000:0.0:1788361461.666484:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130649984 00000100:00100000:0.0:1788361461.666542:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:0.0:1788361461.666551:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:31029:x1875232130649984:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788361461.666987:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:31029:x1875232130649984:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 435us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.666995:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:2.0:1788361461.670678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361461.670747:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130650112 00000100:00100000:1.0:1788361461.670756:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130650112 00000100:00100000:1.0:1788361461.670975:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:1.0:1788361461.670987:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:31029:x1875232130650112:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788361461.671333:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:31029:x1875232130650112:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 347us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361461.671342:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:1.0:1788361461.673832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361461.673965:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130650240 00000100:00100000:0.0:1788361461.673975:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130650240 00000100:00100000:0.0:1788361461.674037:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:0.0:1788361461.674047:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:31033:x1875232130650240:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361461.674702:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:31033:x1875232130650240:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 655us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.674712:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:2.0:1788361461.682177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361461.682277:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130650368 00000100:00100000:1.0:1788361461.682287:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130650368 00000100:00100000:1.0:1788361461.682354:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1788361461.682368:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:31033:x1875232130650368:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788361461.682688:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:31033:x1875232130650368:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 320us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361461.682696:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788361461.686817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361461.687170:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130650496 00000100:00100000:0.0:1788361461.687180:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130650496 00000100:00100000:0.0:1788361461.687306:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:0.0:1788361461.687316:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:31029:x1875232130650496:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361461.687336:0:35340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361461.687355:0:35340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614841 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f259 expref: -99 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361461.687384:0:35340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f259 expref: 12 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361461.687396:0:35340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985965200/0xf6a94c97d6614841 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f259 expref: 12 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361461.687405:0:35340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965200, rc 0) 00000100:00100000:0.0:1788361461.687474:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+12:31029:x1875232130650496:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 159us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.687493:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:2.0:1788361461.691739:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361461.691830:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130650624 00000100:00100000:3.0:1788361461.691840:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130650624 00000100:00100000:3.0:1788361461.691899:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:3.0:1788361461.691910:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+12:31029:x1875232130650624:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788361461.692240:0:35339:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788361461.692266:0:35339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788361461.692270:0:35339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788361461.692274:0:35339:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788361461.692276:0:35339:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 23 00000100:00100000:3.0:1788361461.694537:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+12:31029:x1875232130650624:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 2621us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361461.694549:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:2.0:1788361461.697758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361461.698158:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130650752 00000100:00100000:0.0:1788361461.698176:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130650752 00000100:00100000:0.0:1788361461.698270:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:0.0:1788361461.698283:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+12:31029:x1875232130650752:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788361461.698711:0:35340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361461.698969:0:35340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8985964200/0xf6a94c97d6614848 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f260 expref: -99 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361461.699006:0:35340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8985964200/0xf6a94c97d6614848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f260 expref: 13 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361461.699018:0:35340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8985964200/0xf6a94c97d6614848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f260 expref: 13 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361461.699028:0:35340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964200, rc 0) 00000100:00100000:0.0:1788361461.699148:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:31029:x1875232130650752:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 867us (1397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.699157:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:2.0:1788361461.701767:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361461.702023:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130650880 00000100:00100000:3.0:1788361461.702035:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130650880 00000100:00100000:3.0:1788361461.702295:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:3.0:1788361461.702307:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:31029:x1875232130650880:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788361461.703286:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:31029:x1875232130650880:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 978us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361461.703297:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:2.0:1788361461.705428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361461.705543:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130651008 00000100:00100000:0.0:1788361461.705552:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130651008 00000100:00100000:0.0:1788361461.705708:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:0.0:1788361461.705718:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:31029:x1875232130651008:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788361461.705966:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:31029:x1875232130651008:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 250us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.705974:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:2.0:1788361461.712146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361461.715646:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130651136 00000100:00100000:3.0:1788361461.715669:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130651136 00000100:00100000:3.0:1788361461.715903:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:3.0:1788361461.715915:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:31037:x1875232130651136:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788361461.716246:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:31037:x1875232130651136:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 333us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361461.716255:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:2.0:1788361461.720284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361461.720379:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130651264 00000100:00100000:0.0:1788361461.720388:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130651264 00000100:00100000:0.0:1788361461.720445:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:0.0:1788361461.720455:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:31037:x1875232130651264:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788361461.720719:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:31037:x1875232130651264:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 265us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.720729:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:2.0:1788361461.725186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361461.725247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361461.725283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361461.725370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361461.725406:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130652032 00000100:00100000:2.0:1788361461.725421:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130652032 00000100:00100000:2.0:1788361461.725468:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130651904 00000100:00100000:2.0:1788361461.725472:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130651904 00000100:00100000:2.0:1788361461.725500:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1788361461.725511:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+5:2351:x1875232130652032:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361461.725685:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130651392 00000100:00100000:0.0:1788361461.725690:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130651392 00000100:00100000:0.0:1788361461.725714:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130651776 00000100:00100000:0.0:1788361461.725717:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130651776 00000100:00100000:0.0:1788361461.725744:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361461.725753:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2351:x1875232130651776:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361461.725778:0:35345:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788361461.725786:0:35345:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788361461.725825:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2351:x1875232130651776:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 74us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.725845:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361461.725863:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1788361461.725868:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2348:x1875232130651392:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788361461.725889:0:35346:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp t0 exp 0000000000000000 cur 851 last 0 00000100:00100000:1.0:1788361461.725896:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1788361461.725911:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2351:x1875232130651904:12345-192.168.203.60@tcp:400:kworker.0 00000020:00000080:0.0:1788361461.725926:0:35346:0:(genops.c:1406:class_connect()) connect: client f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008, cookie 0xf6a94c97d661484f 00000100:00100000:1.0:1788361461.725958:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2351:x1875232130651904:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 52us (587us total) trans 0 rc 0/0 00000004:00100000:0.0:1788361461.725961:0:35346:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788361461.725980:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00080000:1.0:1788361461.726056:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361461.726275:0:35346:0:(import.c:65:import_set_state_nolock()) ffff9a89860a4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788361461.726320:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2348:x1875232130651392:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 450us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.726327:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361461.726415:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+5:2351:x1875232130652032:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 905us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361461.726431:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1788361461.732615:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361461.732708:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361461.733789:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130651648 00000100:00100000:3.0:1788361461.733800:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130651648 00000100:00100000:3.0:1788361461.733859:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130651520 00000100:00100000:3.0:1788361461.733863:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130651520 00000100:00100000:3.0:1788361461.733889:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361461.733898:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:31029:x1875232130651648:12345-192.168.203.60@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788361461.734128:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361461.734152:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:0:x1875232130651520:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788361461.734314:0:35346:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1788361461.734392:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:0:x1875232130651520:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 242us (1683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.734400:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000004:00000024:3.0:1788361461.734475:0:35345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00080000:1.0:1788361461.734895:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361461.735661:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31029:x1875232130651648:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 1760us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361461.735670:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1788361461.738315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361461.738368:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130652160 00000100:00100000:0.0:1788361461.738378:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130652160 00000100:00100000:0.0:1788361461.738437:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361461.738448:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31029:x1875232130652160:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788361461.738539:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31029:x1875232130652160:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361461.738547:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361461.741133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361461.741196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361461.741247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361461.741360:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130652288 00000100:00100000:1.0:1788361461.741370:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130652288 00000100:00100000:1.0:1788361461.741412:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130652416 00000100:00100000:1.0:1788361461.741416:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130652416 00000100:00100000:1.0:1788361461.741435:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361461.741443:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875232130652288:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788361461.741474:0:35982:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp t0 exp 0000000000000000 cur 851 last 0 00000020:00000080:1.0:1788361461.741505:0:35982:0:(genops.c:1406:class_connect()) connect: client f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008, cookie 0xf6a94c97d6614856 00002000:00100000:1.0:1788361461.741518:0:35982:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008/ffff9a8aae465800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788361461.741541:0:35982:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788361461.741718:0:35982:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788361461.741764:0:35982:0:(import.c:65:import_set_state_nolock()) ffff9a8aae467800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788361461.741838:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2348:x1875232130652288:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 394us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361461.741846:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361461.741866:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361461.741871:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875232130652416:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788361461.741885:0:35982:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp t0 exp 0000000000000000 cur 851 last 0 00000020:00000080:1.0:1788361461.741901:0:35982:0:(genops.c:1406:class_connect()) connect: client f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008, cookie 0xf6a94c97d661485d 00002000:00100000:1.0:1788361461.741919:0:35982:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008/ffff9a8aae463800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113802 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788361461.741925:0:35982:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788361461.741985:0:35982:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788361461.742000:0:35982:0:(import.c:65:import_set_state_nolock()) ffff9a8aae460000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788361461.742168:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130652544 00000100:00100000:2.0:1788361461.742177:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130652544 00000100:00100000:2.0:1788361461.742234:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:2.0:1788361461.742248:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31029:x1875232130652544:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788361461.742610:0:35349:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788361461.743143:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2348:x1875232130652416:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 1268us (1948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361461.743153:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788361461.744877:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31029:x1875232130652544:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 2624us (3623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361461.744890:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361461.839924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361461.840034:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130652672 00000100:00100000:1.0:1788361461.840044:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130652672 00000100:00100000:1.0:1788361461.840158:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361461.840169:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31058:x1875232130652672:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:1.0:1788361461.840189:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361461.840213:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6614864 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f28a expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361461.840307:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361461.840323:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361461.840338:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361461.840552:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788361461.840556:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361461.840619:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361461.840652:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d6614864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f28a expref: 8 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361461.840671:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f28a expref: 7 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361461.840680:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:1.0:1788361461.840683:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361461.840687:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef800, rc 0) 00000100:00100000:1.0:1788361461.840755:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:31058:x1875232130652672:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 588us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361461.840762:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00010000:00010000:1.0:1788361462.177515:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788361462.465132:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008 00000001:00100000:1.0:1788361462.465147:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c05f3090-241b-43d5-9787-08721e3d4333 00010000:00010000:1.0:1788361463.201240:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361463.353924:0:37208:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788361464.227259:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361464.992275:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361464.992304:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144202624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361464.992401:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361464.992500:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144202624 00000100:00100000:1.0:1788361464.992509:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144202624 00000100:00100000:1.0:1788361464.992585:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361464.992597:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144202624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361464.992643:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361464.992649:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144203136:0@lo:400:kworker.0 00000100:00100000:0.0:1788361464.992695:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361464.992702:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144202624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361464.992717:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361464.992725:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361464.992734:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144203008:0@lo:400:kworker.0 00000100:00080000:1.0:1788361464.992742:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361464.992767:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361464.992793:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144202624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361464.992801:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144203136 00000100:00100000:0.0:1788361464.992806:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144203136 00000100:00100000:2.0:1788361464.992898:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144202880:0@lo:400:kworker.0 00000100:00100000:3.0:1788361464.992900:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144202752:0@lo:400:kworker.0 00000100:00100000:3.0:1788361464.993063:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361464.993067:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144203008 00000100:00100000:1.0:1788361464.993071:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144203008 00000100:00100000:3.0:1788361464.993111:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144203264:0@lo:400:kworker.0 00000100:00100000:1.0:1788361464.993116:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788361464.993123:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144203136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361464.993167:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361464.993171:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144203136:12345-0@lo:400:kworker.0 Request processed in 46us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361464.993179:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144203008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361464.993182:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788361464.993220:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361464.993238:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144203008:12345-0@lo:400:kworker.0 Request processed in 61us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361464.993246:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144203008:0@lo:400:kworker.0 00000100:00100000:0.0:1788361464.993247:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788361464.993267:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144203136:0@lo:400:kworker.0 00000100:00100000:1.0:1788361464.993316:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144202752 00000100:00100000:1.0:1788361464.993319:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144202752 00000100:00100000:3.0:1788361464.993343:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361464.993350:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788361464.993358:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144202752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361464.993395:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144202752:12345-0@lo:400:kworker.0 Request processed in 38us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361464.993401:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788361464.993405:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144202752:0@lo:400:kworker.0 00000100:00100000:0.0:1788361464.993466:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144203264 00000100:00100000:0.0:1788361464.993470:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144203264 00000100:00100000:0.0:1788361464.993502:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788361464.993509:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144203264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361464.993551:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144203264:12345-0@lo:400:kworker.0 Request processed in 42us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361464.993559:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361464.993562:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144203264:0@lo:400:kworker.0 00000100:00100000:0.0:1788361464.993566:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788361464.993599:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361464.993626:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144202880 00000100:00100000:2.0:1788361464.993631:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144202880 00000100:00100000:2.0:1788361464.993663:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361464.993669:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144202880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361464.993707:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144202880:12345-0@lo:400:kworker.0 Request processed in 39us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361464.993713:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788361464.994756:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361464.995065:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144202880:0@lo:400:kworker.0 00000001:00100000:1.0:1788361465.024268:0:5819:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008 00000001:00100000:3.0:1788361465.031356:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008 00000001:00080000:3.0:1788361465.031381:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771073 is committed 00010000:00010000:1.0:1788361465.248300:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788361465.457030:0:37359:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb4b28ab0 20000000:00000080:0.0:1788361465.457054:0:37359:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9a89860aac00 uarg=0000000000000000 20000000:01000000:0.0:1788361465.457140:0:37359:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788361465.457147:0:37359:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788361465.457153:0:37359:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788361465.458428:0:37360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788361465.458956:0:37359:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788361465.458968:0:37359:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788361465.458990:0:37359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459011:0:37359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a841ef600/0xf6a94c97d661454d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614546 expref: 18 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459020:0:37359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d661459a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614593 expref: 18 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459027:0:37359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66146e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d66146dc expref: 18 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459037:0:37359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8a89bcbe00/0xf6a94c97d661473e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1fe expref: 12 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459045:0:37359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9a8985964200/0xf6a94c97d6614848 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f260 expref: 12 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459053:0:37359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459148:0:37359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8985964200/0xf6a94c97d6614848 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f260 expref: 12 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459176:0:37359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8985964200/0xf6a94c97d6614848 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f260 expref: 12 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361465.459207:0:37359:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37359:1875232144203392:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361465.459349:0:37359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a89bcbe00/0xf6a94c97d661473e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1fe expref: 12 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459358:0:37359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a89bcbe00/0xf6a94c97d661473e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1fe expref: 12 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361465.459367:0:37359:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37359:1875232144203520:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361465.459398:0:37359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66146e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d66146dc expref: 18 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459406:0:37359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66146e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d66146dc expref: 18 pid: 35339 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361465.459416:0:37359:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37359:1875232144203648:0@lo:104: 00000100:00100000:3.0:1788361465.459460:0:37359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361465.459510:0:37359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d661459a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6614593 expref: 18 pid: 35340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459519:0:37359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d661459a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6614593 expref: 18 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361465.459527:0:37359:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37359:1875232144203776:0@lo:104: 00000100:00100000:3.0:1788361465.459550:0:37359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788361465.459593:0:37359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9a8a841ef600/0xf6a94c97d661454d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf6a94c97d6614546 expref: 18 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.459603:0:37359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9a8a841ef600/0xf6a94c97d661454d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf6a94c97d6614546 expref: 18 pid: 35341 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361465.459612:0:37359:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37359:1875232144203904:0@lo:104: 00000100:00100000:3.0:1788361465.459640:0:37359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361465.459653:0:37359:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361465.460026:0:35329:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788361465.460043:0:35329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144203648 00000100:00100000:0.0:1788361465.460051:0:35329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144203648 00000100:00100000:0.0:1788361465.460114:0:35329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144203776 00000100:00100000:0.0:1788361465.460129:0:35329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144203776 00000100:00100000:0.0:1788361465.460142:0:35329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144203904 00000100:00100000:0.0:1788361465.460145:0:35329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144203904 00000100:00100000:0.0:1788361465.460167:0:35329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361465.460177:0:35329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+5:37359:x1875232144203648:12345-0@lo:104: 00010000:00010000:0.0:1788361465.460202:0:35329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361465.460278:0:35329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361465.460285:0:35329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+5:37359:x1875232144203648:12345-0@lo:104: Request processed in 109us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361465.460306:0:37359:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37359:1875232144203648:0@lo:104: 00000100:00100000:0.0:1788361465.460308:0:35329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361465.460333:0:35329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361465.460342:0:35329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+4:37359:x1875232144203776:12345-0@lo:104: 00010000:00010000:1.0:1788361465.460345:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361465.460352:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361465.460352:0:35329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460373:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965000 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361465.460377:0:35335:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460384:0:35335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361465.460390:0:35335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361465.460394:0:35335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788361465.460410:0:35329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788361465.460416:0:35329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+4:37359:x1875232144203776:12345-0@lo:104: Request processed in 76us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361465.460423:0:35329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788361465.460425:0:35335:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460431:0:35335:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788361465.460436:0:35329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788361465.460444:0:35329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89244450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+3:37359:x1875232144203904:12345-0@lo:104: 00010000:00010000:1.0:1788361465.460452:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361465.460453:0:35329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460472:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985965000/0xf6a94c97d66146dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d66146e3 expref: -99 pid: 36653 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460487:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788361465.460490:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361465.460494:0:35329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788361465.460495:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964800 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361465.460501:0:35335:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361465.460504:0:35329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89244450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+3:37359:x1875232144203904:12345-0@lo:104: Request processed in 59us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361465.460519:0:35329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788361465.460520:0:35335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361465.460526:0:35335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361465.460529:0:35335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788361465.460542:0:35335:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460545:0:35335:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361465.460558:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460562:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985964800/0xf6a94c97d6614593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661459a expref: -99 pid: 35979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460569:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361465.460571:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460575:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964e00 already unused, calling callback (ffffffffc1ba5c20) 10000000:00010000:1.0:1788361465.460577:0:35335:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460581:0:35335:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788361465.460584:0:35335:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788361465.460591:0:35335:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788361465.460602:0:35335:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460606:0:35335:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788361465.460613:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.460618:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff9a8985964e00/0xf6a94c97d6614546 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf6a94c97d661454d expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361465.460618:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361465.460627:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361465.460632:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361465.460634:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361465.460636:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361465.460652:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144204160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361465.460653:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361465.460667:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144204032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788361465.460685:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361465.460706:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361465.460717:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361465.460723:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144204288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788361465.460756:0:37359:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37359:1875232144203776:0@lo:104: 00000100:00100000:1.0:1788361465.460763:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361465.460772:0:37359:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37359:1875232144203904:0@lo:104: 00000100:00100000:1.0:1788361465.460805:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144204160 00000100:00100000:1.0:1788361465.460810:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144204160 00010000:00010000:1.0:1788361465.460831:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d661459a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6614593 expref: 19 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361465.462296:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144204032 00000100:00100000:1.0:1788361465.462309:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144204032 00010000:00010000:1.0:1788361465.462348:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66146e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66146dc expref: 20 pid: 35339 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361465.462857:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144204288 00000100:00100000:2.0:1788361465.462863:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144204288 00010000:00010000:2.0:1788361465.462887:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a841ef600/0xf6a94c97d661454d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6614546 expref: 21 pid: 35341 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361465.463112:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361465.463133:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+21:3313:x1875232144204160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361465.463153:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361465.463160:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d661459a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6614593 expref: 21 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361465.463172:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d661459a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6614593 expref: 21 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361465.463190:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1f400/0xf6a94c97d661459a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6614593 expref: 21 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361465.463218:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361465.463299:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+20:3313:x1875232144204160:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361465.463307:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361465.463388:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361465.463395:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144204032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361465.463404:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361465.463409:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66146e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d66146dc expref: 19 pid: 35339 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361465.463441:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66146e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d66146dc expref: 19 pid: 35339 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361465.463458:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144204160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361465.463491:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a8df1e800/0xf6a94c97d66146e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d66146dc expref: 19 pid: 35339 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361465.463512:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361465.463788:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:3311:x1875232144204032:12345-0@lo:103:ldlm_bl.0 Request processed in 392us (3083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361465.463795:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788361465.463808:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361465.463824:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8419e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:3313:x1875232144204288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788361465.463832:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361465.463837:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a841ef600/0xf6a94c97d661454d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf6a94c97d6614546 expref: 17 pid: 35341 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361465.463845:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a841ef600/0xf6a94c97d661454d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf6a94c97d6614546 expref: 17 pid: 35341 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361465.463856:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a841ef600/0xf6a94c97d661454d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf6a94c97d6614546 expref: 17 pid: 35341 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361465.463865:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361465.463892:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8419e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:3313:x1875232144204288:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (3138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361465.463898:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788361465.463961:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144204288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788361465.464604:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144204032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788361465.464723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361465.464806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361465.464904:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130652800 00000100:00100000:3.0:1788361465.464911:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130652800 00000100:00100000:1.0:1788361465.464913:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130652928 00000100:00100000:1.0:1788361465.464921:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130652928 00010000:00010000:3.0:1788361465.464942:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8985964200/0xf6a94c97d6614848 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f260 expref: 14 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.464946:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9a8a89bcbe00/0xf6a94c97d661473e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1fe expref: 14 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361465.464975:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361465.465019:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+14:2350:x1875232130652800:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361465.465033:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361465.465037:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8985964200/0xf6a94c97d6614848 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f260 expref: 14 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.465048:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8985964200/0xf6a94c97d6614848 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f260 expref: 14 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361465.465063:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361465.465362:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+14:2350:x1875232130652800:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 377us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361465.466117:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1788361465.466135:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+14:2350:x1875232130652928:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361465.466151:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361465.466159:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9a8a89bcbe00/0xf6a94c97d661473e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1fe expref: 14 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466173:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9a8a89bcbe00/0xf6a94c97d661473e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1fe expref: 14 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466190:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466210:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466228:0:35333:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466235:0:35333:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466244:0:35333:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361465.466249:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:1.0:1788361465.466271:0:35333:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466279:0:35333:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbc00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361465.466284:0:35333:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466293:0:35333:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466304:0:35333:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466317:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361465.466357:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130652928:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 229us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361465.466366:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:1.0:1788361465.466444:0:37359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8985964200/0xf6a94c97d6614848 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f260 expref: 12 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361465.466460:0:37359:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37359:1875232144203392:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361465.466474:0:37359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a89bcbe00/0xf6a94c97d661473e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f1fe expref: 11 pid: 35340 timeout: 955 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361465.466483:0:37359:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:37359:1875232144203520:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361465.466517:0:37359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466537:0:37359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466544:0:37359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361465.466551:0:37359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9a8a89bcbc00/0xf6a94c97d6614872 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 37359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361465.507438:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144204416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361465.507529:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361465.507640:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144204416 00000100:00100000:1.0:1788361465.507650:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144204416 00000100:00100000:1.0:1788361465.507712:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361465.507723:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144204416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361465.507780:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361465.512525:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144204416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4788us (4980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361465.512544:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788361465.512711:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144204416:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361466.273927:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361466.304801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.305081:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130653056 00000100:00100000:0.0:1788361466.305126:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130653056 00000100:00100000:0.0:1788361466.305256:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788361466.305268:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:31512:x1875232130653056:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361466.305291:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.305316:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614879 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f291 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.305394:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614880 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.305421:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.305436:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.305453:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614887 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.305461:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.305468:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361466.305652:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788361466.306713:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661488e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.306732:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661488e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.306743:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661488e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.307014:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788361466.307019:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361466.307141:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661488e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307155:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614880 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307161:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614880 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307167:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614880 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307173:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.307177:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614880 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307184:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614880 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307209:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361466.307219:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.307225:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307231:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6614880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307245:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614887 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307316:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614887 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307322:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614887 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307326:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.307329:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614887 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307335:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614887 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307344:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a8a90b43400) 00010000:00010000:0.0:1788361466.307346:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.307350:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614887 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307356:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964800/0xf6a94c97d6614887 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307401:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6614879 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f291 expref: 8 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307430:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661488e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f291 expref: 7 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.307438:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:0.0:1788361466.307440:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361466.307443:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965000, rc 0) 00000100:00100000:0.0:1788361466.307522:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+7:31512:x1875232130653056:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2257us (2739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.307531:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361466.312076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.312520:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130653312 00000100:00100000:0.0:1788361466.312531:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130653312 00000100:00100000:0.0:1788361466.312596:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1788361466.312606:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:31512:x1875232130653312:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361466.312630:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.312650:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614895 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f298 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.312733:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661489c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.312748:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661489c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.312760:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661489c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.312773:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66148a3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.312791:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66148a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.312799:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66148a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.313581:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66148aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.313593:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66148aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.313602:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66148aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.313613:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788361466.314112:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661489c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314120:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661489c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314126:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661489c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314132:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.314136:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661489c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314143:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661489c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314165:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:0.0:1788361466.314168:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.314173:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661489c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314178:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d661489c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314198:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66148a3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314205:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66148a3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314211:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66148a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314216:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.314219:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66148a3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314225:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66148a3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314232:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a90b43c00) 00010000:00010000:0.0:1788361466.314234:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.314237:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66148a3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.314242:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d66148a3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.315053:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6614895 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f298 expref: 10 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.315076:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66148aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f298 expref: 9 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.315113:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361466.315116:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.315119:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e000, rc 0) 00000100:00100000:0.0:1788361466.315243:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:31512:x1875232130653312:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2637us (3177us total) trans 30064771073 rc 0/0 00000100:00100000:0.0:1788361466.315261:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361466.319175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361466.319411:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130653440 00000100:00100000:3.0:1788361466.319422:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130653440 00000100:00100000:0.0:1788361466.319514:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361466.319526:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:31512:x1875232130653440:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788361466.319634:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:31512:x1875232130653440:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 111us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.319641:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1788361466.365591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.365719:0:35354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130653568 00000100:00100000:0.0:1788361466.365730:0:35354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130653568 00000100:00100000:0.0:1788361466.365853:0:35354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361466.365864:0:35354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c05f3090-241b-43d5-9787-08721e3d4333+9:31521:x1875232130653568:12345-192.168.203.60@tcp:700:mkdir.0 00000100:00100000:0.0:1788361466.365955:0:35354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:c05f3090-241b-43d5-9787-08721e3d4333+9:31521:x1875232130653568:12345-192.168.203.60@tcp:700:mkdir.0 Request processed in 93us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.365963:0:35354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788361466.368322:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361466.368611:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130653824 00000100:00100000:1.0:1788361466.368619:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130653824 00000100:00100000:1.0:1788361466.368674:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361466.368682:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:31521:x1875232130653824:12345-192.168.203.60@tcp:36:mkdir.0 00010000:00010000:1.0:1788361466.368736:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361466.368766:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965800/0xf6a94c97d6614833 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f228 expref: 9 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.368786:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:1.0:1788361466.368804:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361466.369128:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.369146:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f28a expref: 5 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.369156:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.369197:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f28a expref: 5 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.369211:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f28a expref: 5 pid: 37122 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361466.369225:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144204544:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361466.369313:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361466.371670:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144204544:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361466.371700:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.371909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361466.371977:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130653952 00000100:00100000:3.0:1788361466.371984:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130653952 00010000:00010000:3.0:1788361466.372042:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f28a expref: 6 pid: 37122 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361466.372072:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361466.372079:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130653952:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361466.372122:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361466.372131:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f28a expref: 6 pid: 37122 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.372144:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f28a expref: 6 pid: 37122 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.372168:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d661486b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f28a expref: 6 pid: 37122 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.372181:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00000100:00080000:1.0:1788361466.372254:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788361466.372303:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.372314:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.372330:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.372442:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361466.372495:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130653952:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 414us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361466.372502:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00010000:00010000:0.0:1788361466.372794:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.372803:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.372829:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.372840:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.372849:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.374379:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788361466.374397:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.374408:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.374415:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.374421:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ee200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.374426:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.374446:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.374463:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361466.374466:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.374472:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.374479:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d66148b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361466.374497:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000091633666 reply state 000000007f1a1cce transno 30064771074 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361466.374506:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361466.374687:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:31521:x1875232130653824:12345-192.168.203.60@tcp:36:mkdir.0 Request processed in 6002us (6377us total) trans 30064771074 rc 0/0 00000100:00100000:0.0:1788361466.374697:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00010000:00010000:1.0:1788361466.376427:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.376445:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.376452:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.376459:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361466.376463:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.376484:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.376500:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff9a8a90b43c00) 00010000:00010000:1.0:1788361466.376503:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361466.376508:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.376513:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66148bf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.390156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.390516:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130654080 00000100:00100000:0.0:1788361466.390533:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130654080 00000100:00100000:0.0:1788361466.390590:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1788361466.390600:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:31522:x1875232130654080:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361466.390627:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.390652:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66148c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f29f expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.390741:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66148cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.390939:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66148cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.390954:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66148cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.391023:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361466.391028:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361466.391070:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66148cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.391124:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66148c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f29f expref: 11 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.391144:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66148cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f29f expref: 10 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.391168:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361466.391171:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361466.391174:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:0.0:1788361466.391505:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:31522:x1875232130654080:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 904us (1355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.391514:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361466.393944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.394434:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130654208 00000100:00100000:0.0:1788361466.394443:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130654208 00000100:00100000:0.0:1788361466.394501:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788361466.394511:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:31522:x1875232130654208:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361466.394536:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.394572:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66148d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2a6 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394649:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66148db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394666:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66148db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394680:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66148db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394696:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66148e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394704:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66148e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394711:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66148e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394889:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66148e9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394897:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66148e9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394903:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66148e9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.394943:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788361466.394946:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361466.394967:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66148e9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394986:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66148db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394993:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66148db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.394999:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66148db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395005:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.395009:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66148db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395017:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66148db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395029:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361466.395032:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.395037:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66148db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395044:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66148db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395057:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66148e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395063:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66148e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395068:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66148e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395079:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.395083:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66148e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395111:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66148e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395120:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff9a8a90b43400) 00010000:00010000:0.0:1788361466.395122:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.395125:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66148e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395131:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d66148e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395164:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66148d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2a6 expref: 12 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395177:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66148e9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2a6 expref: 11 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.395185:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:0.0:1788361466.395667:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361466.395670:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e200, rc 0) 00000100:00100000:0.0:1788361466.395743:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+11:31522:x1875232130654208:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1232us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.395751:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1788361466.400430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361466.402858:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130654464 00000100:00100000:3.0:1788361466.402872:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130654464 00000100:00100000:3.0:1788361466.402986:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1788361466.402998:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:31522:x1875232130654464:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361466.403020:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361466.403041:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66148f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2ad expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361466.403182:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1788361466.403325:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66148f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2ad expref: 13 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.403342:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:3.0:1788361466.403345:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361466.403350:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66148f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2ad expref: 13 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.403364:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca400, rc 0) 00000100:00100000:3.0:1788361466.403439:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:31522:x1875232130654464:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 443us (3018us total) trans 30064771075 rc 301/301 00000100:00100000:3.0:1788361466.403464:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1788361466.407233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361466.407330:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130654720 00000100:00100000:1.0:1788361466.407341:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130654720 00000100:00100000:1.0:1788361466.407404:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361466.407416:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:31522:x1875232130654720:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:1.0:1788361466.407482:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361466.407512:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d66148e9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2a6 expref: 12 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.407531:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361466.407543:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361466.407573:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.407587:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.407598:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361466.407930:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a2b6511 reply state 000000003989f82d transno 30064771076 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361466.407940:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788361466.407956:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1788361466.408054:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:31522:x1875232130654720:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 639us (828us total) trans 30064771076 rc 0/0 00000100:00100000:1.0:1788361466.408061:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00010000:00010000:3.0:1788361466.410627:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.410644:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.410652:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.410658:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ee400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361466.410663:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.410672:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.410690:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8984a32800) 00010000:00010000:3.0:1788361466.410693:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788361466.410698:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.410760:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d66148fe lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.411974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.412068:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130654976 00000100:00100000:0.0:1788361466.412210:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130654976 00000100:00100000:0.0:1788361466.412263:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1788361466.412277:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:31522:x1875232130654976:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361466.412558:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:31522:x1875232130654976:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 282us (591us total) trans 30064771077 rc 0/0 00000100:00100000:0.0:1788361466.412566:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1788361466.414809:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.414937:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130655232 00000100:00100000:0.0:1788361466.414947:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130655232 00000100:00100000:0.0:1788361466.415042:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361466.415052:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:31522:x1875232130655232:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361466.415078:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.415135:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2b4 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415229:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661490c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415246:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661490c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415258:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661490c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415281:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614913 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415287:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415294:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.415462:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788361466.415565:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661490c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415573:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661490c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415580:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661490c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415587:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.415592:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661490c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415600:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661490c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415612:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361466.415615:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.415620:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661490c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415626:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661490c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415638:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614913 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415643:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614913 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415661:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614913 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415667:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.415670:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614913 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415677:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614913 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415685:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff9a8a90b43400) 00010000:00010000:0.0:1788361466.415688:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.415691:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614913 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415697:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614913 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415750:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614905 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2b4 expref: 15 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415760:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361466.415763:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361466.415766:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2b4 expref: 15 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.415775:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:0.0:1788361466.415835:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+14:31522:x1875232130655232:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 784us (1035us total) trans 30064771078 rc 301/301 00000100:00100000:0.0:1788361466.415851:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788361466.420304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.420358:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130655360 00000100:00100000:0.0:1788361466.420368:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130655360 00000100:00100000:0.0:1788361466.420426:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788361466.420435:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:31522:x1875232130655360:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361466.420683:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.420757:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614921 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2bb expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.420853:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6614928 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.420869:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6614928 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.420880:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6614928 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.420922:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788361466.420925:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361466.420941:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6614928 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.420963:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614921 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2bb expref: 16 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.420976:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6614928 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2bb expref: 15 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.420994:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:0.0:1788361466.420996:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361466.420999:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f800, rc 0) 00000100:00100000:0.0:1788361466.421049:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:31522:x1875232130655360:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 615us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.421054:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788361466.423972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.424016:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130655488 00000100:00100000:0.0:1788361466.424025:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130655488 00000100:00100000:0.0:1788361466.424082:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788361466.424378:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+15:31522:x1875232130655488:12345-192.168.203.60@tcp:37:lfs.0 00000100:00100000:0.0:1788361466.428579:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+15:31522:x1875232130655488:12345-192.168.203.60@tcp:37:lfs.0 Request processed in 4195us (4602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.428598:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1788361466.431676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361466.431746:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130655744 00000100:00100000:2.0:1788361466.431756:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130655744 00000100:00100000:0.0:1788361466.431842:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1788361466.431854:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+15:31522:x1875232130655744:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361466.432134:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+16:31522:x1875232130655744:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 282us (463us total) trans 30064771079 rc 0/0 00000100:00100000:0.0:1788361466.432142:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1788361466.456812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361466.458118:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130655872 00000100:00100000:3.0:1788361466.458129:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130655872 00000100:00100000:2.0:1788361466.458300:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788361466.458310:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+16:31523:x1875232130655872:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361466.458334:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361466.458359:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661492f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2c2 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458431:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614936 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458448:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458566:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458582:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661493d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458590:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661493d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458596:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661493d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458771:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614944 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458781:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614944 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458789:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614944 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361466.458825:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788361466.458829:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361466.458870:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614944 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458882:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614936 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458888:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614936 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458895:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614936 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458900:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361466.458904:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614936 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458910:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614936 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458926:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:2.0:1788361466.458935:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361466.458940:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614936 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458946:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614936 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458960:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661493d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458965:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661493d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458971:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661493d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458975:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361466.458978:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661493d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458983:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661493d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.458991:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff9a8a8beaeb00) 00010000:00010000:2.0:1788361466.458993:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361466.458995:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661493d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.459000:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661493d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.459035:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661492f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2c2 expref: 18 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.459062:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614944 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2c2 expref: 17 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.459069:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:2.0:1788361466.459072:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788361466.459074:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9e00, rc 0) 00000100:00100000:2.0:1788361466.459219:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:31523:x1875232130655872:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 911us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361466.459224:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788361466.461881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361466.461982:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130656128 00000100:00100000:1.0:1788361466.461992:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130656128 00000100:00100000:1.0:1788361466.462049:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361466.462057:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+17:31523:x1875232130656128:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361466.462080:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361466.462082:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361466.462142:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f800/0xf6a94c97d6614928 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2bb expref: 17 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.462162:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:1.0:1788361466.462167:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361466.462182:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d661494b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2c9 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.462557:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614952 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.462589:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614952 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.462600:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614952 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.462615:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.462623:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.462629:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.462846:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361466.462922:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130656256 00000100:00100000:3.0:1788361466.462927:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130656256 00000100:00100000:3.0:1788361466.462974:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361466.462982:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+18:2351:x1875232130656256:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361466.462999:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361466.463012:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614944 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2c2 expref: 18 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.463026:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:3.0:1788361466.463029:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361466.463109:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130656256:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 105us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361466.463117:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00010000:00010000:1.0:1788361466.465773:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d6614960 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.465794:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d6614960 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.465807:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d6614960 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361466.465963:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788361466.466000:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614952 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.466008:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614952 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.466015:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614952 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.466030:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841eee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361466.466035:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614952 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.466043:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614952 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.466057:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:1.0:1788361466.466060:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361466.466066:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614952 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.466072:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841eee00/0xf6a94c97d6614952 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361466.466106:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af9a2e90 reply state 00000000fdcf6ce6 transno 30064771080 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361466.466117:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361466.466161:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841efe00/0xf6a94c97d661494b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2c9 expref: 18 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.466184:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d6614960 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2c9 expref: 17 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.466201:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff9a8984a32b00) 00010000:00010000:1.0:1788361466.466204:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788361466.466207:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ee200, rc 0) 00000100:00100000:1.0:1788361466.466606:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+18:31523:x1875232130656128:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 4228us (4412us total) trans 30064771080 rc 0/0 00000100:00100000:1.0:1788361466.466624:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00010000:00010000:1.0:1788361466.468599:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.468618:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.468626:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.468632:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ef800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361466.468637:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.468645:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.468673:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff9a8984a32e00) 00010000:00010000:1.0:1788361466.468676:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361466.468681:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.468687:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef800/0xf6a94c97d6614959 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.480337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361466.480425:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130656512 00000100:00100000:3.0:1788361466.480434:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130656512 00000100:00100000:3.0:1788361466.480547:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361466.480557:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+17:31523:x1875232130656512:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:3.0:1788361466.481128:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+18:31523:x1875232130656512:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 571us (799us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1788361466.481137:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361466.483270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.483354:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130656640 00000100:00100000:0.0:1788361466.483363:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130656640 00000100:00100000:0.0:1788361466.483425:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788361466.483434:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+18:31523:x1875232130656640:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361466.483467:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.483505:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d661496e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2d0 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.483880:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614975 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.483897:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.483908:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.483923:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661497c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.483928:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661497c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.483934:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661497c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484235:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6614983 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484245:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6614983 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484252:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6614983 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.484287:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788361466.484291:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361466.484317:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6614983 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484339:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484346:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614975 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484354:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614975 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484360:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.484423:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614975 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484433:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614975 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484446:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361466.484449:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.484454:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614975 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484461:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614975 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484475:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661497c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484481:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661497c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484487:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661497c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484499:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.484502:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661497c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484508:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661497c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484516:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff9a8a90b43400) 00010000:00010000:0.0:1788361466.484518:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.484521:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661497c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484526:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d661497c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484561:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d661496e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2d0 expref: 20 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484574:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6614983 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2d0 expref: 19 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.484581:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.484584:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788361466.484586:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ea00, rc 0) 00000100:00100000:0.0:1788361466.484700:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+19:31523:x1875232130656640:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 1266us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.484708:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1788361466.489313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.489359:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130656768 00000100:00100000:0.0:1788361466.489384:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130656768 00000100:00100000:0.0:1788361466.489508:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:0.0:1788361466.489520:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+19:31523:x1875232130656768:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361466.489544:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.489565:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661498a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2d7 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489640:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614991 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489656:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614991 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489669:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614991 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489682:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614998 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489689:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614998 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489700:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614998 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489764:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614991 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489772:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614991 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489779:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614991 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489807:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.489812:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614991 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489821:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614991 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489843:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.489846:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.489852:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614991 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489859:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614991 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489882:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614998 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489888:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614998 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489894:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614998 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489899:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.489901:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614998 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489907:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614998 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489926:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff9a8a90b43000) 00010000:00010000:0.0:1788361466.489929:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.489932:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614998 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489938:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614998 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489977:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661498a lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2d7 expref: 20 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.489987:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.489989:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.489993:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661498a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2d7 expref: 20 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.490002:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:0.0:1788361466.490065:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+19:31523:x1875232130656768:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 547us (768us total) trans 0 rc 301/301 00000100:00100000:0.0:1788361466.490072:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1788361466.493346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.493489:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130657024 00000100:00100000:0.0:1788361466.493500:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130657024 00000100:00100000:0.0:1788361466.493557:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361466.493568:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:31523:x1875232130657024:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361466.493590:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.493611:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d661499f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2de expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.495227:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149a6 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.495250:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149a6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.495265:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149a6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.495286:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.495293:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.495299:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496392:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66149b4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496406:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66149b4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496415:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66149b4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.496428:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x3:0x0]: returning size 0 00010000:00010000:0.0:1788361466.496455:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149a6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496462:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149a6 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496475:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149a6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496481:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.496486:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149a6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496494:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149a6 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496505:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.496508:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.496513:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149a6 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496520:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149a6 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361466.496531:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2076ee7 reply state 00000000fd5cc27f transno 30064771082 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361466.496540:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361466.496575:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d661499f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2de expref: 22 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496588:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66149b4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2de expref: 21 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.496595:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:0.0:1788361466.496601:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788361466.496604:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:0.0:1788361466.496676:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130657024:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 3110us (3336us total) trans 30064771082 rc 0/0 00000100:00100000:0.0:1788361466.496685:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00010000:00010000:0.0:1788361466.499068:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.499174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1788361466.499263:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.499274:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.499280:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.499285:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.499293:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.499310:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff9a8a90b43400) 00010000:00010000:0.0:1788361466.499313:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.499318:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.499324:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149ad lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361466.499597:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130657280 00000100:00100000:3.0:1788361466.499607:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130657280 00000100:00100000:3.0:1788361466.499657:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1788361466.499667:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+21:31523:x1875232130657280:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788361466.499938:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.499954:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.499966:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361466.500024:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771083 00000004:00010000:3.0:1788361466.500047:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000461f5231 reply state 000000009f7aff09 transno 30064771084 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361466.500056:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361466.501499:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+24:31523:x1875232130657280:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 1826us (2322us total) trans 30064771084 rc 0/0 00000100:00100000:3.0:1788361466.501593:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000020:00080000:3.0:1788361466.501599:0:35347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788361466.504684:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.504719:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.504756:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.504763:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361466.504768:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.504776:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.504804:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:1.0:1788361466.504808:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361466.504813:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.504820:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66149c2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.508400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.508503:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130657536 00000100:00100000:0.0:1788361466.508512:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130657536 00000100:00100000:0.0:1788361466.508608:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361466.508618:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+23:31523:x1875232130657536:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1788361466.508878:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+24:31523:x1875232130657536:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 261us (486us total) trans 30064771085 rc 0/0 00000100:00100000:0.0:1788361466.508886:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361466.513016:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361466.513246:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130657792 00000100:00100000:2.0:1788361466.513258:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130657792 00000100:00100000:2.0:1788361466.513303:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:2.0:1788361466.513312:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+24:31523:x1875232130657792:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788361466.513378:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361466.513407:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66149b4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x3:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2de expref: 24 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.513445:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:2.0:1788361466.513458:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361466.513486:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66149c9 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.513501:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66149c9 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.513511:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66149c9 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.513524:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.513531:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.513537:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.513645:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66149d7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.513654:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66149d7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.513663:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66149d7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514519:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514543:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514553:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514562:0:35346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514568:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514574:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514633:0:35346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361466.514659:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66149d7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514665:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66149d7 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514672:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66149d7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514677:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361466.514682:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66149d7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514689:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66149d7 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514711:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:2.0:1788361466.514714:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361466.514719:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66149d7 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514725:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66149d7 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514749:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66149c9 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514756:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66149c9 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514761:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66149c9 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514766:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361466.514769:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66149c9 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514774:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66149c9 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514781:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361466.514783:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361466.514786:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66149c9 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.514792:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66149c9 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361466.514812:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002c84b870 reply state 00000000ab8c3c21 transno 30064771086 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.514821:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361466.514905:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:31523:x1875232130657792:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 1592us (1909us total) trans 30064771086 rc 0/0 00000100:00100000:2.0:1788361466.514913:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00010000:00010000:0.0:1788361466.514969:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361466.514976:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.514983:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361466.514986:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.514993:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.515002:0:35334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x3:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:0.0:1788361466.515004:0:35334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361466.515006:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.515011:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66149de lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.515025:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361466.515026:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361466.515028:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361466.516643:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.516659:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.516676:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.516682:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.516685:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.516693:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.516707:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xefc67454 (ffff9a8a8beaeb00) 00010000:00010000:0.0:1788361466.516710:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.516714:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.516720:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d66149d0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xefc67454 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361466.516967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.517405:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130657920 00000100:00100000:0.0:1788361466.517417:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130657920 00000100:00100000:0.0:1788361466.517471:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361466.517480:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+24:31523:x1875232130657920:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361466.517504:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.517521:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149e5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2e5 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517589:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66149ec lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517621:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66149ec lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517632:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66149ec lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517647:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149f3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517653:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517659:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517719:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66149ec lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517725:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66149ec lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517732:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66149ec lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517737:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.517740:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66149ec lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517746:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66149ec lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517754:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.517763:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.517768:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66149ec lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517773:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66149ec lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517889:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517896:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149f3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517903:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149f3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517908:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.517911:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149f3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517917:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149f3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517926:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff9a8a90b43400) 00010000:00010000:0.0:1788361466.517928:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.517931:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149f3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517936:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66149f3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517974:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149e5 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2e5 expref: 25 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.517991:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.517994:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.517998:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66149e5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2e5 expref: 25 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.518007:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e600, rc 0) 00000100:00100000:0.0:1788361466.518065:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+24:31523:x1875232130657920:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 585us (1100us total) trans 0 rc 301/301 00000100:00100000:0.0:1788361466.518073:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:2.0:1788361466.520012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.520222:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130658176 00000100:00100000:0.0:1788361466.520231:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130658176 00000100:00100000:0.0:1788361466.520282:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788361466.520292:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+24:31523:x1875232130658176:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361466.520312:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.520331:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66149fa lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2ec expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.520692:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a01 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.520771:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a01 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.520785:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a01 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.520800:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.520818:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.520826:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521434:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614a0f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521445:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614a0f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521668:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614a0f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.521684:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788361466.521828:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a01 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521836:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a01 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521843:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a01 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521849:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.521853:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a01 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521861:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a01 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521885:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.521888:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.521893:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a01 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521900:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a01 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361466.521913:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b64e30e5 reply state 0000000029612649 transno 30064771087 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361466.521922:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361466.521960:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66149fa lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2ec expref: 27 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521975:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614a0f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2ec expref: 26 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.521983:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:0.0:1788361466.521986:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788361466.521988:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:0.0:1788361466.522200:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:31523:x1875232130658176:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 1909us (2194us total) trans 30064771087 rc 0/0 00000100:00100000:0.0:1788361466.522209:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00010000:00010000:1.0:1788361466.523786:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.523802:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.523810:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.523817:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361466.523820:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.523837:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.523849:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff9a8a90b43000) 00010000:00010000:1.0:1788361466.523851:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361466.523855:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.523859:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a08 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.525202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361466.525311:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130658432 00000100:00100000:3.0:1788361466.525321:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130658432 00000100:00100000:3.0:1788361466.525802:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:3.0:1788361466.525816:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+26:31523:x1875232130658432:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788361466.526270:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.526290:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.526302:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361466.526355:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771088 00000004:00010000:3.0:1788361466.526380:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000005cba502 reply state 0000000017b713df transno 30064771089 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361466.526389:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361466.526698:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:31523:x1875232130658432:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 885us (1511us total) trans 30064771089 rc 0/0 00000100:00100000:3.0:1788361466.526763:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000020:00080000:3.0:1788361466.526769:0:35347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788361466.528925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1788361466.529130:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.529142:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.529161:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.529168:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.529173:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.529181:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.529204:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:0.0:1788361466.529208:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.529212:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.529219:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6614a1d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361466.529293:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130658688 00000100:00100000:3.0:1788361466.529301:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130658688 00000100:00100000:3.0:1788361466.529418:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361466.529428:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:31523:x1875232130658688:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000040:00080000:1.0:1788361466.529679:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788361466.529703:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:31523:x1875232130658688:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 277us (784us total) trans 30064771090 rc 0/0 00000100:00100000:3.0:1788361466.530272:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1788361466.531573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.531638:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130658944 00000100:00100000:0.0:1788361466.531645:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130658944 00000100:00100000:0.0:1788361466.531690:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:0.0:1788361466.531699:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:31523:x1875232130658944:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361466.531729:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.531748:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6614a24 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2f3 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.531850:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614a2b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.531865:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614a2b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.531888:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614a2b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.531902:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1788361466.532067:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f000/0xf6a94c97d6614a24 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2f3 expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.532109:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614a2b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2f3 expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.532118:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:0.0:1788361466.532121:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788361466.532124:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f400, rc 0) 00000100:00100000:0.0:1788361466.532163:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:31523:x1875232130658944:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 466us (594us total) trans 30064771091 rc 0/0 00000100:00100000:0.0:1788361466.532171:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1788361466.535355:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.535432:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130659200 00000100:00100000:0.0:1788361466.535441:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130659200 00000100:00100000:0.0:1788361466.535596:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361466.535607:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:31523:x1875232130659200:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1788361466.535863:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:31523:x1875232130659200:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 257us (516us total) trans 30064771092 rc 0/0 00000100:00100000:0.0:1788361466.535871:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1788361466.537920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.538236:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130659456 00000100:00100000:0.0:1788361466.538245:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130659456 00000100:00100000:0.0:1788361466.538393:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788361466.538417:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+32:31523:x1875232130659456:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788361466.538541:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788361466.538573:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614a2b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2f3 expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.538594:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614a0f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2ec expref: 31 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.538604:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:0.0:1788361466.538616:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361466.538640:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614a39 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.538655:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614a39 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.538666:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614a39 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.538682:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.538688:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.538694:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.538814:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614a47 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.538832:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614a47 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.538840:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614a47 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539377:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539388:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539396:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539402:0:37122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539409:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539415:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539514:0:37122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361466.539535:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614a47 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539542:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614a47 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539548:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614a47 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539560:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.539564:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614a47 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539572:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614a47 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539582:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:0.0:1788361466.539585:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788361466.539590:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614a47 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539596:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614a47 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539613:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614a39 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539619:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614a39 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539624:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614a39 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539629:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.539633:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614a39 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539639:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614a39 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539657:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.539659:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.539663:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614a39 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.539669:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614a39 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361466.539679:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efd9b300 reply state 0000000081a0fcfd transno 30064771093 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361466.539687:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361466.539771:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+32:31523:x1875232130659456:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 1355us (1856us total) trans 30064771093 rc 0/0 00000100:00100000:0.0:1788361466.539779:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00010000:00010000:1.0:1788361466.539850:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361466.539857:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.539863:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361466.539866:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.539872:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.539881:0:35335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x4:0x0].0x0 (ffff9a8a90b43d00) 00010000:00010000:1.0:1788361466.539883:0:35335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788361466.539886:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.539891:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614a4e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.539916:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361466.539918:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361466.539919:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361466.542366:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.542383:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.542390:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.542396:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361466.542400:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.542408:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.542424:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x8635a1a7 (ffff9a8a90b43400) 00010000:00010000:1.0:1788361466.542427:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361466.542431:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.542437:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614a40 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x8635a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.543786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.543886:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130659584 00000100:00100000:0.0:1788361466.543895:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130659584 00000100:00100000:0.0:1788361466.543983:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:0.0:1788361466.544057:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:31523:x1875232130659584:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361466.544083:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.544125:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a55 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f2fa expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544276:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a5c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544290:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a5c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544319:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a5c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544336:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a63 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544343:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a63 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544350:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a63 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544412:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a5c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544419:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a5c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544425:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a5c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544431:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.544434:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a5c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544441:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a5c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544452:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.544455:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.544459:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a5c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544471:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a5c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544484:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a63 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544489:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a63 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544495:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a63 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544500:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.544503:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a63 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544510:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a63 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544518:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff9a8a90b43900) 00010000:00010000:0.0:1788361466.544520:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.544523:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a63 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544597:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a63 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544640:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a55 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2fa expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544662:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.544665:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.544669:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a55 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2fa expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.544679:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:0.0:1788361466.544733:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:31523:x1875232130659584:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 742us (954us total) trans 0 rc 301/301 00000100:00100000:0.0:1788361466.544740:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:2.0:1788361466.546632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361466.546762:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130659840 00000100:00100000:3.0:1788361466.546770:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130659840 00000100:00100000:3.0:1788361466.546881:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:3.0:1788361466.546892:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+31:31523:x1875232130659840:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788361466.546913:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361466.546933:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6614a6a lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f301 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.547063:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6614a71 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.547077:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6614a71 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.547531:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6614a71 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.547809:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.547820:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.547827:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549319:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549333:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549354:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361466.549367:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 0 00010000:00010000:2.0:1788361466.549397:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6614a71 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549403:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6614a71 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549410:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6614a71 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549416:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361466.549420:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6614a71 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549427:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6614a71 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549438:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361466.549440:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361466.549445:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6614a71 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549506:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6614a71 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361466.549522:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007c294bc5 reply state 000000004ee24a20 transno 30064771094 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.549542:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361466.549581:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6614a6a lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f301 expref: 34 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549597:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f301 expref: 33 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.549604:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:2.0:1788361466.549607:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788361466.549609:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:2.0:1788361466.549791:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:31523:x1875232130659840:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 2899us (3166us total) trans 30064771094 rc 0/0 00000100:00100000:2.0:1788361466.549799:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00010000:00010000:0.0:1788361466.552395:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.552414:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.552422:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.552429:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.552434:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.552442:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.552460:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff9a8a8beae600) 00010000:00010000:0.0:1788361466.552463:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.552468:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.552487:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614a78 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.554277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.554399:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130660096 00000100:00100000:0.0:1788361466.554410:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130660096 00000100:00100000:0.0:1788361466.554469:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788361466.554479:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:31523:x1875232130660096:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788361466.554774:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.554796:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.554807:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361466.554862:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771095 00000004:00010000:0.0:1788361466.554889:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f62a7646 reply state 00000000b4720b0c transno 30064771096 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361466.554898:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361466.554993:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:31523:x1875232130660096:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 515us (723us total) trans 30064771096 rc 0/0 00000100:00100000:0.0:1788361466.555124:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000020:00080000:0.0:1788361466.555129:0:35345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788361466.556362:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.556381:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.556415:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.556424:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361466.556432:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.556443:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.556468:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:1.0:1788361466.556471:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361466.556476:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.556487:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614a8d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.561373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.561491:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130660224 00000100:00100000:0.0:1788361466.561503:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130660224 00000100:00100000:0.0:1788361466.561561:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:0.0:1788361466.561569:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:31524:x1875232130660224:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361466.561602:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.561623:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f308 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.561700:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.561716:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.561728:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.561783:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361466.561786:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361466.561805:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.561829:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614a94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f308 expref: 7 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.561844:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f308 expref: 6 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.561851:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361466.561854:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361466.561857:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fc00, rc 0) 00000100:00100000:0.0:1788361466.561907:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31524:x1875232130660224:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 339us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.561913:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1788361466.564890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.564976:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130660352 00000100:00100000:0.0:1788361466.564986:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130660352 00000100:00100000:0.0:1788361466.565046:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:0.0:1788361466.565060:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31524:x1875232130660352:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361466.565129:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.565178:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614aa2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f30f expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.565255:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614aa9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.565272:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.565289:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.565304:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614ab0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.565311:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.565317:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.565430:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614ab7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.565438:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614ab7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566178:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614ab7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361466.566551:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788361466.566557:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361466.566584:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614ab7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566598:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566606:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614aa9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566613:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566619:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.566623:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566631:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566644:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361466.566647:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.566652:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614aa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566658:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614aa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566686:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566691:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566698:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566703:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361466.566705:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566711:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566719:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff9a8a90b43900) 00010000:00010000:0.0:1788361466.566722:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361466.566724:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614ab0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.566730:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614ab0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.567120:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614aa2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f30f expref: 8 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.567137:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614ab7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f30f expref: 7 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.567158:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361466.567160:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788361466.567163:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f400, rc 0) 00000100:00100000:0.0:1788361466.567242:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:31524:x1875232130660352:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 2183us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.567252:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1788361466.570470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361466.570616:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130660608 00000100:00100000:2.0:1788361466.570625:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130660608 00000100:00100000:2.0:1788361466.570681:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1788361466.570691:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:31524:x1875232130660608:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361466.570713:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361466.570735:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614abe lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f316 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.570842:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ac5 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.570868:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ac5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.570881:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ac5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.570898:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614acc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.570906:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614acc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.570913:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614acc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571041:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614ad3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571050:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614ad3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571057:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614ad3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361466.571067:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00010000:00010000:2.0:1788361466.571220:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ac5 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571229:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ac5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571235:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ac5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571247:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361466.571252:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ac5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571259:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ac5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571272:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361466.571274:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361466.571279:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ac5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571285:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ac5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571299:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614acc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571304:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614acc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571310:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614acc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571315:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361466.571317:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614acc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571323:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614acc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571343:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361466.571345:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361466.571348:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614acc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571353:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614acc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571398:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614abe lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f316 expref: 10 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571411:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614ad3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f316 expref: 9 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.571418:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:2.0:1788361466.571420:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361466.571423:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361466.571942:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+9:31524:x1875232130660608:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 1250us (1490us total) trans 30064771097 rc 0/0 00000100:00100000:2.0:1788361466.571951:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1788361466.577072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361466.577460:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130660864 00000100:00100000:3.0:1788361466.577468:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130660864 00000100:00100000:3.0:1788361466.577526:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361466.577535:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+9:31524:x1875232130660864:12345-192.168.203.60@tcp:103:mmap_sanity.0 00010000:00010000:3.0:1788361466.577551:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361466.577578:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614ad3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f316 expref: 9 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361466.577598:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:3.0:1788361466.577602:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361466.577653:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:31524:x1875232130660864:12345-192.168.203.60@tcp:103:mmap_sanity.0 Request processed in 119us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361466.577661:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1788361466.579948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361466.580071:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130660992 00000100:00100000:2.0:1788361466.580081:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130660992 00000100:00100000:2.0:1788361466.580366:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:2.0:1788361466.580376:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:31524:x1875232130660992:12345-192.168.203.60@tcp:58:mmap_sanity.0 00010000:00010000:2.0:1788361466.580500:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.580537:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f301 expref: 34 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.580546:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.580585:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f301 expref: 34 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.580600:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f301 expref: 34 pid: 35347 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361466.580616:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89266d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144204672:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361466.580735:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361466.586957:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89266d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144204672:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361466.586994:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361466.588689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361466.588819:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130661120 00000100:00100000:1.0:1788361466.588829:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130661120 00010000:00010000:1.0:1788361466.588871:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f301 expref: 35 pid: 35347 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361466.588916:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1788361466.588926:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+35:2349:x1875232130661120:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361466.588941:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361466.588950:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f301 expref: 35 pid: 35347 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.588981:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f301 expref: 35 pid: 35347 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.589006:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614a7f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f301 expref: 35 pid: 35347 timeout: 956 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.589026:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:1.0:1788361466.589032:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.589042:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.589050:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361466.589571:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361466.589637:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:2349:x1875232130661120:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 711us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361466.589646:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00010000:00010000:2.0:1788361466.589935:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361466.589944:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361466.591900:0:35345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788361466.592030:0:35345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 64 off8640 00000040:00080000:2.0:1788361466.592126:0:35345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].1, 136 off8328 00000100:00100000:2.0:1788361466.592320:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:31524:x1875232130660992:12345-192.168.203.60@tcp:58:mmap_sanity.0 Request processed in 11941us (12378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361466.592340:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1788361466.596869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361466.598896:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130661248 00000100:00100000:0.0:1788361466.598912:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130661248 00000100:00100000:0.0:1788361466.598990:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:0.0:1788361466.599000:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:31524:x1875232130661248:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361466.599026:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361466.599051:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614ae8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f31d expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.599156:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.599169:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614ae8 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f31d expref: 9 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.599197:0:37122:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.599211:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614ae8 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f31d expref: 9 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.599244:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:0.0:1788361466.599247:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361466.599252:0:37122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614ae8 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f31d expref: 9 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361466.599260:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:0.0:1788361466.599332:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+9:31524:x1875232130661248:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 333us (2473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361466.599339:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:0.0:1788361467.018483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.018528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.018558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.018600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.018629:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130661376 00000100:00100000:0.0:1788361467.018638:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130661376 00000100:00100000:0.0:1788361467.018684:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:0.0:1788361467.018695:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:2350:x1875232130661376:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361467.018699:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130661504 00000100:00100000:2.0:1788361467.018706:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130661504 00000100:00100000:2.0:1788361467.018764:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361467.018770:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:2350:x1875232130661376:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 75us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361467.018779:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+34:2349:x1875232130661504:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361467.018785:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:3.0:1788361467.018858:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130661760 00000100:00100000:3.0:1788361467.018862:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130661760 00000100:00100000:1.0:1788361467.018962:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130662016 00000100:00100000:1.0:1788361467.018966:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130662016 00000100:00100000:3.0:1788361467.019023:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361467.019031:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+5:2349:x1875232130661760:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361467.019551:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+34:2349:x1875232130661504:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 776us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361467.019558:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00080000:2.0:1788361467.022586:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361467.022595:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361467.022732:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.022920:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130661632 00000100:00100000:0.0:1788361467.022929:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130661632 00000100:00100000:3.0:1788361467.022960:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+5:2349:x1875232130661760:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 3927us (4429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361467.022970:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361467.023019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.023040:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361467.023054:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130662016:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361467.023058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.023103:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.023120:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130662016:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 70us (4560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.023128:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361467.023157:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130662144 00000100:00080000:2.0:1788361467.023161:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361467.023161:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130662144 00000100:00100000:2.0:1788361467.023179:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130661888 00000100:00100000:2.0:1788361467.023202:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130661888 00000100:00100000:1.0:1788361467.023207:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00080000:2.0:1788361467.023211:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361467.023216:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130662144:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361467.023249:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361467.023255:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130662144:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361467.023262:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+9:2350:x1875232130661888:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361467.023265:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361467.023312:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130662272 00000100:00100000:1.0:1788361467.023316:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130662272 00000100:00100000:1.0:1788361467.023339:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:1.0:1788361467.023345:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+11:30912:x1875232130662272:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361467.023355:0:35341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361467.023375:0:35341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841ef800/0xf6a94c97d6614aef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f324 expref: -99 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.023401:0:35341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841ef800/0xf6a94c97d6614aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f324 expref: 12 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.023413:0:35341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841ef800/0xf6a94c97d6614aef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f324 expref: 12 pid: 35341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.023423:0:35341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841ef800, rc 0) 00000100:00100000:1.0:1788361467.023440:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+12:30912:x1875232130662272:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 96us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.023447:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:2.0:1788361467.023486:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+9:2350:x1875232130661888:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 225us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361467.023494:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1788361467.024373:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361467.024387:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+5:2350:x1875232130661632:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361467.024444:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+5:2350:x1875232130661632:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 62us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361467.024460:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1788361467.027274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.027420:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130662400 00000100:00100000:1.0:1788361467.027430:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130662400 00000100:00100000:1.0:1788361467.027603:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:1.0:1788361467.027625:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+12:30912:x1875232130662400:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361467.028405:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+12:30912:x1875232130662400:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 778us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.028415:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:2.0:1788361467.030519:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.031397:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130662528 00000100:00100000:1.0:1788361467.031407:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130662528 00000100:00100000:1.0:1788361467.031487:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:1.0:1788361467.031498:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+12:30912:x1875232130662528:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361467.031692:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+12:30912:x1875232130662528:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 195us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.031700:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:2.0:1788361467.036512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.036645:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130662656 00000100:00100000:1.0:1788361467.036654:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130662656 00000100:00100000:1.0:1788361467.036713:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:1.0:1788361467.036723:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+12:30912:x1875232130662656:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361467.036741:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361467.036761:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841efe00/0xf6a94c97d6614af6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f32b expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.036804:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841efe00/0xf6a94c97d6614af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f32b expref: 13 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.036825:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841efe00/0xf6a94c97d6614af6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f32b expref: 13 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.036835:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841efe00, rc 0) 00000100:00100000:1.0:1788361467.036906:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:30912:x1875232130662656:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 184us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.036913:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:2.0:1788361467.038386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.038456:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130662784 00000100:00100000:1.0:1788361467.038463:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130662784 00000100:00100000:1.0:1788361467.038514:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:1.0:1788361467.038522:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:30912:x1875232130662784:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361467.038783:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:30912:x1875232130662784:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 261us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.038791:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 10000000:01000000:0.0:1788361467.040159:0:35343:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361467.040164:0:35343:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8ac1c6e000 from 10 10000000:01000000:0.0:1788361467.040169:0:35343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361467.040672:0:35343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6614afd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.040685:0:35343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6614afd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.040696:0:35343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6614afd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361467.040721:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144204800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361467.040769:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361467.040830:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83c98300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361467.040908:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144204800 00000100:00100000:1.0:1788361467.040916:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144204800 00000100:00100000:1.0:1788361467.040994:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788361467.041003:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+16:35343:x1875232144204800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361467.041016:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361467.041029:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841eee00/0xf6a94c97d6614b04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6614afd expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.041054:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841eee00/0xf6a94c97d6614b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6614afd expref: 17 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.041065:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841eee00/0xf6a94c97d6614b04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614afd expref: 17 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.041076:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841eee00, rc 0) 00000100:00100000:1.0:1788361467.041151:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:35343:x1875232144204800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.041172:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788361467.041322:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144204800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361467.041339:0:35343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6614afd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614b04 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.041362:0:35343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6614afd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6614b04 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361467.041400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.041484:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144204928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788361467.041513:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361467.043743:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361467.043855:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130662912 00000100:00100000:0.0:1788361467.043863:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130662912 00000100:00100000:1.0:1788361467.043900:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144204928 00000100:00100000:1.0:1788361467.043904:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144204928 00000100:00100000:0.0:1788361467.043921:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:0.0:1788361467.043929:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:30912:x1875232130662912:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361467.043933:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788361467.043938:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:35343:x1875232144204928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361467.044265:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:30912:x1875232130662912:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 336us (2866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361467.044274:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:3.0:1788361467.044361:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144204928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361467.044364:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:35343:x1875232144204928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (2749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.044371:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788361467.044412:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788361467.044762:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361467.044854:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144205056 00000100:00100000:1.0:1788361467.044859:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144205056 00000100:00100000:1.0:1788361467.044892:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788361467.044901:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:35343:x1875232144205056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361467.045017:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:35343:x1875232144205056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.045023:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788361467.045371:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361467.045388:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361467.046573:0:37372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788361467.046747:0:35343:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788361467.046768:0:35343:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788361467.046777:0:35343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6614afd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614b04 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.046789:0:35343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f000/0xf6a94c97d6614afd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614b04 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788361467.046799:0:35343:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788361467.046802:0:35343:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a8a8a12b000 from 10 10000000:01000000:3.0:1788361467.046804:0:35343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788361467.046835:0:35343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6614b0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.046843:0:35343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6614b0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.046860:0:35343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6614b0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361467.046881:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788361467.046930:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361467.046965:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361467.047030:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144205184 00000100:00100000:1.0:1788361467.047036:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144205184 00000100:00100000:1.0:1788361467.047080:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788361467.047231:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+17:35343:x1875232144205184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788361467.047244:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361467.047256:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a841efa00/0xf6a94c97d6614b12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6614b0b expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.047280:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a841efa00/0xf6a94c97d6614b12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6614b0b expref: 18 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.047292:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a841efa00/0xf6a94c97d6614b12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614b0b expref: 18 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.047308:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841efa00, rc 0) 00000100:00100000:1.0:1788361467.047383:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:35343:x1875232144205184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.047390:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788361467.047602:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83542a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361467.047617:0:35343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6614b0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614b12 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.047642:0:35343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6614b0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6614b12 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361467.047692:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361467.047720:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361467.047785:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361467.047816:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144205312 00000100:00100000:1.0:1788361467.047821:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144205312 00000100:00100000:1.0:1788361467.047884:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788361467.047892:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:35343:x1875232144205312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788361467.048338:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:35343:x1875232144205312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.048345:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788361467.048442:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361467.048484:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361467.048523:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361467.048586:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935600 going to sleep for 11 seconds 00000100:00100000:1.0:1788361467.048671:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144205440 00000100:00100000:1.0:1788361467.048676:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144205440 00000100:00100000:1.0:1788361467.048746:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788361467.048753:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:35343:x1875232144205440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788361467.048899:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:35343:x1875232144205440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.048906:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788361467.048967:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788361467.049661:0:37373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788361467.049709:0:35343:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788361467.049747:0:35343:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788361467.049756:0:35343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6614b0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614b12 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.049765:0:35343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a89bca000/0xf6a94c97d6614b0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614b12 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788361467.049774:0:35343:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788361467.049776:0:35343:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9a89852f1800 from 10 10000000:01000000:0.0:1788361467.049779:0:35343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788361467.049815:0:35343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6614b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.049833:0:35343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6614b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.049843:0:35343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6614b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361467.049856:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788361467.049888:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361467.050172:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935840 going to sleep for 11 seconds 00000100:00100000:3.0:1788361467.050285:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144205568 00000100:00100000:3.0:1788361467.050292:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144205568 00000100:00100000:3.0:1788361467.050327:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788361467.050336:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+18:35343:x1875232144205568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788361467.050347:0:35339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361467.050360:0:35339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6614b20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf6a94c97d6614b19 expref: -99 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.050381:0:35339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6614b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf6a94c97d6614b19 expref: 19 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.050391:0:35339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9a8a89bcb600/0xf6a94c97d6614b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf6a94c97d6614b19 expref: 19 pid: 35339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.050400:0:35339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb600, rc 0) 00000100:00100000:3.0:1788361467.050570:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:35343:x1875232144205568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361467.050577:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788361467.050633:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788361467.050646:0:35343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6614b19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614b20 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.050654:0:35343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6614b19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf6a94c97d6614b20 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361467.050699:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361467.050725:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361467.050793:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935840 going to sleep for 11 seconds 00000100:00100000:2.0:1788361467.050823:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144205696 00000100:00100000:2.0:1788361467.050828:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144205696 00000100:00100000:2.0:1788361467.050893:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788361467.050900:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:35343:x1875232144205696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788361467.051148:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:35343:x1875232144205696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361467.051154:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788361467.051227:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788361467.051253:0:35343:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788361467.051291:0:35343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361467.051706:0:35343:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361467.051734:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144205824 00000100:00100000:1.0:1788361467.051739:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144205824 00000100:00100000:2.0:1788361467.051778:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788361467.051785:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:35343:x1875232144205824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788361467.051936:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:35343:x1875232144205824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361467.051942:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788361467.052029:0:35343:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:35343:1875232144205824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788361467.053009:0:37374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788361467.053057:0:35343:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788361467.053077:0:35343:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788361467.053107:0:35343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6614b19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614b20 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.053134:0:35343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff9a8a8573f800/0xf6a94c97d6614b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf6a94c97d6614b20 expref: -99 pid: 35343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.296707:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361467.555408:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361467.555420:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361467.555469:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 2 count 2 00000040:00080000:0.0:1788361467.555476:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361467.555633:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144205952:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361467.555773:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a909359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361467.561204:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144205952:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788361467.561606:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.561787:0:35356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130663040 00000100:00100000:0.0:1788361467.561795:0:35356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130663040 00000100:00100000:0.0:1788361467.561891:0:35356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361467.561901:0:35356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c05f3090-241b-43d5-9787-08721e3d4333+34:31528:x1875232130663040:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788361467.561998:0:35356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c05f3090-241b-43d5-9787-08721e3d4333+34:31528:x1875232130663040:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 Request processed in 97us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361467.562006:0:35356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1788361467.564616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.564861:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130663168 00000100:00100000:0.0:1788361467.564870:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130663168 00000100:00100000:0.0:1788361467.564929:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1788361467.564939:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:31528:x1875232130663168:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788361467.564970:0:35345:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788361467.565078:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:31528:x1875232130663168:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 140us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361467.565106:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:3.0:1788361467.571186:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.572112:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130663296 00000100:00100000:1.0:1788361467.572123:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130663296 00000100:00100000:1.0:1788361467.572191:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:1.0:1788361467.572201:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:31528:x1875232130663296:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788361467.572285:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6614b27 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572305:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6614b27 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572318:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6614b27 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572334:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614b2e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572341:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614b2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572347:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614b2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572371:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572378:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572400:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361467.572441:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00000004:00200000:1.0:1788361467.572446:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361467.572461:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572472:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6614b27 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572478:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6614b27 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572483:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6614b27 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572488:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ef600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361467.572490:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6614b27 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572496:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6614b27 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572505:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:1.0:1788361467.572507:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361467.572511:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6614b27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572514:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ef600/0xf6a94c97d6614b27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572533:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614b2e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572540:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614b2e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572546:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614b2e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572551:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841ee400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361467.572554:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614b2e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572560:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614b2e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572568:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x9ebbb977 (ffff9a8984a32300) 00010000:00010000:1.0:1788361467.572571:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361467.572574:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614b2e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572580:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee400/0xf6a94c97d6614b2e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x9ebbb977 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572599:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572605:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572616:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572627:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361467.572630:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572635:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572644:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:1.0:1788361467.572646:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361467.572649:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.572655:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b35 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.572734:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:31528:x1875232130663296:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 534us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.572743:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:3.0:1788361467.575130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.575509:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130663552 00000100:00100000:0.0:1788361467.575520:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130663552 00000100:00100000:0.0:1788361467.575619:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1788361467.575630:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:31528:x1875232130663552:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361467.575657:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361467.575678:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b3c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f332 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.575791:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b43 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.575809:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.575821:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361467.575835:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00010000:00010000:0.0:1788361467.575947:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b43 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.575955:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b43 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.575962:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b43 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.575968:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361467.575972:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b43 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.575980:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b43 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.576010:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:0.0:1788361467.576019:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361467.576040:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b43 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.576048:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b43 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.576148:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b3c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f332 expref: 36 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.576160:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361467.576162:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361467.576191:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b3c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f332 expref: 36 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.576202:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e200, rc 0) 00000100:00100000:0.0:1788361467.576276:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:31528:x1875232130663552:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 629us (1145us total) trans 30064771098 rc 301/301 00000100:00100000:0.0:1788361467.576283:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:3.0:1788361467.580331:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.580474:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130663680 00000100:00100000:2.0:1788361467.580484:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130663680 00000100:00100000:2.0:1788361467.580548:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:2.0:1788361467.580559:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+35:31528:x1875232130663680:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361467.580596:0:37122:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x5:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361467.580708:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+35:31528:x1875232130663680:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 151us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361467.580743:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:2.0:1788361467.583528:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.583574:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130663936 00000100:00100000:0.0:1788361467.583584:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130663936 00000100:00100000:0.0:1788361467.583636:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:0.0:1788361467.583645:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:31528:x1875232130663936:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361467.583666:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361467.583687:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b51 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f339 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361467.584357:0:35346:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0xa4:0x0], count =30 00000004:00080000:0.0:1788361467.584371:0:35346:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0xa4:0x0]+30 in llog 00000004:00080000:0.0:1788361467.584421:0:35346:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc2:0x0], index 0: 0 00010000:00010000:0.0:1788361467.584649:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614b58 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.584662:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614b58 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.584673:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614b58 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.584722:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b51 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f339 expref: 38 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.584735:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614b58 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f339 expref: 37 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.584742:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:0.0:1788361467.584744:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361467.584747:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:0.0:1788361467.584801:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+37:31528:x1875232130663936:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1158us (1298us total) trans 30064771099 rc 0/0 00000100:00100000:0.0:1788361467.584814:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:3.0:1788361467.588206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.588263:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130664192 00000100:00100000:2.0:1788361467.588297:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130664192 00000100:00100000:1.0:1788361467.588458:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:1.0:1788361467.588472:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+37:31528:x1875232130664192:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361467.588535:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361467.588564:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614b58 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f339 expref: 37 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588582:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:1.0:1788361467.588592:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361467.588618:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b66 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588641:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b66 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588652:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b66 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588711:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614b6d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xe5448f38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588719:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614b6d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe5448f38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588726:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614b6d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe5448f38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588798:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b66 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588819:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b66 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588826:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b66 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588832:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361467.588837:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b66 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588846:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b66 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588864:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361467.588874:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361467.588879:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b66 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588885:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614b66 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588896:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614b6d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe5448f38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588902:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614b6d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe5448f38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588908:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614b6d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe5448f38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588913:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361467.588916:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614b6d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe5448f38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588922:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614b6d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xe5448f38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588930:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xe5448f38 (ffff9a8984a32300) 00010000:00010000:1.0:1788361467.588933:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361467.588936:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614b6d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xe5448f38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.588945:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614b6d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xe5448f38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.589021:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+36:31528:x1875232130664192:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 554us (823us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361467.589035:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788361467.591733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.591860:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130664320 00000100:00100000:2.0:1788361467.591883:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130664320 00000100:00100000:2.0:1788361467.591971:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:2.0:1788361467.591983:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:31528:x1875232130664320:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361467.592017:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361467.592065:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614b74 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f340 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.592190:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.592206:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.592218:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.592365:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614b74 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f340 expref: 38 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.592397:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f340 expref: 37 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.592406:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361467.592421:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361467.592433:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361467.592928:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:31528:x1875232130664320:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 932us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361467.592936:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:2.0:1788361467.596603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.597509:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130664576 00000100:00100000:0.0:1788361467.597520:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130664576 00000100:00100000:0.0:1788361467.597569:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:0.0:1788361467.597578:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+37:31528:x1875232130664576:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361467.597667:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.597703:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.597716:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361467.598041:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].2, 88 off8344 00000004:00080000:0.0:1788361467.598052:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 857612965341ns, next at 858612963147ns, rc = 0 00000004:00010000:0.0:1788361467.598200:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000ed94ec1 reply state 00000000ce1b2326 transno 30064771100 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361467.598211:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361467.598305:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+39:31528:x1875232130664576:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 727us (1707us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1788361467.598313:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00010000:00010000:0.0:1788361467.600343:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.600359:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.600366:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.600373:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361467.600378:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.600386:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.600423:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:0.0:1788361467.600426:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788361467.600432:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.600439:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b82 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361467.601251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.601428:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130664704 00000100:00100000:0.0:1788361467.601437:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130664704 00000100:00100000:0.0:1788361467.601509:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:0.0:1788361467.601519:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+38:31528:x1875232130664704:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361467.601544:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361467.601564:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b89 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f347 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.601625:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b89 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f347 expref: 39 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.601641:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b89 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f347 expref: 39 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.601663:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:0.0:1788361467.601667:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361467.601670:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e200, rc 0) 00000100:00100000:0.0:1788361467.601729:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:31528:x1875232130664704:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 211us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361467.601749:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:2.0:1788361467.605006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.605072:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130664832 00000100:00100000:1.0:1788361467.605082:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130664832 00000100:00100000:1.0:1788361467.605239:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361467.605248:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+5:2349:x1875232130664832:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788361467.605612:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130664832:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 363us (612us total) trans 30064771074 rc 0/0 00000100:00100000:1.0:1788361467.605620:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361467.609279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.609364:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130665088 00000100:00100000:2.0:1788361467.609374:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130665088 00000100:00100000:2.0:1788361467.609429:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361467.609440:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:31528:x1875232130665088:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361467.610598:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+40:31528:x1875232130665088:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1157us (1324us total) trans 30064771101 rc 0/0 00000100:00100000:2.0:1788361467.610610:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1788361467.612394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.612599:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130665344 00000100:00100000:0.0:1788361467.612609:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130665344 00000100:00100000:0.0:1788361467.612736:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:0.0:1788361467.612747:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+40:31528:x1875232130665344:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788361467.612853:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+40:31528:x1875232130665344:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 109us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361467.612861:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:3.0:1788361467.614812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.614972:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130665472 00000100:00100000:0.0:1788361467.614989:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130665472 00000100:00100000:0.0:1788361467.615033:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:0.0:1788361467.615040:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+40:31528:x1875232130665472:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361467.615077:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361467.615176:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b90 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f34e expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.615358:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b97 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.615375:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b97 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.615389:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b97 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361467.615456:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361467.615501:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b97 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.615566:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614b90 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f34e expref: 42 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.615586:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b97 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f34e expref: 41 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.615594:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:0.0:1788361467.615598:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788361467.615618:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:0.0:1788361467.615697:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+41:31528:x1875232130665472:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 656us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361467.615717:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:3.0:1788361467.618198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.618259:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130665600 00000100:00100000:0.0:1788361467.618268:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130665600 00000100:00100000:0.0:1788361467.618312:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788361467.618320:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130665600:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361467.618338:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361467.618376:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d6614b9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f355 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361467.618426:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983afc, blocks: 0x1 00010000:00010000:0.0:1788361467.618460:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=857s v=(0 0) 00010000:00010000:0.0:1788361467.618466:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361467.618477:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d6614b9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f355 expref: 7 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.620137:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d6614b9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f355 expref: 7 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.620154:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e600, rc 0) 00000100:00100000:0.0:1788361467.620235:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130665600:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1914us (2053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361467.620243:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361467.622879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.623135:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130665856 00000100:00100000:1.0:1788361467.623144:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130665856 00000100:00100000:1.0:1788361467.623224:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1788361467.623250:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+41:31528:x1875232130665856:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788361467.623409:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+41:31528:x1875232130665856:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 175us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.623440:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:3.0:1788361467.628040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.628563:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130665984 00000100:00100000:1.0:1788361467.628573:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130665984 00000100:00100000:1.0:1788361467.628633:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:1.0:1788361467.628646:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:31528:x1875232130665984:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361467.628667:0:35983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361467.628691:0:35983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f35c expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.628725:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d6614b9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f355 expref: 8 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.628754:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361467.628759:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361467.628765:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 8 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.628810:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d6614b9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f355 expref: 8 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.628826:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d6614b9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f355 expref: 8 pid: 36286 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.628840:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:35983:1875232144206080:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361467.629117:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86477a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361467.632363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.633154:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130666112 00000100:00100000:2.0:1788361467.633164:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130666112 00010000:00010000:2.0:1788361467.633226:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d6614b9e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f355 expref: 9 pid: 36286 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361467.633276:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788361467.633286:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8419c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130666112:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361467.633302:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361467.633325:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d6614b9e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f355 expref: 9 pid: 36286 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.633339:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d6614b9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f355 expref: 9 pid: 36286 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.633383:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361467.633387:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361467.633397:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 9 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.633407:0:36007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 9 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.633442:0:36007:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 9 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361467.633456:0:36007:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:36007:1875232144206208:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361467.633531:0:36007:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83c98780 going to sleep for 11 seconds 00010000:00010000:0.0:1788361467.634209:0:35983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f442f86/0xf6a94c97d6614b9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f355 expref: 9 pid: 36286 timeout: 957 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361467.634229:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:35983:1875232144206080:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361467.634253:0:35983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 8 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.634265:0:35983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623a00, rc 0) 00000100:00100000:0.0:1788361467.634306:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+8:31528:x1875232130665984:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 5664us (6276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361467.634315:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361467.636754:0:36007:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:36007:1875232144206208:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361467.636779:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361467.636942:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8419c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130666112:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3655us (4586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361467.636954:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788361467.643306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.643380:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130666240 00000100:00100000:3.0:1788361467.643390:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130666240 00002000:00100000:3.0:1788361467.643436:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (0->409599) req@ffff9a8986704e00 x1875232130666240/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788361467.643448:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986704e00 with x1875232130666240 ext(0->409599) 00002000:00010000:3.0:1788361467.643454:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8986704e00 00000100:00100000:3.0:1788361467.643488:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1788361467.643497:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130666240:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361467.655865:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130666240:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 12356us (12555us total) trans 30064771075 rc 0/0 00000100:00100000:0.0:1788361467.655887:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:0.0:1788361467.655899:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (0->409599) req@ffff9a8986704e00 x1875232130666240/t30064771075(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:528/0 lens 488/448 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788361467.655926:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986704e00 with x1875232130666240 ext(0->409599) 00002000:00010000:0.0:1788361467.655933:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8986704e00 00000100:00100000:2.0:1788361467.659482:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.659597:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130666368 00000100:00100000:1.0:1788361467.659606:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130666368 00000100:00100000:1.0:1788361467.659669:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:1.0:1788361467.659679:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+41:31528:x1875232130666368:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788361467.687873:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771100 is committed 00000004:00080000:0.0:1788361467.687887:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788361467.687942:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771101 is committed 00000001:00080000:0.0:1788361467.687950:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771097 is committed 00000100:00100000:1.0:1788361467.688160:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:31528:x1875232130666368:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 28477us (28682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.688172:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:0.0:1788361467.688718:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144206336:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788361467.688772:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361467.688872:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144206336 00000100:00100000:2.0:1788361467.688882:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144206336 00000100:00100000:2.0:1788361467.688939:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361467.688948:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144206336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788361467.689135:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:2.0:1788361467.689139:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb mtime from disk: 0 -> 1788361468 00002000:00010000:2.0:1788361467.689141:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361467.689143:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb ctime from disk: 1788361468 -> 1788361468 00002000:00010000:2.0:1788361467.689146:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00080000:0.0:1788361467.689367:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361467.689469:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144206336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 521us (695us total) trans 30064771076 rc 0/0 00000100:00100000:2.0:1788361467.689476:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1788361467.689597:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8986704700/2, rc 0, transno 30064771076 00000100:00100000:0.0:1788361467.689604:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144206336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361467.690159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.690217:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130666496 00000100:00100000:2.0:1788361467.690223:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130666496 00000100:00100000:2.0:1788361467.690260:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1788361467.690268:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130666496:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788361467.714780:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771075 is committed 00000001:00080000:1.0:1788361467.714805:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771076 is committed 00000100:00100000:3.0:1788361467.714989:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130666496:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 24716us (24826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361467.715001:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788361467.717394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.717495:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130666752 00000100:00100000:2.0:1788361467.717505:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130666752 00000100:00100000:2.0:1788361467.717565:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:2.0:1788361467.717576:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:31528:x1875232130666752:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361467.717643:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361467.717673:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614b97 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f34e expref: 13 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.717692:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361467.717697:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361467.717729:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.717743:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.717772:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361467.717962:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eda2d776 reply state 0000000089312370 transno 30064771102 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361467.717972:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361467.718058:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:31528:x1875232130666752:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 484us (671us total) trans 30064771102 rc 0/0 00000100:00100000:2.0:1788361467.718066:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00010000:00010000:1.0:1788361467.719026:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.719044:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.719049:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.719053:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361467.719056:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.719062:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.719072:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361467.719074:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361467.719077:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.719080:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614bac lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361467.719833:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.719974:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130666880 00000100:00100000:2.0:1788361467.719981:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130666880 00000100:00100000:2.0:1788361467.720035:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361467.720045:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130666880:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788361467.720316:0:36286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:2.0:1788361467.720320:0:36286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb mtime from disk: 1788361468 -> 1788361467 00002000:00010000:2.0:1788361467.720322:0:36286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb atime from disk: 0 -> 1788361467 00002000:00010000:2.0:1788361467.720325:0:36286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb ctime from disk: 1788361468 -> 1788361467 00002000:00010000:2.0:1788361467.720327:0:36286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:2.0:1788361467.720385:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130666880:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 341us (554us total) trans 30064771077 rc 0/0 00000100:00100000:2.0:1788361467.720394:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361467.722231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.722368:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130667136 00000100:00100000:0.0:1788361467.722376:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130667136 00000100:00100000:0.0:1788361467.722423:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:0.0:1788361467.722431:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:31528:x1875232130667136:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788361467.722508:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.722527:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f340 expref: 13 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.722537:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.722586:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f340 expref: 13 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.722601:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f340 expref: 13 pid: 35345 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361467.722614:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144206464:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361467.722690:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86477780 going to sleep for 11 seconds 00000100:00100000:0.0:1788361467.725197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.725343:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144206464:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361467.725368:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.725403:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130667264 00000100:00100000:1.0:1788361467.725411:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130667264 00010000:00010000:1.0:1788361467.725446:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f340 expref: 14 pid: 35345 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.725484:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361467.725492:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130667264:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361467.725507:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361467.725521:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f340 expref: 14 pid: 35345 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.725534:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f340 expref: 14 pid: 35345 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.725557:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614b7b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f340 expref: 14 pid: 35345 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.725584:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361467.725590:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.725601:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.725610:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.725633:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361467.725658:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.725667:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.725694:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130667264:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 202us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.725702:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00010000:00010000:2.0:1788361467.726385:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.726468:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.726474:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.726481:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361467.726485:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.726493:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.726505:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361467.726508:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788361467.726512:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.726518:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6614bb3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361467.726576:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+12:31528:x1875232130667136:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 4145us (4350us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788361467.726589:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:0.0:1788361467.728168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.728437:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130667392 00000100:00100000:1.0:1788361467.728444:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130667392 00000100:00100000:1.0:1788361467.728493:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1788361467.728501:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130667392:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788361467.728540:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.728579:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.728589:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361467.728594:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361467.728599:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.728630:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.728643:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 7 pid: 35983 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.728657:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:35983:1875232144206592:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361467.728718:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361467.731309:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:35983:1875232144206592:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361467.731336:0:35983:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361467.732206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.732303:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130667520 00000100:00100000:3.0:1788361467.732310:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130667520 00010000:00010000:3.0:1788361467.732343:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 8 pid: 35983 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361467.732381:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361467.732390:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130667520:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361467.732417:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361467.732442:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 8 pid: 35983 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.732455:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 8 pid: 35983 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.732476:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6614ba5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f35c expref: 8 pid: 35983 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.732491:0:35331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361467.732495:0:35331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361467.732502:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.732511:0:35331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361467.732537:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361467.732586:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130667520:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 197us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361467.732594:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00010000:00010000:1.0:1788361467.734360:0:35983:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.734376:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.734422:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.734430:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.734438:0:35983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.734446:0:35983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361467.734450:0:35983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.734458:0:35983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.734477:0:35983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.734482:0:35983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6614bba lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.734549:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130667392:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 6048us (6384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.734563:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788361467.737081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.737152:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130667776 00000100:00100000:1.0:1788361467.737162:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130667776 00000100:00100000:1.0:1788361467.737229:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:1.0:1788361467.737238:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+12:31528:x1875232130667776:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788361467.737316:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614bc1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.737335:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614bc1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.737348:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614bc1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.738197:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.738212:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b89 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f347 expref: 13 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.738220:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.738251:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b89 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f347 expref: 13 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.738267:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b89 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f347 expref: 13 pid: 35346 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.738294:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144206720:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361467.738362:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361467.740632:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144206720:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361467.740643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:1.0:1788361467.740662:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361467.741019:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130667904 00000100:00100000:2.0:1788361467.741026:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130667904 00010000:00010000:2.0:1788361467.741063:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b89 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f347 expref: 14 pid: 35346 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.741145:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1788361467.741155:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130667904:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361467.741168:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361467.741174:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b89 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f347 expref: 14 pid: 35346 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.741197:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b89 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f347 expref: 14 pid: 35346 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.741215:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614b89 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f347 expref: 14 pid: 35346 timeout: 957 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.741226:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361467.741230:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.741237:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.741242:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.741312:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361467.741348:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130667904:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 196us (712us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361467.741523:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.741529:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361467.741677:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771103 00000001:00080000:0.0:1788361467.741792:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771104 00000001:00080000:0.0:1788361467.741835:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771105 00000100:00100000:0.0:1788361467.741906:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144206848:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788361467.741999:0:35347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361467.742025:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86477780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361467.742066:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144206848 00000100:00100000:3.0:1788361467.742073:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144206848 00000100:00100000:3.0:1788361467.742147:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788361467.742156:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144206848:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788361467.742396:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361467.742472:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144206848:12345-0@lo:1000:mdt00_002.0 Request processed in 317us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361467.742480:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788361467.742504:0:35347:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771076 gen 2 00000004:00080000:0.0:1788361467.742509:0:35347:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8986704700, transno 30064771076 00000100:00100000:0.0:1788361467.742529:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144206848:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788361467.743630:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771106 00000100:00100000:0.0:1788361467.743697:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144206976:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788361467.743746:0:35347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361467.743768:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361467.743933:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144206976 00000100:00100000:2.0:1788361467.743939:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144206976 00000100:00100000:2.0:1788361467.743981:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788361467.743987:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144206976:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361467.744193:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35347:x1875232144206976:12345-0@lo:1000:mdt00_002.0 Request processed in 204us (444us total) trans 30064771078 rc 0/0 00000100:00100000:2.0:1788361467.744201:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788361467.744391:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144206976:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788361467.744420:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744429:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744436:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744443:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361467.744448:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744457:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744477:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361467.744480:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361467.744486:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744492:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bc8 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744525:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744538:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744544:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744549:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361467.744552:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744558:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744567:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:1.0:1788361467.744569:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361467.744576:0:35347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614ae8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f31d expref: 7 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744585:0:35347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614ae8 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f31d expref: 7 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744592:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614ae8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f31d expref: 7 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.744620:0:35347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614ae8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f31d expref: 7 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361467.744626:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144207104:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361467.744681:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361467.745990:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144207104:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361467.746006:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746012:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ae1 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746035:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bcf lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746044:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bcf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746052:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bcf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746058:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bcf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746061:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bcf lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746065:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bcf lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746068:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361467.746070:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bcf lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746073:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bcf lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746127:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:1.0:1788361467.746130:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361467.746134:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bcf lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746139:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bcf lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746150:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614bc1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746156:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614bc1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746161:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614bc1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746166:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361467.746169:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614bc1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746175:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614bc1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746193:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:1.0:1788361467.746195:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361467.746198:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614bc1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.746203:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614bc1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361467.746522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.746596:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130668032 00000100:00100000:3.0:1788361467.746603:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130668032 00000100:00100000:3.0:1788361467.746650:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361467.746661:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:31524:x1875232130668032:12345-192.168.203.60@tcp:49:mmap_sanity.0 00000040:00080000:2.0:1788361467.746668:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361467.746677:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788361467.746709:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+16:31528:x1875232130667776:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 9471us (9632us total) trans 30064771107 rc 0/0 00000100:00100000:1.0:1788361467.746719:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000040:00080000:2.0:1788361467.746723:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 2 count 2 00000020:00080000:1.0:1788361467.746724:0:35347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788361467.746740:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361467.746757:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:31524:x1875232130668032:12345-192.168.203.60@tcp:49:mmap_sanity.0 Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361467.746765:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1788361467.749198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.749274:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130668288 00000100:00100000:2.0:1788361467.749282:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130668288 00000100:00100000:2.0:1788361467.749328:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1788361467.749338:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+16:31528:x1875232130668288:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788361467.749894:0:35349:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788361467.750003:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771108 00010000:00010000:2.0:1788361467.750039:0:35349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.750053:0:35349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.750070:0:35349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.750079:0:35349:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.750111:0:35349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.750119:0:35349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361467.750142:0:35349:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788361467.750238:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+18:31528:x1875232130668288:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 901us (1045us total) trans 30064771109 rc 0/0 00000100:00100000:2.0:1788361467.750246:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000020:00080000:2.0:1788361467.750251:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788361467.750319:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361467.750327:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.750334:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361467.750338:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.750347:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.750359:0:35334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x6:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:0.0:1788361467.750362:0:35334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361467.750367:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.750373:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614bd6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361467.750394:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361467.750396:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361467.750399:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361467.752138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361467.752266:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130668416 00000100:00100000:1.0:1788361467.752282:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130668416 00000100:00100000:1.0:1788361467.752372:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788361467.752382:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:31524:x1875232130668416:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361467.752399:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361467.752418:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000c2a34b/0xf6a94c97d6614bdd lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f363 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361467.752443:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6a983afb, atime: 0x6a983afb, ctime: 0x6a983afb, blocks: 0x403 00010000:00010000:1.0:1788361467.752465:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=857s v=(0 0) 00010000:00010000:1.0:1788361467.752469:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361467.752477:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000c2a34b/0xf6a94c97d6614bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f363 expref: 6 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.752490:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000000c2a34b/0xf6a94c97d6614bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f363 expref: 6 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361467.752500:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623200, rc 0) 00000100:00100000:1.0:1788361467.752540:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31524:x1875232130668416:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 162us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361467.752545:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1788361467.754591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.754755:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130668544 00000100:00100000:2.0:1788361467.754763:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130668544 00002000:00100000:2.0:1788361467.754796:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (0->4095) req@ffff9a8a83540000 x1875232130668544/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361467.754803:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a83540000 with x1875232130668544 ext(0->4095) 00002000:00010000:2.0:1788361467.754817:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a83540000 00000100:00100000:2.0:1788361467.754845:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:2.0:1788361467.754853:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130668544:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:2.0:1788361467.755126:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130668544:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 272us (541us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788361467.755149:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00002000:00100000:2.0:1788361467.755156:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (0->4095) req@ffff9a8a83540000 x1875232130668544/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/4536 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361467.755165:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a83540000 with x1875232130668544 ext(0->4095) 00002000:00010000:2.0:1788361467.755169:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a83540000 00000100:00100000:0.0:1788361467.758961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.759263:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130668672 00000100:00100000:3.0:1788361467.759273:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130668672 00002000:00100000:3.0:1788361467.759319:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (4096->8191) req@ffff9a8a89f25180 x1875232130668672/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.759330:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f25180 with x1875232130668672 ext(4096->8191) 00002000:00010000:3.0:1788361467.759336:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f25180 00000100:00100000:3.0:1788361467.759422:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361467.759433:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2351:x1875232130668672:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:3.0:1788361467.759640:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2351:x1875232130668672:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 209us (688us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788361467.759649:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00002000:00100000:3.0:1788361467.759656:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (4096->8191) req@ffff9a8a89f25180 x1875232130668672/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/4536 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.759678:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f25180 with x1875232130668672 ext(4096->8191) 00002000:00010000:3.0:1788361467.759682:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f25180 00000100:00100000:0.0:1788361467.763226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.763348:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130668800 00000100:00100000:2.0:1788361467.763357:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130668800 00002000:00100000:2.0:1788361467.763406:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (8192->12287) req@ffff9a8a89f24380 x1875232130668800/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361467.763416:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24380 with x1875232130668800 ext(8192->12287) 00002000:00010000:2.0:1788361467.763422:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24380 00000100:00100000:2.0:1788361467.763451:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:2.0:1788361467.763459:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130668800:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:2.0:1788361467.763652:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130668800:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 193us (435us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788361467.763660:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00002000:00100000:2.0:1788361467.763667:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (8192->12287) req@ffff9a8a89f24380 x1875232130668800/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/4536 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361467.763675:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24380 with x1875232130668800 ext(8192->12287) 00002000:00010000:2.0:1788361467.763679:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24380 00000100:00100000:0.0:1788361467.767345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.767804:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130668928 00000100:00100000:3.0:1788361467.767877:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130668928 00002000:00100000:3.0:1788361467.767931:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (12288->69631) req@ffff9a8a89f27800 x1875232130668928/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.767943:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f27800 with x1875232130668928 ext(12288->69631) 00002000:00010000:3.0:1788361467.767951:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f27800 00000100:00100000:3.0:1788361467.767990:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1788361467.767999:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2352:x1875232130668928:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:3.0:1788361467.771205:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2352:x1875232130668928:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 3197us (3859us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1788361467.771219:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00002000:00100000:3.0:1788361467.771232:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (12288->69631) req@ffff9a8a89f27800 x1875232130668928/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/440 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.771245:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f27800 with x1875232130668928 ext(12288->69631) 00002000:00010000:3.0:1788361467.771252:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f27800 00000100:00100000:0.0:1788361467.776920:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.777061:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130669056 00000100:00100000:2.0:1788361467.777071:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130669056 00002000:00100000:2.0:1788361467.777151:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (69632->106495) req@ffff9a8a89f24a80 x1875232130669056/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361467.777172:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24a80 with x1875232130669056 ext(69632->106495) 00002000:00010000:2.0:1788361467.777187:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24a80 00000100:00100000:2.0:1788361467.777217:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361467.777227:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130669056:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:2.0:1788361467.780028:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130669056:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 2793us (3109us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788361467.780040:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00002000:00100000:2.0:1788361467.780051:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (69632->106495) req@ffff9a8a89f24a80 x1875232130669056/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/440 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361467.780061:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24a80 with x1875232130669056 ext(69632->106495) 00002000:00010000:2.0:1788361467.780067:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24a80 00000100:00100000:2.0:1788361467.784670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.784775:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130669184 00000100:00100000:0.0:1788361467.784786:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130669184 00002000:00100000:0.0:1788361467.784844:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (106496->143359) req@ffff9a8986704700 x1875232130669184/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361467.784856:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986704700 with x1875232130669184 ext(106496->143359) 00002000:00010000:0.0:1788361467.784862:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8986704700 00000100:00100000:0.0:1788361467.784931:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1788361467.784941:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130669184:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361467.787623:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130669184:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 2675us (2950us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788361467.787635:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00002000:00100000:0.0:1788361467.787646:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (106496->143359) req@ffff9a8986704700 x1875232130669184/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/440 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361467.787657:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986704700 with x1875232130669184 ext(106496->143359) 00002000:00010000:0.0:1788361467.787663:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8986704700 00000100:00100000:2.0:1788361467.796984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.797226:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130669312 00000100:00100000:3.0:1788361467.797235:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130669312 00002000:00100000:3.0:1788361467.797289:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (143360->180223) req@ffff9a8986705880 x1875232130669312/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.797300:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986705880 with x1875232130669312 ext(143360->180223) 00002000:00010000:3.0:1788361467.797307:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8986705880 00000100:00100000:3.0:1788361467.797357:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1788361467.797367:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130669312:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:3.0:1788361467.801703:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130669312:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 4327us (4719us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1788361467.801716:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00002000:00100000:3.0:1788361467.801727:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (143360->180223) req@ffff9a8986705880 x1875232130669312/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/440 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.801736:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986705880 with x1875232130669312 ext(143360->180223) 00002000:00010000:3.0:1788361467.801743:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8986705880 00000100:00100000:1.0:1788361467.814511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.814599:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130669440 00000100:00100000:0.0:1788361467.814606:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130669440 00002000:00100000:0.0:1788361467.814650:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (180224->217087) req@ffff9a8ab7141f80 x1875232130669440/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361467.814658:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7141f80 with x1875232130669440 ext(180224->217087) 00002000:00010000:0.0:1788361467.814662:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7141f80 00000100:00100000:0.0:1788361467.814705:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361467.814712:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130669440:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361467.819746:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130669440:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 5024us (5246us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788361467.819760:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00002000:00100000:0.0:1788361467.819772:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (180224->217087) req@ffff9a8ab7141f80 x1875232130669440/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/440 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361467.819784:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7141f80 with x1875232130669440 ext(180224->217087) 00002000:00010000:0.0:1788361467.819790:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7141f80 00000100:00100000:0.0:1788361467.825421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.825598:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130669568 00000100:00100000:3.0:1788361467.825609:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130669568 00002000:00100000:3.0:1788361467.825659:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (217088->253951) req@ffff9a8a89f24e00 x1875232130669568/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.825679:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24e00 with x1875232130669568 ext(217088->253951) 00002000:00010000:3.0:1788361467.825687:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24e00 00000100:00100000:3.0:1788361467.825721:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361467.825731:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130669568:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:3.0:1788361467.827927:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130669568:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 2190us (2508us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1788361467.827938:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00002000:00100000:3.0:1788361467.827957:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (217088->253951) req@ffff9a8a89f24e00 x1875232130669568/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/440 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.827968:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24e00 with x1875232130669568 ext(217088->253951) 00002000:00010000:3.0:1788361467.827987:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24e00 00000100:00100000:3.0:1788361467.836782:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361467.837761:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130669696 00000100:00100000:0.0:1788361467.837774:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130669696 00002000:00100000:0.0:1788361467.837837:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (253952->290815) req@ffff9a8a9f586300 x1875232130669696/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361467.837848:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9f586300 with x1875232130669696 ext(253952->290815) 00002000:00010000:0.0:1788361467.837855:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9f586300 00000100:00100000:0.0:1788361467.837894:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1788361467.837903:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130669696:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361467.840850:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130669696:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 2939us (4068us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788361467.840863:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00002000:00100000:0.0:1788361467.840875:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (253952->290815) req@ffff9a8a9f586300 x1875232130669696/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/440 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361467.840903:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9f586300 with x1875232130669696 ext(253952->290815) 00002000:00010000:0.0:1788361467.840909:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9f586300 00000100:00100000:1.0:1788361467.846799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.846847:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130669824 00000100:00100000:3.0:1788361467.846917:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130669824 00002000:00100000:3.0:1788361467.847026:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (290816->327679) req@ffff9a8ab7142300 x1875232130669824/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.847039:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7142300 with x1875232130669824 ext(290816->327679) 00002000:00010000:3.0:1788361467.847045:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7142300 00000100:00100000:3.0:1788361467.847156:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1788361467.847166:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130669824:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:3.0:1788361467.849373:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130669824:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 2202us (2576us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1788361467.849387:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00002000:00100000:3.0:1788361467.849399:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (290816->327679) req@ffff9a8ab7142300 x1875232130669824/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/440 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.849409:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7142300 with x1875232130669824 ext(290816->327679) 00002000:00010000:3.0:1788361467.849416:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7142300 00000100:00100000:0.0:1788361467.855327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.855779:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130669952 00000100:00100000:2.0:1788361467.855789:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130669952 00002000:00100000:2.0:1788361467.855838:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (327680->364543) req@ffff9a8a89f27100 x1875232130669952/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361467.855848:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f27100 with x1875232130669952 ext(327680->364543) 00002000:00010000:2.0:1788361467.855855:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f27100 00000100:00100000:2.0:1788361467.855934:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788361467.855944:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130669952:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:2.0:1788361467.860656:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130669952:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 4703us (5328us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788361467.860684:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00002000:00100000:2.0:1788361467.860698:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (327680->364543) req@ffff9a8a89f27100 x1875232130669952/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/440 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361467.860708:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f27100 with x1875232130669952 ext(327680->364543) 00002000:00010000:2.0:1788361467.860716:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f27100 00000100:00100000:0.0:1788361467.866723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.866810:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130670080 00000100:00100000:3.0:1788361467.866821:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130670080 00002000:00100000:3.0:1788361467.866871:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (364544->401407) req@ffff9a8a89f27b80 x1875232130670080/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.866882:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f27b80 with x1875232130670080 ext(364544->401407) 00002000:00010000:3.0:1788361467.866888:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f27b80 00000100:00100000:3.0:1788361467.866925:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361467.866950:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130670080:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:3.0:1788361467.869684:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130670080:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 2723us (2957us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1788361467.869697:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00002000:00100000:3.0:1788361467.869708:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc2:0x0] (364544->401407) req@ffff9a8a89f27b80 x1875232130670080/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/440 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361467.869719:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f27b80 with x1875232130670080 ext(364544->401407) 00002000:00010000:3.0:1788361467.869725:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f27b80 00000100:00100000:0.0:1788361467.876227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361467.877377:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130670208 00000100:00100000:2.0:1788361467.877390:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130670208 00002000:00100000:2.0:1788361467.877445:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (401408->409599) req@ffff9a8a89f24700 x1875232130670208/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/0 e 0 to 0 dl 1788361478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361467.877456:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24700 with x1875232130670208 ext(401408->409599) 00002000:00010000:2.0:1788361467.877463:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24700 00000100:00100000:2.0:1788361467.877550:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361467.877560:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130670208:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:2.0:1788361467.877812:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130670208:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 252us (1594us total) trans 0 rc 8192/8192 00000100:00100000:2.0:1788361467.877819:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00002000:00100000:2.0:1788361467.877826:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc2:0x0] (401408->409599) req@ffff9a8a89f24700 x1875232130670208/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:528/0 lens 488/8632 e 0 to 0 dl 1788361478 ref 1 fl Complete:/600/0 rc 8192/8192 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361467.877834:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89f24700 with x1875232130670208 ext(401408->409599) 00002000:00010000:2.0:1788361467.877838:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89f24700 00000100:00100000:0.0:1788361467.882673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361467.882905:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130670464 00000100:00100000:3.0:1788361467.882963:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130670464 00000100:00100000:3.0:1788361467.883021:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1788361467.883032:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:31524:x1875232130670464:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000001:00080000:3.0:1788361467.883484:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771110 00000100:00100000:3.0:1788361467.883647:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:31524:x1875232130670464:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 616us (981us total) trans 30064771111 rc 0/0 00000100:00100000:3.0:1788361467.883656:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000020:00080000:3.0:1788361467.883661:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788361468.320447:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361468.565672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.566519:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130670720 00000100:00100000:2.0:1788361468.566531:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130670720 00000100:00100000:2.0:1788361468.566691:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1788361468.566720:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+18:31523:x1875232130670720:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:2.0:1788361468.567020:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+19:31523:x1875232130670720:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 304us (1357us total) trans 30064771112 rc 0/0 00000100:00100000:2.0:1788361468.567028:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00080000:0.0:1788361468.567158:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361468.569854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.569949:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130670848 00000100:00100000:1.0:1788361468.569959:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130670848 00000100:00100000:1.0:1788361468.570019:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:1.0:1788361468.570029:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:31523:x1875232130670848:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361468.570055:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361468.570078:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614be4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f36a expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570210:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614beb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570227:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614beb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570240:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614beb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570258:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bf2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570276:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bf2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570283:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bf2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570604:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bf9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570621:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570629:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361468.570668:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x5:0x0]: returning size 409600 00000004:00200000:1.0:1788361468.570674:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361468.570694:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570707:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bf9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570716:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614beb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570723:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614beb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570730:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614beb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570736:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.570741:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614beb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570749:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614beb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570761:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361468.570771:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.570778:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614beb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570784:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614beb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570797:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bf2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570802:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bf2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570807:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bf2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570812:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.570815:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bf2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570821:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bf2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570828:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff9a8984a32d00) 00010000:00010000:1.0:1788361468.570830:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.570833:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bf2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570839:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614bf2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570878:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614be4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f36a expref: 21 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570906:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bf9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f36a expref: 20 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.570914:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:1.0:1788361468.570917:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361468.570919:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622800, rc 0) 00000100:00100000:1.0:1788361468.570989:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130670848:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 961us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361468.570997:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:0.0:1788361468.574009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.574670:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130671104 00000100:00100000:2.0:1788361468.574683:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130671104 00000100:00100000:2.0:1788361468.574847:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:2.0:1788361468.574857:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130671104:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788361468.574919:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361468.574951:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614bf9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f36a expref: 20 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.574969:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:2.0:1788361468.574974:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361468.575002:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c00 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.575018:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c00 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.575029:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c00 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.575043:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.575050:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.575075:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.575427:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c0e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.575666:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c0e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.575679:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c0e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361468.576901:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].3, 64 off8408 00010000:00010000:2.0:1788361468.576984:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.576997:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577006:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577014:0:37122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577021:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577027:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577051:0:37122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361468.577449:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361468.577458:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577502:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c0e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577511:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c0e lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577516:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c0e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.577846:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361468.577852:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.577862:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.577876:0:36289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:0.0:1788361468.577879:0:36289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361468.577884:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.577890:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614c15 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.577905:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361468.577914:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361468.577916:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361468.577939:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.577943:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c0e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577950:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c0e lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577958:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:2.0:1788361468.577961:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361468.577964:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c0e lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577970:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c0e lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577988:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c00 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577993:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c00 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.577998:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c00 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.578013:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.578016:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c00 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.578021:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c00 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.578029:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361468.578031:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361468.578034:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c00 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.578040:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c00 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361468.578051:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e8965dbf reply state 00000000372b7b8f transno 30064771113 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.578060:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361468.578581:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+21:31523:x1875232130671104:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 3720us (4577us total) trans 30064771113 rc 0/0 00000100:00100000:2.0:1788361468.578591:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00010000:00010000:3.0:1788361468.581148:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.581165:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.581181:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.581188:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361468.581335:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.581345:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.581363:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xb1b4ce6b (ffff9a8a8beaea00) 00010000:00010000:3.0:1788361468.581366:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361468.581371:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.581376:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614c07 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xb1b4ce6b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361468.582595:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.582660:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130671232 00000100:00100000:2.0:1788361468.582669:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130671232 00000100:00100000:2.0:1788361468.582728:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:2.0:1788361468.582738:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130671232:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361468.582766:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361468.582785:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c1c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f371 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.582869:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c23 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.582883:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c23 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.582894:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c23 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.582907:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c2a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.582914:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c2a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.582920:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c2a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.582981:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c23 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.582986:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c23 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.582992:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c23 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.582997:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.583000:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c23 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.583017:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c23 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.583028:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361468.583031:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361468.583035:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c23 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.583041:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c23 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.583055:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c2a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.583061:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c2a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.583067:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c2a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.583073:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.583075:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c2a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.583081:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c2a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.584682:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff9a8a8beaee00) 00010000:00010000:2.0:1788361468.584685:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361468.584748:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c2a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.584775:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c2a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.584837:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c1c lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f371 expref: 21 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.584848:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361468.584851:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361468.584855:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c1c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f371 expref: 21 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.584863:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:2.0:1788361468.584976:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130671232:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 2239us (2387us total) trans 0 rc 301/301 00000100:00100000:2.0:1788361468.584985:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1788361468.590648:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.590728:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130671360 00000100:00100000:1.0:1788361468.590738:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130671360 00000100:00100000:1.0:1788361468.590802:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:1.0:1788361468.590812:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130671360:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361468.590847:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361468.590872:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614c31 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f378 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.590951:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614c38 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.590969:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614c38 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.590981:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614c38 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.590996:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614c3f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.591019:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614c3f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.591025:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614c3f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.591119:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614c38 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.591127:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614c38 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.591133:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614c38 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.591138:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.591142:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614c38 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.591150:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614c38 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.591163:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361468.591165:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.591180:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614c38 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.591186:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614c38 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.591198:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614c3f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.592318:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614c3f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.592325:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614c3f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.592330:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.592334:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614c3f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.592341:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614c3f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.592353:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff9a8984a32d00) 00010000:00010000:1.0:1788361468.592356:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.592359:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614c3f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.592364:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614c3f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.592422:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614c31 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f378 expref: 21 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.592433:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361468.592435:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.592451:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614c31 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f378 expref: 21 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.592475:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623c00, rc 0) 00000100:00100000:1.0:1788361468.592547:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130671360:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 1736us (1907us total) trans 0 rc 301/301 00000100:00100000:1.0:1788361468.592554:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:0.0:1788361468.595753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.595864:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130671616 00000100:00100000:1.0:1788361468.595875:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130671616 00000100:00100000:1.0:1788361468.595934:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1788361468.595943:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130671616:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361468.595969:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361468.595992:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614c46 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f37f expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.596168:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614c4d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.596198:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614c4d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.596329:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614c4d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.596346:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.596353:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.596359:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.597151:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.597162:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.597179:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361468.597191:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788361468.598536:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614c4d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.598549:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614c4d lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.598556:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614c4d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.598562:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.598567:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614c4d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.598575:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614c4d lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.598591:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361468.598594:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.598600:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614c4d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.598622:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614c4d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361468.598636:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000010d3f269 reply state 00000000c2a5a12f transno 30064771114 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361468.598646:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361468.598693:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614c46 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f37f expref: 23 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.598710:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f37f expref: 22 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.598718:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:1.0:1788361468.598720:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788361468.598723:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622400, rc 0) 00000100:00100000:1.0:1788361468.598844:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+23:31523:x1875232130671616:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 2900us (3098us total) trans 30064771114 rc 0/0 00000100:00100000:1.0:1788361468.598853:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00010000:00010000:1.0:1788361468.606022:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.606041:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.606050:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.606058:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623000 already unused, calling callback (ffffffffc1fc84f0) 00000100:00100000:0.0:1788361468.606066:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:1.0:1788361468.606078:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.606115:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.606137:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff9a8984a32100) 00010000:00010000:1.0:1788361468.606140:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.606146:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.606153:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c54 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.606288:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130671872 00000100:00100000:2.0:1788361468.606297:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130671872 00000100:00100000:2.0:1788361468.606353:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1788361468.606364:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130671872:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788361468.606674:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.606690:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.606700:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361468.606765:0:37122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771115 00000004:00010000:2.0:1788361468.606792:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000394ed25 reply state 00000000ead9238c transno 30064771116 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.606801:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361468.606897:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:31523:x1875232130671872:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 534us (835us total) trans 30064771116 rc 0/0 00000100:00100000:2.0:1788361468.606906:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00000020:00080000:2.0:1788361468.606912:0:37122:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361468.609250:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.609267:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.609275:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.609282:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361468.609291:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.609299:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.609318:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:3.0:1788361468.609321:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361468.609340:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.609347:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614c69 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361468.610396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.611080:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130672128 00000100:00100000:2.0:1788361468.611124:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130672128 00000100:00100000:2.0:1788361468.611185:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:2.0:1788361468.611207:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+24:31523:x1875232130672128:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361468.611233:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361468.611255:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c70 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f386 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.611392:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c77 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.611407:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c77 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.611418:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c77 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.611430:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.611454:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.611460:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612041:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612050:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612054:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361468.612062:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 0 00010000:00010000:2.0:1788361468.612106:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c77 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612114:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c77 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612121:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c77 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612128:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.612133:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c77 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612141:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c77 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612166:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361468.612169:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361468.612186:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c77 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612193:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614c77 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361468.612207:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008adcb6b0 reply state 00000000fac38aac transno 30064771117 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.612216:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361468.612251:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614c70 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f386 expref: 27 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612266:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f386 expref: 26 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.612274:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361468.612276:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788361468.612278:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9800, rc 0) 00000100:00100000:2.0:1788361468.612355:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:31523:x1875232130672128:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 1160us (1963us total) trans 30064771117 rc 0/0 00000100:00100000:2.0:1788361468.612363:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00010000:00010000:1.0:1788361468.617221:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.617240:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.617248:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.617255:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.617260:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.617268:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.617287:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff9a8a8beaee00) 00010000:00010000:1.0:1788361468.617290:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.617311:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.617318:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614c7e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361468.618281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.618352:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130672384 00000100:00100000:2.0:1788361468.618362:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130672384 00000100:00100000:2.0:1788361468.618414:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:2.0:1788361468.618423:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+26:31523:x1875232130672384:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788361468.618716:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.618735:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.618747:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361468.618798:0:37122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771118 00000004:00010000:2.0:1788361468.618825:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087d15158 reply state 00000000b2ecbf70 transno 30064771119 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.618834:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361468.618928:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:31523:x1875232130672384:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 506us (652us total) trans 30064771119 rc 0/0 00000100:00100000:2.0:1788361468.618936:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000020:00080000:2.0:1788361468.618941:0:37122:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361468.620501:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.620513:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.620520:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.620526:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361468.620530:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.620537:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.620553:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:3.0:1788361468.620556:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361468.620561:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.620567:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614c93 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361468.623875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.623975:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130672640 00000100:00100000:1.0:1788361468.623986:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130672640 00000100:00100000:1.0:1788361468.624119:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:1.0:1788361468.624130:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:31529:x1875232130672640:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361468.624165:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361468.624196:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c9a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f38d expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624295:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ca1 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624311:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ca1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624323:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ca1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624339:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614ca8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624346:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614ca8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624352:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614ca8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624519:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614caf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624529:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614caf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624540:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614caf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361468.624552:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00010000:00010000:1.0:1788361468.624654:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ca1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624662:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ca1 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624668:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ca1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624674:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.624678:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ca1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624686:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ca1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624699:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361468.624703:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.624707:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ca1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624724:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ca1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624738:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614ca8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624744:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614ca8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624750:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614ca8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624755:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.624758:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614ca8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624764:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614ca8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624772:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff9a8984a32100) 00010000:00010000:1.0:1788361468.624775:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.624778:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614ca8 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624784:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614ca8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624834:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614c9a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f38d expref: 13 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624862:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614caf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f38d expref: 12 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.624869:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:1.0:1788361468.624872:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361468.624874:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623c00, rc 0) 00000100:00100000:1.0:1788361468.624937:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+12:31529:x1875232130672640:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 808us (1068us total) trans 30064771120 rc 0/0 00000100:00100000:1.0:1788361468.624945:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00080000:0.0:1788361468.625651:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361468.631534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.631631:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130672896 00000100:00100000:2.0:1788361468.631640:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130672896 00000100:00100000:2.0:1788361468.631731:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1788361468.631742:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+12:31529:x1875232130672896:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361468.631769:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361468.631791:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614cbd lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f394 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.631886:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614cc4 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.631904:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614cc4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.631944:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614cc4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.631961:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614ccb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.631969:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614ccb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.631976:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614ccb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632128:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614cd2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632148:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614cd2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632156:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614cd2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361468.632168:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00010000:00010000:2.0:1788361468.632298:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614cc4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632306:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614cc4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632313:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614cc4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632320:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.632331:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614cc4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632339:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614cc4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632352:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361468.632355:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361468.632359:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614cc4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632366:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614cc4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632379:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614ccb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632386:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614ccb lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632391:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614ccb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632396:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.632399:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614ccb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632405:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614ccb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632413:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff9a8a8beaee00) 00010000:00010000:2.0:1788361468.632415:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361468.632424:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614ccb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632431:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614ccb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632476:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614cbd lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f394 expref: 15 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632491:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614cd2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f394 expref: 14 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.632499:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:2.0:1788361468.632501:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361468.632504:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9e00, rc 0) 00000100:00100000:2.0:1788361468.632572:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+14:31529:x1875232130672896:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 830us (1045us total) trans 30064771121 rc 0/0 00000100:00100000:2.0:1788361468.632580:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1788361468.635446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361468.635524:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130673152 00000100:00100000:3.0:1788361468.635532:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130673152 00000100:00100000:3.0:1788361468.635587:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361468.635607:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+14:31529:x1875232130673152:12345-192.168.203.60@tcp:103:mmap_sanity.0 00010000:00010000:3.0:1788361468.635619:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361468.635644:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614caf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f38d expref: 14 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.635660:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:3.0:1788361468.635664:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361468.635717:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+13:31529:x1875232130673152:12345-192.168.203.60@tcp:103:mmap_sanity.0 Request processed in 110us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361468.635724:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1788361468.638785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.638833:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130673280 00000100:00100000:2.0:1788361468.638842:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130673280 00000100:00100000:2.0:1788361468.638902:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:2.0:1788361468.638911:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+13:31529:x1875232130673280:12345-192.168.203.60@tcp:58:mmap_sanity.0 00010000:00010000:2.0:1788361468.639017:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.639036:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f386 expref: 27 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.639063:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.639123:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f386 expref: 27 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.639137:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f386 expref: 27 pid: 35346 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.639152:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144207232:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361468.639462:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361468.642846:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144207232:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361468.642875:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361468.644074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.644336:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130673408 00000100:00100000:2.0:1788361468.644344:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130673408 00010000:00010000:2.0:1788361468.644380:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f386 expref: 28 pid: 35346 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.644475:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1788361468.644486:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:2349:x1875232130673408:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361468.644502:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361468.644511:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f386 expref: 28 pid: 35346 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.644543:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f386 expref: 28 pid: 35346 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.644566:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614c85 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f386 expref: 28 pid: 35346 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.644584:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361468.644590:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.644600:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.644608:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.644647:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361468.644668:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.644677:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.644714:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:2349:x1875232130673408:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 228us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361468.644722:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000040:00080000:0.0:1788361468.645608:0:35346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].2, 136 off8464 00000100:00100000:0.0:1788361468.645672:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+13:31529:x1875232130673280:12345-192.168.203.60@tcp:58:mmap_sanity.0 Request processed in 6762us (6894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361468.645681:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:0.0:1788361468.649150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.649294:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130673536 00000100:00100000:1.0:1788361468.649305:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130673536 00000100:00100000:1.0:1788361468.649360:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:1.0:1788361468.649370:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+13:31529:x1875232130673536:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361468.649394:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361468.649414:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614ce7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f39b expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.649472:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.649483:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614ce7 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f39b expref: 14 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.649502:0:35347:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.649535:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614ce7 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f39b expref: 14 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.649549:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:1.0:1788361468.649552:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361468.649556:0:35347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614ce7 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f39b expref: 14 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.649564:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623000, rc 0) 00000100:00100000:1.0:1788361468.649621:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+14:31529:x1875232130673536:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 253us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361468.649629:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000040:00080000:2.0:1788361468.768312:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361468.768321:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361468.768362:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 3 count 3 00000040:00080000:2.0:1788361468.768369:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361468.768493:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144207360:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788361468.768614:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361468.772421:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144207360:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361468.772537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.772680:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130673664 00000100:00100000:1.0:1788361468.772688:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130673664 00000100:00100000:1.0:1788361468.772748:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:1.0:1788361468.772760:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:31530:x1875232130673664:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788361468.772798:0:35345:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788361468.772914:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:31530:x1875232130673664:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 157us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361468.772922:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:3.0:1788361468.779446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361468.779577:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130673792 00000100:00100000:0.0:1788361468.779588:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130673792 00000100:00100000:0.0:1788361468.779651:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788361468.779661:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:31530:x1875232130673792:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788361468.779765:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614cee lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779783:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614cee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779796:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614cee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779812:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614cf5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779819:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779825:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779847:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779855:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779860:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361468.779901:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00000004:00200000:0.0:1788361468.779906:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361468.779931:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779944:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614cee lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779958:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614cee lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779965:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614cee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779970:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361468.779975:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614cee lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779983:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614cee lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.779994:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361468.779997:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361468.780002:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614cee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780007:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614cee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780021:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780027:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780032:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780036:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361468.780045:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780052:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780058:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x20b1fb9b (ffff9a8a90b43d00) 00010000:00010000:0.0:1788361468.780060:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361468.780062:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614cf5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780067:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614cf5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x20b1fb9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780082:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780140:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780146:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780150:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361468.780152:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780157:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780163:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:0.0:1788361468.780165:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361468.780185:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.780194:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6614cfc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361468.780273:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:31530:x1875232130673792:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 613us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361468.780280:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1788361468.782742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.783217:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130674048 00000100:00100000:2.0:1788361468.783224:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130674048 00000100:00100000:2.0:1788361468.783291:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788361468.783300:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:31530:x1875232130674048:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361468.783323:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361468.783344:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614d03 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3a2 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783460:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d0a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783476:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783489:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361468.783502:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00010000:00010000:2.0:1788361468.783603:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d0a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783611:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d0a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783618:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d0a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783624:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.783628:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d0a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783650:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d0a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783663:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361468.783667:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361468.783672:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d0a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783678:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d0a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783719:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614d03 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3a2 expref: 29 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783729:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:2.0:1788361468.783732:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361468.783735:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614d03 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3a2 expref: 29 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.783745:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8000, rc 0) 00000100:00100000:2.0:1788361468.783807:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:31530:x1875232130674048:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 508us (1083us total) trans 30064771122 rc 301/301 00000100:00100000:2.0:1788361468.783814:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788361468.785980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361468.786194:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130674176 00000100:00100000:0.0:1788361468.786203:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130674176 00000100:00100000:0.0:1788361468.786304:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:0.0:1788361468.786314:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+28:31530:x1875232130674176:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788361468.786348:0:37122:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x8:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788361468.786445:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+28:31530:x1875232130674176:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 133us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361468.786452:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1788361468.789510:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.789630:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130674432 00000100:00100000:2.0:1788361468.789644:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130674432 00000100:00100000:2.0:1788361468.789701:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:2.0:1788361468.789714:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:31530:x1875232130674432:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361468.789749:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361468.789779:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614d18 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3a9 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361468.790362:0:35346:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0xa5:0x0], count =29 00000004:00080000:2.0:1788361468.790368:0:35346:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0xa5:0x0]+29 in llog 00000004:00080000:2.0:1788361468.790419:0:35346:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc2:0x0], index 1: 0 00010000:00010000:2.0:1788361468.790603:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d1f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.790620:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d1f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.790633:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d1f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.790697:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614d18 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3a9 expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.790715:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d1f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3a9 expref: 30 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.790724:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaee00) 00010000:00010000:2.0:1788361468.790727:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361468.790731:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8600, rc 0) 00000100:00100000:2.0:1788361468.790790:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+30:31530:x1875232130674432:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1076us (1286us total) trans 30064771123 rc 0/0 00000100:00100000:2.0:1788361468.790797:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1788361468.793401:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.793465:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130674688 00000100:00100000:1.0:1788361468.793474:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130674688 00000100:00100000:1.0:1788361468.793528:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:1.0:1788361468.793538:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:31530:x1875232130674688:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361468.793595:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361468.793635:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614d1f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3a9 expref: 30 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793655:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaee00) 00010000:00010000:1.0:1788361468.793665:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361468.793686:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d2d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793698:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d2d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793707:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d2d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793721:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d34 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xa300653 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793729:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d34 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa300653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793736:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d34 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa300653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793816:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d2d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793824:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d2d lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793831:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d2d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793837:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.793848:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d2d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793856:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d2d lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793865:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361468.793867:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.793871:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d2d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793877:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d2d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793886:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d34 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa300653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793891:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d34 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa300653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793897:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d34 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa300653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793902:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.793904:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d34 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa300653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793910:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d34 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xa300653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793917:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xa300653 (ffff9a8984a32100) 00010000:00010000:1.0:1788361468.793919:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361468.793929:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d34 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xa300653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.793935:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d34 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xa300653 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361468.794005:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:31530:x1875232130674688:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 468us (610us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361468.794012:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:0.0:1788361468.799501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.799806:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130674816 00000100:00100000:2.0:1788361468.799829:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130674816 00000100:00100000:2.0:1788361468.799887:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:2.0:1788361468.799898:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:31530:x1875232130674816:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361468.799922:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361468.799946:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614d3b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3b0 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.799986:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.800001:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.800013:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.800141:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614d3b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b0 expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.800419:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b0 expref: 30 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.800427:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:2.0:1788361468.800429:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361468.800432:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361468.800489:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+30:31530:x1875232130674816:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 593us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361468.800496:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:3.0:1788361468.806043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361468.806139:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130675072 00000100:00100000:0.0:1788361468.806147:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130675072 00000100:00100000:0.0:1788361468.806213:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1788361468.806221:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:31530:x1875232130675072:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361468.806425:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.806446:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.806477:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361468.807415:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].2, 88 off8344 00000004:00080000:0.0:1788361468.807426:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 858822339834ns, next at 859822337847ns, rc = 0 00000004:00010000:0.0:1788361468.807519:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ba27d7e2 reply state 00000000f21d9154 transno 30064771124 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361468.807529:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361468.807686:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+32:31530:x1875232130675072:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1463us (1649us total) trans 30064771124 rc 0/0 00000100:00100000:0.0:1788361468.807695:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00010000:00010000:1.0:1788361468.809371:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.809385:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.809392:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.809399:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361468.809403:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.809411:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.809429:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:1.0:1788361468.809432:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788361468.809438:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.809444:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d49 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361468.810220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.810393:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130675200 00000100:00100000:1.0:1788361468.810402:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130675200 00000100:00100000:1.0:1788361468.810457:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:1.0:1788361468.810467:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:31530:x1875232130675200:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361468.810490:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361468.810507:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d50 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3b7 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.810567:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d50 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b7 expref: 32 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.810581:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d50 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b7 expref: 32 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.810600:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:1.0:1788361468.810604:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361468.810606:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622200, rc 0) 00000100:00100000:1.0:1788361468.810652:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:31530:x1875232130675200:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 187us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361468.810658:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:3.0:1788361468.812741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.812914:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130675328 00000100:00100000:2.0:1788361468.812933:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130675328 00000100:00100000:2.0:1788361468.812986:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788361468.812996:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+5:2350:x1875232130675328:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788361468.813447:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130675328:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 442us (701us total) trans 30064771074 rc 0/0 00000100:00100000:2.0:1788361468.813456:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361468.815147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.815224:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130675584 00000100:00100000:2.0:1788361468.815230:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130675584 00000100:00100000:2.0:1788361468.815271:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1788361468.815278:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:31530:x1875232130675584:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361468.815507:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:31530:x1875232130675584:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 228us (364us total) trans 30064771125 rc 0/0 00000100:00100000:2.0:1788361468.815514:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361468.817221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.817382:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130675840 00000100:00100000:1.0:1788361468.817389:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130675840 00000100:00100000:1.0:1788361468.817445:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1788361468.817454:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+33:31530:x1875232130675840:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788361468.817549:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+33:31530:x1875232130675840:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 95us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361468.817569:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:3.0:1788361468.819168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.819245:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130675968 00000100:00100000:1.0:1788361468.819251:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130675968 00000100:00100000:1.0:1788361468.819344:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:1.0:1788361468.819354:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:31530:x1875232130675968:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361468.819371:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361468.819393:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d57 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3be expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.819495:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614d5e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.819515:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614d5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.819528:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614d5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361468.819567:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361468.819584:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614d5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.819614:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614d57 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3be expref: 35 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.819631:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614d5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3be expref: 34 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.819641:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:1.0:1788361468.819650:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788361468.819654:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623a00, rc 0) 00000100:00100000:1.0:1788361468.819700:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:31530:x1875232130675968:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 347us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361468.819706:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:0.0:1788361468.821861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.821942:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130676096 00000100:00100000:2.0:1788361468.821952:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130676096 00000100:00100000:2.0:1788361468.822004:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:2.0:1788361468.822015:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130676096:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361468.822031:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361468.822051:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614d65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3c5 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361468.822073:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983afd, blocks: 0x1 00010000:00010000:2.0:1788361468.822140:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=858s v=(0 0) 00010000:00010000:2.0:1788361468.822146:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361468.822163:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3c5 expref: 7 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.822204:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3c5 expref: 7 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.822217:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8000, rc 0) 00000100:00100000:2.0:1788361468.822268:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130676096:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 257us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361468.822282:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361468.825448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361468.825673:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130676352 00000100:00100000:0.0:1788361468.825695:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130676352 00000100:00100000:0.0:1788361468.825751:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:0.0:1788361468.825944:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+34:31530:x1875232130676352:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788361468.826057:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+34:31530:x1875232130676352:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 297us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361468.826403:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1788361468.832161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.832282:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130676480 00000100:00100000:1.0:1788361468.832292:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130676480 00000100:00100000:1.0:1788361468.832355:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1788361468.832366:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:31530:x1875232130676480:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361468.832392:0:35983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361468.832414:0:35983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3cc expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.832462:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614d65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3c5 expref: 8 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.832475:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361468.832480:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361468.832488:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 8 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.832528:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3c5 expref: 8 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.832547:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614d65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3c5 expref: 8 pid: 36286 timeout: 958 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361468.832586:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144207488:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361468.834876:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab7445300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361468.839522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.839581:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144207488:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361468.839613:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130676608 00000100:00100000:3.0:1788361468.839626:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130676608 00010000:00010000:3.0:1788361468.839661:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614d65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3c5 expref: 9 pid: 36286 timeout: 958 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.839677:0:35983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 9 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.839698:0:35983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623800, rc 0) 00000100:00100000:2.0:1788361468.839717:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361468.839727:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:2349:x1875232130676608:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361468.839740:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788361468.839762:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:31530:x1875232130676480:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 7399us (7609us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361468.839764:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614d65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3c5 expref: 9 pid: 36286 timeout: 958 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361468.839770:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00010000:00010000:2.0:1788361468.839777:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614d65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3c5 expref: 9 pid: 36286 timeout: 958 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.839801:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d6614d65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3c5 expref: 8 pid: 36286 timeout: 958 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.839815:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361468.839819:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361468.839829:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.839853:0:36007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.839886:0:36007:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.839899:0:36007:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:36007:1875232144207616:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361468.839947:0:36007:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a812edf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361468.841695:0:36007:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:36007:1875232144207616:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361468.841716:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361468.841760:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130676608:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 2036us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361468.841767:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1788361468.847525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361468.847664:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130676736 00000100:00100000:3.0:1788361468.847674:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130676736 00002000:00100000:3.0:1788361468.847736:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff9a8a8926dc00 x1875232130676736/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:529/0 lens 488/0 e 0 to 0 dl 1788361479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788361468.847747:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926dc00 with x1875232130676736 ext(0->409599) 00002000:00010000:3.0:1788361468.847753:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926dc00 00000100:00100000:3.0:1788361468.847789:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361468.847798:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130676736:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361468.859289:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2349:x1875232130676736:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 11481us (11762us total) trans 30064771075 rc 0/0 00000100:00100000:1.0:1788361468.859309:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00002000:00100000:1.0:1788361468.859321:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff9a8a8926dc00 x1875232130676736/t30064771075(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:529/0 lens 488/448 e 0 to 0 dl 1788361479 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788361468.859332:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926dc00 with x1875232130676736 ext(0->409599) 00002000:00010000:1.0:1788361468.859339:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926dc00 00000100:00100000:0.0:1788361468.868869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.868988:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130676864 00000100:00100000:2.0:1788361468.868998:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130676864 00000100:00100000:2.0:1788361468.869056:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:2.0:1788361468.869066:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+34:31530:x1875232130676864:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788361468.897294:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771124 is committed 00000100:00100000:2.0:1788361468.897305:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+34:31530:x1875232130676864:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 28236us (28440us total) trans 0 rc 0/0 00000004:00080000:1.0:1788361468.897306:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788361468.897315:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000020:00080000:1.0:1788361468.897323:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a86477540 refcount 2 committed 0 result 0 batchid 25769803891 00000020:00080000:1.0:1788361468.897326:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ab7662f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a83c98180 00000020:00080000:1.0:1788361468.897330:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ab7662b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8abd1a7400 00000001:00080000:1.0:1788361468.897372:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771120 is committed 00000001:00080000:1.0:1788361468.897383:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771125 is committed 00000020:00080000:2.0:1788361468.897388:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803891 committed batchid 21474836520 00000001:00080000:1.0:1788361468.897393:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771121 is committed 00000020:00080000:2.0:1788361468.897572:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 21474836520 00000100:00100000:2.0:1788361468.898027:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144207744:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788361468.898081:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361468.898147:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144207744 00000100:00100000:0.0:1788361468.898155:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144207744 00000100:00080000:2.0:1788361468.898208:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361468.898327:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788361468.898335:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144207744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788361468.898458:0:36286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:0.0:1788361468.898461:0:36286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 0 -> 1788361469 00002000:00010000:0.0:1788361468.898463:0:36286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788361468.898464:0:36286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1788361469 -> 1788361469 00002000:00010000:0.0:1788361468.898466:0:36286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788361468.898506:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144207744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (424us total) trans 30064771076 rc 0/0 00000100:00100000:0.0:1788361468.898513:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361468.898562:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771073 gen 2 00000100:00100000:2.0:1788361468.898581:0:3313:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8a9f585880 x1875232144207744/t30064771076(30064771076) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788361484 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788361468.898593:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a9f585880/2, rc 0, transno 30064771076 00000100:00100000:2.0:1788361468.898597:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144207744:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788361468.900033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.900109:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130676992 00000100:00100000:2.0:1788361468.900117:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130676992 00000100:00100000:2.0:1788361468.900165:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:2.0:1788361468.900185:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130676992:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788361468.918115:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771076 is committed 00000001:00080000:0.0:1788361468.918132:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771075 is committed 00000100:00100000:3.0:1788361468.918319:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130676992:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 18140us (18286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361468.918331:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361468.920347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.920526:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130677248 00000100:00100000:1.0:1788361468.920536:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130677248 00000100:00100000:1.0:1788361468.920598:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1788361468.920608:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:31530:x1875232130677248:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361468.920667:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361468.920695:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614d5e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3be expref: 14 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.920713:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:1.0:1788361468.920718:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361468.920752:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.920768:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.920778:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361468.920941:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061092634 reply state 0000000034014f5b transno 30064771126 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361468.920950:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361468.921200:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:31530:x1875232130677248:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 592us (858us total) trans 30064771126 rc 0/0 00000100:00100000:1.0:1788361468.921209:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00010000:00010000:3.0:1788361468.925690:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.925709:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.925716:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.925723:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361468.925728:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.925736:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.925754:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:3.0:1788361468.925757:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361468.925779:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.925786:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614d73 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361468.926216:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.926292:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130677376 00000100:00100000:1.0:1788361468.926301:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130677376 00000100:00100000:1.0:1788361468.926378:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:1.0:1788361468.926392:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130677376:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788361468.926644:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:1.0:1788361468.926648:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1788361469 -> 1788361469 00002000:00010000:1.0:1788361468.926650:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb atime from disk: 0 -> 1788361469 00002000:00010000:1.0:1788361468.926653:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1788361469 -> 1788361469 00002000:00010000:1.0:1788361468.926655:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:1.0:1788361468.926721:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130677376:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 333us (508us total) trans 30064771077 rc 0/0 00000100:00100000:1.0:1788361468.926728:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788361468.929248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.929290:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130677632 00000100:00100000:1.0:1788361468.929300:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130677632 00000100:00100000:1.0:1788361468.929411:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:1.0:1788361468.929422:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:31530:x1875232130677632:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788361468.929509:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.929528:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b0 expref: 14 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.929537:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.929573:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b0 expref: 14 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.929607:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b0 expref: 14 pid: 35346 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361468.929622:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144207872:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361468.929718:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8376e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788361468.932466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.932722:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144207872:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361468.932750:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.932827:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130677760 00000100:00100000:2.0:1788361468.932833:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130677760 00010000:00010000:2.0:1788361468.932865:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b0 expref: 15 pid: 35346 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.932933:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1788361468.932943:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8419d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130677760:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361468.932956:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361468.932963:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b0 expref: 15 pid: 35346 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.932975:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b0 expref: 15 pid: 35346 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.932999:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d42 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b0 expref: 15 pid: 35346 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.933038:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:2.0:1788361468.933043:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.933053:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.933067:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.933122:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361468.933180:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8419d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130677760:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 230us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361468.933188:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00010000:00010000:3.0:1788361468.933290:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.933299:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.933332:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.933338:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.933345:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.933398:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361468.933404:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.933412:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.933424:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:3.0:1788361468.933426:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788361468.933430:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361468.933452:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614d7a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361468.933507:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:31530:x1875232130677632:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 4088us (4266us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788361468.933516:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788361468.938003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.938310:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130677888 00000100:00100000:1.0:1788361468.938320:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130677888 00000100:00100000:1.0:1788361468.938448:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1788361468.938459:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2351:x1875232130677888:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788361468.938507:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.938530:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.938539:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361468.938543:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361468.938548:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.938587:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.938616:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 7 pid: 35983 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361468.938633:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144208000:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361468.938713:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8376e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788361468.940407:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144208000:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361468.940431:0:35983:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361468.942570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.942752:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130678016 00000100:00100000:2.0:1788361468.942760:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130678016 00010000:00010000:2.0:1788361468.942797:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 8 pid: 35983 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.942872:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361468.942882:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130678016:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361468.942898:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361468.942921:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 8 pid: 35983 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.942934:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 8 pid: 35983 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.942969:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6614d6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3cc expref: 8 pid: 35983 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.942985:0:35331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361468.942989:0:35331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361468.942995:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.943006:0:35331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.943043:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361468.943125:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130678016:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 244us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361468.943134:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00010000:00010000:1.0:1788361468.943646:0:35983:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.943657:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.943685:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.943704:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.943713:0:35983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.943734:0:35983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361468.943738:0:35983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.943747:0:35983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.943761:0:35983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.943767:0:35983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054c6898f/0xf6a94c97d6614d81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361468.943829:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2351:x1875232130677888:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 5372us (5832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361468.943837:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788361468.946398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361468.946532:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130678272 00000100:00100000:0.0:1788361468.946541:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130678272 00000100:00100000:0.0:1788361468.946594:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:0.0:1788361468.946604:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:31530:x1875232130678272:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788361468.946700:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614d88 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.946719:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614d88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.946731:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614d88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.946975:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.946998:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d50 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b7 expref: 14 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.947006:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.947040:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d50 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b7 expref: 14 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.947054:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d50 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b7 expref: 14 pid: 35345 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361468.947069:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144208128:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361468.947180:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935600 going to sleep for 11 seconds 00000100:00100000:2.0:1788361468.949109:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144208128:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361468.949133:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361468.949713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.949910:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130678400 00000100:00100000:1.0:1788361468.949917:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130678400 00010000:00010000:1.0:1788361468.949949:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d50 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b7 expref: 15 pid: 35345 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361468.949988:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1788361468.949997:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130678400:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361468.950011:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361468.950030:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d50 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b7 expref: 15 pid: 35345 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.950043:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d50 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b7 expref: 15 pid: 35345 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.950064:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614d50 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3b7 expref: 15 pid: 35345 timeout: 958 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.950078:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:1.0:1788361468.950083:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.950132:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.950139:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361468.950176:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361468.950211:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.950220:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361468.950235:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130678400:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 238us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361468.950244:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000001:00080000:2.0:1788361468.950410:0:37122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771127 00000001:00080000:2.0:1788361468.950582:0:37122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771128 00000001:00080000:2.0:1788361468.950631:0:37122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771129 00000100:00100000:2.0:1788361468.950718:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37122:1875232144208256:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788361468.950759:0:37122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361468.950787:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a812ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361468.951107:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144208256 00000100:00100000:0.0:1788361468.951112:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144208256 00000100:00100000:0.0:1788361468.951151:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788361468.951158:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:37122:x1875232144208256:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788361468.951354:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:37122:x1875232144208256:12345-0@lo:1000:mdt00_003.0 Request processed in 196us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361468.951356:0:37122:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771076 gen 2 00000004:00080000:2.0:1788361468.951361:0:37122:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a9f585880, transno 30064771076 00000100:00100000:0.0:1788361468.951362:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788361468.951410:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37122:1875232144208256:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788361468.951927:0:37122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771130 00000100:00100000:2.0:1788361468.951980:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37122:1875232144208384:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788361468.952011:0:37122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361468.952033:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f6a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361468.952052:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144208384 00000100:00100000:1.0:1788361468.952057:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144208384 00000100:00100000:1.0:1788361468.952182:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788361468.952188:0:35351:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788361468.952191:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:37122:x1875232144208384:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788361468.952195:0:35351:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788361468.952475:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:37122:x1875232144208384:12345-0@lo:1000:mdt00_003.0 Request processed in 284us (462us total) trans 30064771078 rc 0/0 00000100:00100000:1.0:1788361468.952491:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788361468.953220:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:37122:1875232144208384:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788361468.953254:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953265:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953273:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953279:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.953283:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953292:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953308:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:2.0:1788361468.953319:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361468.953326:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953332:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614d8f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953361:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953368:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953374:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953380:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.953383:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953389:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953397:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361468.953399:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361468.953406:0:37122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614ce7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f39b expref: 9 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953418:0:37122:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614ce7 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f39b expref: 9 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953428:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614ce7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f39b expref: 9 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.953467:0:37122:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614ce7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f39b expref: 9 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.953480:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144208512:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361468.953541:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f6a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361468.956338:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144208512:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361468.956365:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956376:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614ce0 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956409:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d96 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956424:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d96 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956437:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d96 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956448:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d96 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956454:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d96 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956461:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d96 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956481:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.956485:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d96 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956492:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d96 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956505:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361468.956508:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361468.956512:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d96 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956518:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614d96 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956528:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614d88 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956534:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614d88 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956540:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614d88 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956545:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361468.956548:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614d88 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956555:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614d88 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956575:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361468.956577:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361468.956580:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614d88 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.956586:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614d88 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361468.956896:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:31530:x1875232130678272:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 10292us (10515us total) trans 30064771131 rc 0/0 00000100:00100000:2.0:1788361468.956906:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000020:00080000:2.0:1788361468.956912:0:37122:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788361468.957196:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361468.957201:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361468.957232:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 3 count 3 00000040:00080000:0.0:1788361468.957237:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361468.958250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.958346:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130678528 00000100:00100000:1.0:1788361468.958353:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130678528 00000100:00100000:1.0:1788361468.958401:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:1.0:1788361468.958411:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:31529:x1875232130678528:12345-192.168.203.60@tcp:49:mmap_sanity.0 00000100:00100000:1.0:1788361468.958537:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:31529:x1875232130678528:12345-192.168.203.60@tcp:49:mmap_sanity.0 Request processed in 127us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361468.958544:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361468.961733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361468.962560:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130678656 00000100:00100000:0.0:1788361468.962570:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130678656 00000100:00100000:0.0:1788361468.962666:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:3.0:1788361468.962675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361468.962692:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:31529:x1875232130678656:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361468.962712:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361468.962735:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3d3 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361468.962762:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6a983afd, atime: 0x6a983afd, ctime: 0x6a983afd, blocks: 0x403 00010000:00010000:0.0:1788361468.962783:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=858s v=(0 0) 00010000:00010000:0.0:1788361468.962788:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361468.962800:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 6 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.962817:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 6 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.962831:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:0.0:1788361468.962887:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31529:x1875232130678656:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 211us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361468.962894:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:2.0:1788361468.962939:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130678912 00000100:00100000:2.0:1788361468.962943:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130678912 00000100:00100000:2.0:1788361468.962974:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361468.962981:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:31530:x1875232130678912:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788361468.963755:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788361468.963893:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771132 00010000:00010000:2.0:1788361468.963939:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.963955:0:35348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.963967:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.963974:0:35348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.963994:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.964000:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361468.964022:0:35348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788361468.964111:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:31530:x1875232130678912:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1129us (1440us total) trans 30064771133 rc 0/0 00000100:00100000:2.0:1788361468.964119:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000020:00080000:2.0:1788361468.964123:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788361468.964487:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361468.964494:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.964502:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361468.964512:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.964521:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.964535:0:35334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x9:0x0].0x0 (ffff9a8a8beaeb00) 00010000:00010000:0.0:1788361468.964538:0:35334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361468.964542:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.964547:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614da4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361468.964565:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361468.964567:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361468.964569:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361468.967112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.967215:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130679040 00000100:00100000:2.0:1788361468.967225:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130679040 00002000:00100000:2.0:1788361468.967282:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->4095) req@ffff9a8a9f585880 x1875232130679040/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:529/0 lens 488/0 e 0 to 0 dl 1788361479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361468.967293:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9f585880 with x1875232130679040 ext(0->4095) 00002000:00010000:2.0:1788361468.967299:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9f585880 00000100:00100000:2.0:1788361468.967367:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361468.967377:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130679040:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:2.0:1788361468.967614:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130679040:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 239us (540us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788361468.967622:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00002000:00100000:2.0:1788361468.967628:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->4095) req@ffff9a8a9f585880 x1875232130679040/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:529/0 lens 488/4536 e 0 to 0 dl 1788361479 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361468.967636:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9f585880 with x1875232130679040 ext(0->4095) 00002000:00010000:2.0:1788361468.967645:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9f585880 00000100:00100000:3.0:1788361468.970556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.970972:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130679168 00000100:00100000:1.0:1788361468.970983:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130679168 00002000:00100000:1.0:1788361468.971067:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (4096->8191) req@ffff9a898705c000 x1875232130679168/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:529/0 lens 488/0 e 0 to 0 dl 1788361479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361468.971167:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705c000 with x1875232130679168 ext(4096->8191) 00002000:00010000:1.0:1788361468.971181:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705c000 00000100:00100000:1.0:1788361468.971214:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361468.971225:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2351:x1875232130679168:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:1.0:1788361468.971460:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2351:x1875232130679168:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 236us (910us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788361468.971468:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00002000:00100000:1.0:1788361468.971482:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (4096->8191) req@ffff9a898705c000 x1875232130679168/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:529/0 lens 488/4536 e 0 to 0 dl 1788361479 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361468.971492:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705c000 with x1875232130679168 ext(4096->8191) 00002000:00010000:1.0:1788361468.971495:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705c000 00000100:00100000:0.0:1788361468.975231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.975320:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130679296 00000100:00100000:2.0:1788361468.975329:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130679296 00002000:00100000:2.0:1788361468.975379:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (8192->12287) req@ffff9a8a8926fb80 x1875232130679296/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:529/0 lens 488/0 e 0 to 0 dl 1788361479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361468.975390:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926fb80 with x1875232130679296 ext(8192->12287) 00002000:00010000:2.0:1788361468.975395:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926fb80 00000100:00100000:2.0:1788361468.975425:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361468.975435:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130679296:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:2.0:1788361468.975615:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130679296:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 182us (393us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788361468.975623:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00002000:00100000:2.0:1788361468.975628:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (8192->12287) req@ffff9a8a8926fb80 x1875232130679296/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:529/0 lens 488/4536 e 0 to 0 dl 1788361479 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361468.975635:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926fb80 with x1875232130679296 ext(8192->12287) 00002000:00010000:2.0:1788361468.975638:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926fb80 00000100:00100000:0.0:1788361468.982263:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361468.982360:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130679424 00000100:00100000:1.0:1788361468.982370:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130679424 00002000:00100000:1.0:1788361468.982450:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (12288->69631) req@ffff9a8a8926df80 x1875232130679424/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:529/0 lens 488/0 e 0 to 0 dl 1788361479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361468.982461:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926df80 with x1875232130679424 ext(12288->69631) 00002000:00010000:1.0:1788361468.982468:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926df80 00000100:00100000:1.0:1788361468.982501:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1788361468.982510:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2352:x1875232130679424:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:1.0:1788361468.991008:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2352:x1875232130679424:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 8484us (8739us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1788361468.991023:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00002000:00100000:1.0:1788361468.991034:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (12288->69631) req@ffff9a8a8926df80 x1875232130679424/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:529/0 lens 488/440 e 0 to 0 dl 1788361479 ref 1 fl Complete:/600/0 rc 57344/57344 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361468.991045:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926df80 with x1875232130679424 ext(12288->69631) 00002000:00010000:1.0:1788361468.991052:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926df80 00000100:00100000:3.0:1788361468.996952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361468.997189:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130679552 00000100:00100000:2.0:1788361468.997201:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130679552 00002000:00100000:2.0:1788361468.997256:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (69632->106495) req@ffff9a898705f480 x1875232130679552/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:529/0 lens 488/0 e 0 to 0 dl 1788361479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361468.997267:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705f480 with x1875232130679552 ext(69632->106495) 00002000:00010000:2.0:1788361468.997334:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705f480 00000100:00100000:2.0:1788361468.997407:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1788361468.997416:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2351:x1875232130679552:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361469.001394:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2351:x1875232130679552:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 3970us (4444us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788361469.001409:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00002000:00100000:0.0:1788361469.001421:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (69632->106495) req@ffff9a898705f480 x1875232130679552/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:529/0 lens 488/440 e 0 to 0 dl 1788361479 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361469.001432:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705f480 with x1875232130679552 ext(69632->106495) 00002000:00010000:0.0:1788361469.001439:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705f480 00000100:00100000:3.0:1788361469.006981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361469.007244:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130679680 00000100:00100000:1.0:1788361469.007256:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130679680 00002000:00100000:1.0:1788361469.007330:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (106496->143359) req@ffff9a898705ca80 x1875232130679680/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:530/0 lens 488/0 e 0 to 0 dl 1788361480 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361469.007342:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705ca80 with x1875232130679680 ext(106496->143359) 00002000:00010000:1.0:1788361469.007347:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705ca80 00000100:00100000:1.0:1788361469.007380:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:1.0:1788361469.007390:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130679680:12345-192.168.203.60@tcp:3:kworker.0 00000100:00080000:2.0:1788361469.007780:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361469.010977:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130679680:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 3580us (3996us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788361469.011004:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00002000:00100000:1.0:1788361469.011016:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (106496->143359) req@ffff9a898705ca80 x1875232130679680/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:530/0 lens 488/440 e 0 to 0 dl 1788361480 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361469.011026:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705ca80 with x1875232130679680 ext(106496->143359) 00002000:00010000:1.0:1788361469.011032:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705ca80 00000100:00100000:3.0:1788361469.015781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361469.015883:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130679808 00000100:00100000:0.0:1788361469.015893:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130679808 00002000:00100000:0.0:1788361469.015943:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (143360->180223) req@ffff9a898705ce00 x1875232130679808/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:530/0 lens 488/0 e 0 to 0 dl 1788361480 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361469.016032:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705ce00 with x1875232130679808 ext(143360->180223) 00002000:00010000:0.0:1788361469.016039:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705ce00 00000100:00100000:0.0:1788361469.016080:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361469.017211:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130679808:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361469.019912:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130679808:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 2701us (4191us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788361469.019924:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00002000:00100000:0.0:1788361469.019935:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (143360->180223) req@ffff9a898705ce00 x1875232130679808/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:530/0 lens 488/440 e 0 to 0 dl 1788361480 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361469.019946:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705ce00 with x1875232130679808 ext(143360->180223) 00002000:00010000:0.0:1788361469.019953:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705ce00 00000100:00100000:0.0:1788361469.028636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361469.028805:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130679936 00000100:00100000:1.0:1788361469.028816:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130679936 00002000:00100000:1.0:1788361469.028865:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (180224->217087) req@ffff9a8a8926f480 x1875232130679936/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:530/0 lens 488/0 e 0 to 0 dl 1788361480 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361469.028877:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926f480 with x1875232130679936 ext(180224->217087) 00002000:00010000:1.0:1788361469.028883:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926f480 00000100:00100000:1.0:1788361469.028919:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1788361469.028929:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130679936:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:2.0:1788361469.033132:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130679936:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 4194us (4494us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788361469.033146:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00002000:00100000:2.0:1788361469.033157:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (180224->217087) req@ffff9a8a8926f480 x1875232130679936/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:530/0 lens 488/440 e 0 to 0 dl 1788361480 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361469.033176:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926f480 with x1875232130679936 ext(180224->217087) 00002000:00010000:2.0:1788361469.033184:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926f480 00010000:00010000:1.0:1788361469.344879:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361470.112736:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361470.112847:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144208768:0@lo:400:kworker.0 00000100:00100000:0.0:1788361470.112914:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361470.112970:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361470.112977:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144208896:0@lo:400:kworker.0 00000100:00100000:0.0:1788361470.113000:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361470.113048:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144209152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361470.113072:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361470.113131:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361470.113137:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144209024:0@lo:400:kworker.0 00000100:00100000:0.0:1788361470.113174:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361470.113226:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144209152 00000100:00100000:0.0:1788361470.113233:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144209152 00000100:00100000:0.0:1788361470.113287:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788361470.113296:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144209152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361470.113333:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361470.113375:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144209152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361470.113382:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788361470.113403:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361470.113433:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144209152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361470.113453:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144208768 00000100:00100000:0.0:1788361470.113456:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144208768 00000100:00100000:0.0:1788361470.113484:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144208896 00000100:00100000:0.0:1788361470.113487:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144208896 00000100:00100000:0.0:1788361470.113504:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361470.113510:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144208768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361470.113543:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144208768:12345-0@lo:400:kworker.0 Request processed in 33us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361470.113549:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361470.113560:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361470.113566:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144208896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361470.113591:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144208896:12345-0@lo:400:kworker.0 Request processed in 25us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361470.113597:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788361470.113610:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361470.113625:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144208896:0@lo:400:kworker.0 00000100:00100000:0.0:1788361470.113635:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144208768:0@lo:400:kworker.0 00000100:00100000:0.0:1788361470.113695:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144209024 00000100:00100000:0.0:1788361470.113699:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144209024 00000100:00100000:0.0:1788361470.113725:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788361470.113731:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144209024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361470.113765:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144209024:12345-0@lo:400:kworker.0 Request processed in 34us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361470.113771:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788361470.113794:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144209024:0@lo:400:kworker.0 00000100:00100000:3.0:1788361470.113887:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144208640:0@lo:400:kworker.0 00000100:00100000:3.0:1788361470.113921:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361470.114431:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144209408:0@lo:400:kworker.0 00000100:00100000:2.0:1788361470.114463:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361470.114486:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361470.114493:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144209280:0@lo:400:kworker.0 00000100:00100000:2.0:1788361470.114519:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361470.114561:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144208640 00000100:00100000:0.0:1788361470.114566:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144208640 00000100:00100000:0.0:1788361470.114603:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788361470.114610:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144208640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361470.114659:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144208640:12345-0@lo:400:kworker.0 Request processed in 49us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361470.114665:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788361470.117324:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144209408 00000100:00100000:3.0:1788361470.117333:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144209280 00000100:00100000:3.0:1788361470.117338:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144209280 00000100:00100000:2.0:1788361470.117338:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144209408 00000100:00100000:3.0:1788361470.117387:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144208640:0@lo:400:kworker.0 00000100:00100000:2.0:1788361470.117408:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361470.117419:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144209408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361470.117439:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788361470.117445:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144209280:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788361470.117511:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361470.117565:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144209280:12345-0@lo:400:kworker.0 Request processed in 118us (3045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361470.117584:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361470.117662:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144209408:12345-0@lo:400:kworker.0 Request processed in 246us (3198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361470.117669:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361470.117687:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144209280:0@lo:400:kworker.0 00000100:00100000:0.0:1788361470.117701:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144209408:0@lo:400:kworker.0 00010000:00010000:0.0:1788361470.368538:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361470.624446:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144209536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361470.624749:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788361470.624805:0:35368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 860639717951ns, next at 861639715883ns, rc = 0 00000100:00100000:0.0:1788361470.624861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361470.624954:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130680064 00000100:00100000:2.0:1788361470.624961:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130680064 00000100:00100000:2.0:1788361470.625147:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:2.0:1788361470.625170:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+19:31523:x1875232130680064:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361470.625218:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361470.625241:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614dab lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3da expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361470.625310:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614dab lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3da expref: 20 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361470.625326:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614dab lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3da expref: 20 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361470.625349:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361470.625352:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361470.625357:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361470.625406:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130680064:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 249us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361470.625413:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00080000:0.0:1788361470.625656:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361470.627688:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144209536 00000100:00100000:1.0:1788361470.627700:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144209536 00000100:00100000:1.0:1788361470.627809:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788361470.627820:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144209536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361470.627857:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 49348608 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361470.627932:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144209536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (3183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361470.627939:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361470.628006:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144209536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361470.629889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361470.629983:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130680192 00000100:00100000:0.0:1788361470.629992:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130680192 00000100:00080000:2.0:1788361470.630071:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361470.630149:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:0.0:1788361470.630175:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:31523:x1875232130680192:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361470.630205:0:35983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361470.630226:0:35983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3e1 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361470.630256:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 5 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361470.630262:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788361470.630266:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361470.630269:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361470.630414:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 5 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361470.630431:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 5 pid: 36286 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361470.630450:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144209664:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361470.630532:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90935540 going to sleep for 11 seconds 00000100:00100000:1.0:1788361470.632147:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144209664:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361470.632203:0:35983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361470.632329:0:35983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fe00, rc 0) 00000100:00100000:1.0:1788361470.632378:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88447050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:31523:x1875232130680192:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 2220us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361470.632387:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1788361470.633612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361470.633731:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130680320 00000100:00100000:0.0:1788361470.633740:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130680320 00002000:00100000:0.0:1788361470.633796:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->204799) req@ffff9a898705d500 x1875232130680320/t0(0) o4->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:531/0 lens 488/0 e 0 to 0 dl 1788361481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361470.633808:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705d500 with x1875232130680320 ext(0->204799) 00010000:00010000:0.0:1788361470.633816:0:35986:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 6 pid: 36286 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361470.633844:0:35986:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 6 pid: 36286 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361470.633852:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a898705d500 00000100:00100000:0.0:1788361470.633880:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1788361470.633889:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130680320:12345-192.168.203.60@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1788361470.640393:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2350:x1875232130680320:12345-192.168.203.60@tcp:4:ldlm_bl.0 Request processed in 6493us (6772us total) trans 30064771079 rc 0/0 00000100:00100000:0.0:1788361470.640409:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:0.0:1788361470.640424:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (0->204799) req@ffff9a898705d500 x1875232130680320/t30064771079(0) o4->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:531/0 lens 488/448 e 0 to 0 dl 1788361481 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361470.640435:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705d500 with x1875232130680320 ext(0->204799) 00010000:00010000:0.0:1788361470.640447:0:35986:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 8 pid: 36286 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361470.640467:0:35986:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 8 pid: 36286 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361470.640490:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a898705d500 00000100:00100000:3.0:1788361470.643241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361470.643401:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130680448 00000100:00100000:2.0:1788361470.643411:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130680448 00010000:00010000:2.0:1788361470.643452:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 8 pid: 36286 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361470.643509:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1788361470.643519:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2349:x1875232130680448:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361470.643536:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361470.643562:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 8 pid: 36286 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361470.643760:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 8 pid: 36286 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361470.643891:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009366bf70/0xf6a94c97d6614d9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3d3 expref: 8 pid: 36286 timeout: 960 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361470.643911:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361470.643917:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361470.643928:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361470.643939:0:36007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361470.643980:0:36007:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361470.643995:0:36007:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:36007:1875232144209792:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361470.644235:0:36007:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361470.647442:0:36007:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:36007:1875232144209792:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361470.647467:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361470.647520:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:2349:x1875232130680448:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 4003us (4284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361470.647531:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000040:00080000:0.0:1788361471.008421:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361471.008431:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361471.008466:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 3 count 3 00000040:00080000:0.0:1788361471.008472:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361471.042792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361471.043034:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130680576 00000100:00100000:1.0:1788361471.043044:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130680576 00000100:00100000:1.0:1788361471.043147:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361471.043168:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:31529:x1875232130680576:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361471.043188:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361471.043209:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000259755f4/0xf6a94c97d6614db9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3e8 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361471.043244:0:35980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361471.043253:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:1.0:1788361471.043258:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1788361471.043263:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000259755f4/0xf6a94c97d6614db9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e8 expref: 8 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361471.043299:0:35980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361471.043334:0:35980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 6 pid: 35983 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361471.043349:0:35980:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:35980:1875232144209920:192.168.203.60@tcp:104: 00000100:00080000:2.0:1788361471.043515:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361471.043679:0:35980:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8376ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361471.047774:0:35980:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:35980:1875232144209920:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361471.047810:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000259755f4/0xf6a94c97d6614db9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [204800->208895] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e8 expref: 8 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361471.047833:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622600, rc 0) 00000100:00100000:1.0:1788361471.047894:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:31529:x1875232130680576:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 4738us (5120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361471.047902:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:3.0:1788361471.048715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361471.048791:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130680704 00000100:00100000:2.0:1788361471.048799:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130680704 00002000:00100000:2.0:1788361471.048843:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff9a898705d180 x1875232130680704/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:532/0 lens 488/0 e 0 to 0 dl 1788361482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788361471.048854:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705d180 with x1875232130680704 ext(0->409599) 00010000:00010000:2.0:1788361471.048862:0:35988:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 7 pid: 35983 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361471.048876:0:35988:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 7 pid: 35983 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361471.048883:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a898705d180 00000100:00100000:2.0:1788361471.048909:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:2.0:1788361471.048918:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130680704:12345-192.168.203.60@tcp:4:mmap_sanity.0 00000100:00100000:3.0:1788361471.060021:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130680704:12345-192.168.203.60@tcp:4:mmap_sanity.0 Request processed in 11093us (11297us total) trans 30064771080 rc 0/0 00000100:00100000:3.0:1788361471.060036:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00002000:00100000:3.0:1788361471.060048:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->409599) req@ffff9a898705d180 x1875232130680704/t30064771080(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:532/0 lens 488/448 e 0 to 0 dl 1788361482 ref 1 fl Complete:H/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788361471.060056:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705d180 with x1875232130680704 ext(0->409599) 00010000:00010000:3.0:1788361471.060065:0:35988:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 9 pid: 35983 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361471.060080:0:35988:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 9 pid: 35983 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361471.060107:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a898705d180 00000100:00100000:0.0:1788361471.062531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361471.062648:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130680832 00000100:00100000:2.0:1788361471.062658:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130680832 00010000:00010000:2.0:1788361471.062698:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 9 pid: 35983 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361471.062744:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788361471.062753:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2349:x1875232130680832:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361471.062770:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788361471.062789:0:35333:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb mtime from disk: 1788361469 -> 1788361471 00002000:00010000:2.0:1788361471.062793:0:35333:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc2:0x0] updating lvb ctime from disk: 1788361469 -> 1788361471 00010000:00010000:2.0:1788361471.062800:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 9 pid: 35983 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361471.062827:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 9 pid: 35983 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361471.062854:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ed158db/0xf6a94c97d6614db2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e1 expref: 9 pid: 35983 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361471.062873:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1788361471.062877:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(2 0) 00010000:00010000:2.0:1788361471.062886:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000259755f4/0xf6a94c97d6614db9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e8 expref: 7 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361471.062897:0:35333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000259755f4/0xf6a94c97d6614db9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e8 expref: 7 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361471.062935:0:35333:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000259755f4/0xf6a94c97d6614db9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e8 expref: 7 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361471.062949:0:35333:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35333:1875232144210048:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361471.063022:0:35333:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84bbe000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361471.064597:0:35333:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35333:1875232144210048:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361471.064619:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361471.064698:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130680832:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1945us (2173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361471.064708:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361471.065193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361471.065316:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130680960 00000100:00100000:2.0:1788361471.065323:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130680960 00002000:00100000:2.0:1788361471.065359:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (176128->241663) req@ffff9a8a90b2f100 x1875232130680960/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/0 e 0 to 0 dl 1788361482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361471.065370:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a90b2f100 with x1875232130680960 ext(176128->241663) 00002000:00010000:2.0:1788361471.065374:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a90b2f100 00000100:00100000:2.0:1788361471.065393:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788361471.065399:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2350:x1875232130680960:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:2.0:1788361471.069321:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2350:x1875232130680960:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 3912us (4120us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1788361471.069334:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00002000:00100000:2.0:1788361471.069346:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (176128->241663) req@ffff9a8a90b2f100 x1875232130680960/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/440 e 0 to 0 dl 1788361482 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361471.069356:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a90b2f100 with x1875232130680960 ext(176128->241663) 00002000:00010000:2.0:1788361471.069363:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a90b2f100 00000100:00100000:0.0:1788361471.073684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361471.073746:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130681088 00000100:00100000:3.0:1788361471.073755:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130681088 00002000:00100000:3.0:1788361471.073802:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (241664->278527) req@ffff9a8a90b2e300 x1875232130681088/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/0 e 0 to 0 dl 1788361482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361471.073833:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a90b2e300 with x1875232130681088 ext(241664->278527) 00002000:00010000:3.0:1788361471.073839:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a90b2e300 00000100:00100000:3.0:1788361471.073873:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361471.073882:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2349:x1875232130681088:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:3.0:1788361471.077407:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2349:x1875232130681088:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 3516us (3723us total) trans 0 rc 36864/36864 00000100:00100000:3.0:1788361471.077421:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00002000:00100000:3.0:1788361471.077445:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (241664->278527) req@ffff9a8a90b2e300 x1875232130681088/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/440 e 0 to 0 dl 1788361482 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361471.077455:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a90b2e300 with x1875232130681088 ext(241664->278527) 00002000:00010000:3.0:1788361471.077462:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a90b2e300 00000100:00100000:3.0:1788361471.085186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361471.085347:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130681216 00000100:00100000:2.0:1788361471.085357:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130681216 00002000:00100000:2.0:1788361471.085404:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (278528->315391) req@ffff9a898705f100 x1875232130681216/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/0 e 0 to 0 dl 1788361482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361471.085415:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705f100 with x1875232130681216 ext(278528->315391) 00002000:00010000:2.0:1788361471.085421:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705f100 00000100:00100000:2.0:1788361471.085454:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1788361471.085466:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2350:x1875232130681216:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:2.0:1788361471.090560:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2350:x1875232130681216:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 5087us (5372us total) trans 0 rc 36864/36864 00000100:00100000:2.0:1788361471.090584:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00002000:00100000:2.0:1788361471.090598:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (278528->315391) req@ffff9a898705f100 x1875232130681216/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/440 e 0 to 0 dl 1788361482 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:2.0:1788361471.090611:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705f100 with x1875232130681216 ext(278528->315391) 00002000:00010000:2.0:1788361471.090619:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705f100 00000100:00100000:1.0:1788361471.098705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361471.099069:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130681344 00000100:00100000:3.0:1788361471.099079:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130681344 00002000:00100000:3.0:1788361471.099211:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (315392->352255) req@ffff9a8ab7140a80 x1875232130681344/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/0 e 0 to 0 dl 1788361482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361471.099222:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7140a80 with x1875232130681344 ext(315392->352255) 00002000:00010000:3.0:1788361471.099228:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab7140a80 00000100:00100000:3.0:1788361471.099295:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788361471.099305:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2351:x1875232130681344:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361471.104424:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2351:x1875232130681344:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 5111us (5719us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788361471.104507:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00002000:00100000:0.0:1788361471.104520:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (315392->352255) req@ffff9a8ab7140a80 x1875232130681344/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/440 e 0 to 0 dl 1788361482 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361471.104530:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7140a80 with x1875232130681344 ext(315392->352255) 00002000:00010000:0.0:1788361471.104537:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab7140a80 00000100:00100000:3.0:1788361471.115405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361471.115958:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130681472 00000100:00100000:0.0:1788361471.115968:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130681472 00002000:00100000:0.0:1788361471.116029:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (352256->389119) req@ffff9a898705ed80 x1875232130681472/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/0 e 0 to 0 dl 1788361482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361471.116046:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705ed80 with x1875232130681472 ext(352256->389119) 00002000:00010000:0.0:1788361471.116052:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705ed80 00000100:00100000:0.0:1788361471.116163:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361471.116180:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130681472:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361471.121498:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130681472:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 5309us (6090us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788361471.121518:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00002000:00100000:0.0:1788361471.121539:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (352256->389119) req@ffff9a898705ed80 x1875232130681472/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/440 e 0 to 0 dl 1788361482 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361471.121585:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705ed80 with x1875232130681472 ext(352256->389119) 00002000:00010000:0.0:1788361471.121593:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705ed80 00000100:00100000:1.0:1788361471.127783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361471.127963:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130681600 00000100:00100000:0.0:1788361471.127971:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130681600 00002000:00100000:0.0:1788361471.128010:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (389120->409599) req@ffff9a8ab7143100 x1875232130681600/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/0 e 0 to 0 dl 1788361482 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361471.128021:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7143100 with x1875232130681600 ext(389120->409599) 00002000:00010000:0.0:1788361471.128027:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab7143100 00000100:00100000:0.0:1788361471.128122:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:0.0:1788361471.128130:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130681600:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361471.129839:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130681600:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 1701us (2057us total) trans 0 rc 20480/20480 00000100:00100000:0.0:1788361471.129851:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00002000:00100000:0.0:1788361471.129861:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (389120->409599) req@ffff9a8ab7143100 x1875232130681600/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:532/0 lens 488/440 e 0 to 0 dl 1788361482 ref 1 fl Complete:/600/0 rc 20480/20480 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361471.129871:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7143100 with x1875232130681600 ext(389120->409599) 00002000:00010000:0.0:1788361471.129877:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab7143100 00000100:00100000:3.0:1788361471.134946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361471.135571:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130681856 00000100:00100000:2.0:1788361471.135589:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130681856 00000100:00100000:2.0:1788361471.135662:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:2.0:1788361471.135841:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:31529:x1875232130681856:12345-192.168.203.60@tcp:103:mmap_sanity.0 00010000:00010000:2.0:1788361471.135861:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361471.135891:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614cd2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f394 expref: 10 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361471.135911:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:2.0:1788361471.135917:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361471.135972:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+9:31529:x1875232130681856:12345-192.168.203.60@tcp:103:mmap_sanity.0 Request processed in 300us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361471.135980:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00080000:0.0:1788361471.136049:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361471.139197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361471.139311:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130681984 00000100:00100000:3.0:1788361471.139321:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130681984 00000100:00100000:3.0:1788361471.139378:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:3.0:1788361471.139388:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+9:31529:x1875232130681984:12345-192.168.203.60@tcp:58:mmap_sanity.0 00010000:00010000:3.0:1788361471.139497:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361471.139517:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f37f expref: 19 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361471.139526:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361471.139561:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f37f expref: 19 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361471.139586:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f37f expref: 19 pid: 35345 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361471.139601:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144210176:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361471.139694:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788361471.144810:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144210176:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361471.144842:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361471.147916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361471.151025:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130682112 00000100:00100000:2.0:1788361471.151043:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130682112 00010000:00010000:0.0:1788361471.151603:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f37f expref: 20 pid: 35345 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361471.151690:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361471.151700:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:2349:x1875232130682112:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361471.151731:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361471.151739:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f37f expref: 20 pid: 35345 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.151766:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f37f expref: 20 pid: 35345 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.151805:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6614c5b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f37f expref: 20 pid: 35345 timeout: 961 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.151830:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:0.0:1788361471.151836:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.151847:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.151854:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.151896:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361471.152381:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361471.152392:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361471.152745:0:35347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].3, 136 off8600 00000100:00100000:3.0:1788361471.152817:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+9:31529:x1875232130681984:12345-192.168.203.60@tcp:58:mmap_sanity.0 Request processed in 13427us (13626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361471.152830:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:0.0:1788361471.152831:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+19:2349:x1875232130682112:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1128us (4919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361471.152842:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788361471.156259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361471.156354:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130682240 00000100:00100000:0.0:1788361471.156363:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130682240 00000100:00100000:0.0:1788361471.156476:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:0.0:1788361471.156489:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+9:31529:x1875232130682240:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361471.156525:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361471.156546:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614dc7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3ef expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.156663:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.156729:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614dc7 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3ef expref: 10 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.156750:0:35345:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.156763:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614dc7 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3ef expref: 10 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.156778:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:0.0:1788361471.156781:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361471.156785:0:35345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614dc7 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3ef expref: 10 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361471.156793:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:0.0:1788361471.156888:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:31529:x1875232130682240:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 402us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361471.156896:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00010000:00010000:0.0:1788361471.392605:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361472.032432:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361472.032442:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361472.032496:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 4 count 4 00000040:00080000:0.0:1788361472.032502:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361472.032694:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144210304:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361472.032850:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f6a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361472.037258:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144210304:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361472.040354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.040498:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130682368 00000100:00100000:2.0:1788361472.040506:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130682368 00000100:00080000:0.0:1788361472.040565:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361472.040579:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788361472.040592:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+19:31531:x1875232130682368:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361472.040624:0:37122:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361472.040740:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+19:31531:x1875232130682368:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 152us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.040748:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1788361472.044187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.044245:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130682496 00000100:00100000:0.0:1788361472.044254:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130682496 00000100:00100000:0.0:1788361472.044358:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:0.0:1788361472.044368:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:31531:x1875232130682496:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788361472.044448:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614dce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044467:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614dce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044481:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614dce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044495:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614dd5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044502:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044507:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044542:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044566:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044574:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361472.044613:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00000004:00200000:0.0:1788361472.044618:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361472.044631:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044642:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614dce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044648:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614dce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044655:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614dce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044661:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361472.044665:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614dce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044672:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614dce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044684:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361472.044687:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361472.044692:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614dce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044707:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d6614dce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044720:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614dd5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044726:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614dd5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044731:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044746:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361472.044749:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614dd5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044756:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614dd5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044764:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb6096ffe (ffff9a8a90b43500) 00010000:00010000:0.0:1788361472.044766:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361472.044769:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614dd5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044775:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614dd5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb6096ffe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044790:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044796:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044807:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044812:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361472.044816:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044822:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044829:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:0.0:1788361472.044832:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361472.044835:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.044840:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6614ddc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.044910:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:31531:x1875232130682496:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 544us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361472.044918:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:1.0:1788361472.047640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.047852:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130682752 00000100:00100000:2.0:1788361472.047861:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130682752 00000100:00100000:2.0:1788361472.047942:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:2.0:1788361472.047974:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+19:31531:x1875232130682752:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361472.047994:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361472.048011:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614de3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3f6 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.048323:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614dea lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.048340:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614dea lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.048350:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614dea lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361472.048362:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00010000:00010000:2.0:1788361472.048463:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614dea lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.048470:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614dea lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.048477:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614dea lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.048483:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.048501:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614dea lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.050300:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614dea lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.050323:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:2.0:1788361472.050326:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361472.050331:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614dea lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.050338:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614dea lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.050398:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614de3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3f6 expref: 21 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.050411:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:2.0:1788361472.050414:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361472.050417:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614de3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3f6 expref: 21 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.050426:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9e00, rc 0) 00000100:00100000:2.0:1788361472.050489:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+20:31531:x1875232130682752:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2539us (2856us total) trans 30064771134 rc 301/301 00000100:00100000:2.0:1788361472.050496:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1788361472.053365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.053440:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130682880 00000100:00100000:2.0:1788361472.053450:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130682880 00000100:00100000:2.0:1788361472.053506:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:2.0:1788361472.053516:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:31531:x1875232130682880:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361472.053581:0:35346:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361472.053707:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:31531:x1875232130682880:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 191us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.053714:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:1.0:1788361472.056573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.056717:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130683136 00000100:00100000:3.0:1788361472.056726:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130683136 00000100:00100000:3.0:1788361472.056788:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:3.0:1788361472.056798:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:31531:x1875232130683136:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361472.056818:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361472.056839:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614df8 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f3fd expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361472.059076:0:35347:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc3:0x0], index 0: 0 00010000:00010000:3.0:1788361472.060516:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6614dff lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.060549:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6614dff lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.060563:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6614dff lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.060645:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614df8 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3fd expref: 23 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.060665:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6614dff lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3fd expref: 22 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.060693:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361472.060696:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361472.060700:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcba00, rc 0) 00000100:00100000:3.0:1788361472.060772:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+22:31531:x1875232130683136:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 3975us (4202us total) trans 30064771135 rc 0/0 00000100:00100000:3.0:1788361472.060780:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361472.064702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.064809:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130683392 00000100:00100000:2.0:1788361472.064819:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130683392 00000100:00100000:2.0:1788361472.064877:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:2.0:1788361472.064886:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+22:31531:x1875232130683392:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361472.064946:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361472.064977:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6614dff lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3fd expref: 22 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.064997:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:2.0:1788361472.065008:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361472.065032:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e0d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.065047:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e0d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.065057:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e0d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.065067:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e14 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x7ad310d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.065072:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e14 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7ad310d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066198:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e14 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7ad310d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066523:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e0d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066533:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e0d lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066540:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e0d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066548:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.066552:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e0d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066561:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e0d lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066574:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361472.066577:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.066581:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e0d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066588:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e0d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066599:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e14 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7ad310d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066605:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e14 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7ad310d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066618:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e14 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7ad310d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066624:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.066808:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e14 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7ad310d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066816:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e14 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x7ad310d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066825:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x7ad310d2 (ffff9a8a8beaea00) 00010000:00010000:2.0:1788361472.066827:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.066830:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e14 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x7ad310d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.066835:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e14 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x7ad310d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.066995:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:31531:x1875232130683392:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 2107us (2298us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361472.067005:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:1.0:1788361472.070821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.070897:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130683520 00000100:00100000:2.0:1788361472.070907:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130683520 00000100:00100000:2.0:1788361472.070975:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:2.0:1788361472.071004:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+21:31531:x1875232130683520:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361472.071027:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361472.071049:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e1b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f404 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.071133:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.071160:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.071174:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.071305:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e1b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f404 expref: 23 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.071325:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f404 expref: 22 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.071335:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:2.0:1788361472.071338:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361472.071342:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9200, rc 0) 00000100:00100000:2.0:1788361472.071404:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+22:31531:x1875232130683520:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 419us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.071411:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:1.0:1788361472.075373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.075475:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130683776 00000100:00100000:0.0:1788361472.075485:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130683776 00000100:00100000:0.0:1788361472.075541:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:0.0:1788361472.075556:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+22:31531:x1875232130683776:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361472.075703:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.075723:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.075748:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361472.076646:0:35345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].4, 88 off8496 00000004:00080000:0.0:1788361472.076656:0:35345:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 862091569586ns, next at 863091567048ns, rc = 0 00000004:00010000:0.0:1788361472.076750:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000737201ad reply state 00000000c9bb4d3e transno 30064771136 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.076760:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361472.076857:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+24:31531:x1875232130683776:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1302us (1491us total) trans 30064771136 rc 0/0 00000100:00100000:0.0:1788361472.076866:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:0.0:1788361472.079479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:1.0:1788361472.079537:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.079548:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.079615:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.079623:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361472.079627:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.079635:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.079652:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:1.0:1788361472.079655:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788361472.079661:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.079667:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6614e29 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.079805:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130683904 00000100:00100000:2.0:1788361472.079813:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130683904 00000100:00100000:2.0:1788361472.079864:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:2.0:1788361472.079873:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+23:31531:x1875232130683904:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361472.079896:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361472.079913:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e30 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f40b expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.079984:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e30 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f40b expref: 24 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.079998:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e30 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f40b expref: 24 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.080017:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:2.0:1788361472.080020:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361472.080023:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8200, rc 0) 00000100:00100000:2.0:1788361472.080076:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+24:31531:x1875232130683904:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 203us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.080114:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:1.0:1788361472.082638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.082851:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130684032 00000100:00100000:3.0:1788361472.082860:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130684032 00000100:00100000:3.0:1788361472.082972:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:3.0:1788361472.082982:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130684032:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788361472.083319:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130684032:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 338us (688us total) trans 30064771079 rc 0/0 00000100:00100000:3.0:1788361472.083328:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00080000:0.0:1788361472.084475:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361472.086572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.086681:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130684288 00000100:00100000:2.0:1788361472.086689:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130684288 00000100:00100000:2.0:1788361472.086745:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1788361472.086754:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+24:31531:x1875232130684288:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361472.086968:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+25:31531:x1875232130684288:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 212us (399us total) trans 30064771137 rc 0/0 00000100:00100000:2.0:1788361472.086976:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1788361472.088932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.089015:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130684544 00000100:00100000:1.0:1788361472.089022:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130684544 00000100:00100000:1.0:1788361472.089067:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:1.0:1788361472.089075:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:31531:x1875232130684544:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788361472.089296:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:31531:x1875232130684544:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 221us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361472.089304:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:1.0:1788361472.091609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.091839:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130684672 00000100:00100000:3.0:1788361472.091848:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130684672 00000100:00100000:3.0:1788361472.092000:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:3.0:1788361472.092010:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+25:31531:x1875232130684672:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361472.092030:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361472.092052:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614e37 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f412 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.092910:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614e3e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.092929:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614e3e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.092952:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614e3e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361472.092993:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361472.093011:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614e3e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.093040:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614e37 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f412 expref: 27 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.093058:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614e3e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f412 expref: 26 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.093067:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:3.0:1788361472.093070:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788361472.093074:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca800, rc 0) 00000100:00100000:3.0:1788361472.093171:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+26:31531:x1875232130684672:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1162us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361472.093179:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:2.0:1788361472.095960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.096180:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130684800 00000100:00100000:0.0:1788361472.096188:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130684800 00000100:00100000:0.0:1788361472.096231:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788361472.096238:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130684800:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361472.096254:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361472.096269:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6614e45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f419 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361472.096296:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983b00, blocks: 0x1 00010000:00010000:0.0:1788361472.096322:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=862s v=(0 0) 00010000:00010000:0.0:1788361472.096327:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361472.096337:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6614e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f419 expref: 8 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.096376:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6614e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f419 expref: 8 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.096389:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:0.0:1788361472.096444:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130684800:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 205us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361472.096450:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788361472.101551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.102579:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130685056 00000100:00100000:3.0:1788361472.102592:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130685056 00000100:00100000:3.0:1788361472.102703:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:3.0:1788361472.102713:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:31531:x1875232130685056:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788361472.102828:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:31531:x1875232130685056:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 116us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361472.102836:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:1.0:1788361472.107142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.107370:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130685184 00000100:00100000:3.0:1788361472.107393:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130685184 00000100:00100000:3.0:1788361472.107482:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:3.0:1788361472.107493:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+8:31531:x1875232130685184:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361472.107513:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361472.107543:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f420 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.107585:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6614e45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f419 expref: 9 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.107594:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361472.107599:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361472.107604:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 9 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.107639:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6614e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f419 expref: 9 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.107653:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6614e45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f419 expref: 9 pid: 35982 timeout: 962 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361472.107666:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144210432:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361472.107752:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361472.110245:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.110396:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144210432:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361472.110438:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->409599] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 9 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.110479:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb200, rc 0) 00000100:00100000:3.0:1788361472.110538:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:31531:x1875232130685184:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 3048us (3405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361472.110547:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1788361472.111263:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130685312 00000100:00100000:2.0:1788361472.111271:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130685312 00010000:00010000:2.0:1788361472.111303:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6614e45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f419 expref: 9 pid: 35982 timeout: 962 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.112217:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788361472.112296:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8419d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130685312:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361472.112311:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361472.112338:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6614e45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f419 expref: 9 pid: 35982 timeout: 962 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.112352:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6614e45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f419 expref: 9 pid: 35982 timeout: 962 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.112379:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009366bf70/0xf6a94c97d6614e45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f419 expref: 9 pid: 35982 timeout: 962 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.112395:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361472.112399:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361472.112409:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 8 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.113044:0:36007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 8 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.113119:0:36007:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 8 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.113139:0:36007:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:36007:1875232144210560:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361472.113524:0:36007:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361472.119160:0:36007:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:36007:1875232144210560:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361472.119190:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361472.119240:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8419d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130685312:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 6950us (9000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.119250:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1788361472.119523:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.119923:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130685440 00000100:00100000:0.0:1788361472.119930:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130685440 00002000:00100000:0.0:1788361472.119977:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff9a8abc897100 x1875232130685440/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:533/0 lens 488/0 e 0 to 0 dl 1788361483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788361472.119988:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc897100 with x1875232130685440 ext(0->409599) 00002000:00010000:0.0:1788361472.119993:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abc897100 00000100:00100000:0.0:1788361472.120021:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:0.0:1788361472.120029:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130685440:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361472.127080:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130685440:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7040us (7546us total) trans 30064771080 rc 0/0 00000100:00100000:3.0:1788361472.127112:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00002000:00100000:3.0:1788361472.127124:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff9a8abc897100 x1875232130685440/t30064771080(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:533/0 lens 488/448 e 0 to 0 dl 1788361483 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788361472.127135:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc897100 with x1875232130685440 ext(0->409599) 00002000:00010000:3.0:1788361472.127143:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abc897100 00000100:00100000:0.0:1788361472.129489:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.129667:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130685568 00000100:00100000:2.0:1788361472.129676:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130685568 00000100:00100000:2.0:1788361472.129733:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:2.0:1788361472.129742:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+26:31531:x1875232130685568:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788361472.136556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.136591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.136614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.136631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.136655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.136678:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130685824 00000100:00100000:0.0:1788361472.136678:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130686208 00000100:00100000:0.0:1788361472.136688:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130686208 00000100:00100000:1.0:1788361472.136689:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130685824 00000100:00100000:0.0:1788361472.136745:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130686080 00000100:00100000:0.0:1788361472.136750:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130686080 00000100:00100000:3.0:1788361472.136773:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130685696 00000100:00100000:3.0:1788361472.136777:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130685696 00000100:00100000:0.0:1788361472.136779:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361472.136788:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2350:x1875232130686208:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361472.136806:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:3.0:1788361472.136813:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130685696:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361472.136857:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2350:x1875232130686208:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 69us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361472.136871:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1788361472.136895:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361472.136903:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130685824:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361472.136930:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1788361472.136943:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130686080:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361472.136996:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130685696:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 182us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361472.137004:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00080000:2.0:1788361472.137364:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361472.137368:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361472.137393:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130685952 00000100:00100000:2.0:1788361472.137398:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130685952 00000100:00100000:0.0:1788361472.137450:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130685824:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 547us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361472.137459:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1788361472.137490:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1788361472.137499:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:2350:x1875232130685952:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361472.137534:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:2350:x1875232130685952:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 37us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.137541:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361472.137680:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130686080:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 741us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361472.137687:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000001:00080000:3.0:1788361472.155979:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771136 is committed 00000004:00080000:3.0:1788361472.155991:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:3.0:1788361472.156019:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771137 is committed 00000004:00080000:3.0:1788361472.156027:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788361472.156040:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a812edf00 refcount 2 committed 0 result 0 batchid 25769803892 00000100:00100000:1.0:1788361472.156267:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+18:31531:x1875232130685568:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 26520us (26778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361472.156271:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144210688:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788361472.156280:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:0.0:1788361472.156329:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788361472.156475:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a89869aec00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a812ed240 00000020:00080000:3.0:1788361472.156492:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a89256600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ac1bec000 00000020:00080000:3.0:1788361472.156515:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803891 batchid updated 00000100:00100000:2.0:1788361472.156666:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144210688 00000100:00100000:2.0:1788361472.156677:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144210688 00000100:00100000:2.0:1788361472.156724:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788361472.156733:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144210688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788361472.156760:0:36286:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:194 count 1 00010000:00010000:2.0:1788361472.156786:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361472.156806:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361472.156817:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144210816:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788361472.156820:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000000c2a34b/0xf6a94c97d6614bdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f363 expref: 5 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.156829:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc2:0x0].0x0 since=5s v=(0 0) 00010000:00010000:2.0:1788361472.156833:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361472.156838:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361472.156845:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361472.156866:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000000c2a34b/0xf6a94c97d6614bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f363 expref: 5 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.156881:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000000c2a34b/0xf6a94c97d6614bdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f363 expref: 5 pid: 35980 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.156893:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144210944:192.168.203.60@tcp:104: 00000020:00080000:1.0:1788361472.156931:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803892 committed batchid 25769803891 00000100:00100000:2.0:1788361472.156948:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361472.156970:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144210816 00000100:00100000:2.0:1788361472.156974:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144210816 00000100:00100000:2.0:1788361472.157006:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788361472.157014:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144210816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788361472.157183:0:35982:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb size from disk: 0 -> 409600 00002000:00010000:2.0:1788361472.157187:0:35982:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 0 -> 1788361472 00002000:00010000:2.0:1788361472.157189:0:35982:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361472.157191:0:35982:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1788361472 -> 1788361472 00002000:00010000:2.0:1788361472.157194:0:35982:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361472.157244:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3312:x1875232144210816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 232us (397us total) trans 30064771081 rc 0/0 00000100:00100000:2.0:1788361472.157252:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788361472.157311:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1788361472.157329:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803891 00000004:00080000:3.0:1788361472.157345:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a843eaa00/2, rc 0, transno 30064771081 00000100:00100000:3.0:1788361472.157356:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144210816:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361472.158065:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.158200:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130686336 00000100:00100000:1.0:1788361472.158206:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130686336 00000100:00100000:1.0:1788361472.158253:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788361472.158261:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130686336:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788361472.160318:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144210944:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361472.160345:0:36286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361472.165376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.165500:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130686464 00000100:00100000:2.0:1788361472.165510:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130686464 00010000:00010000:2.0:1788361472.165549:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000000c2a34b/0xf6a94c97d6614bdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f363 expref: 6 pid: 35980 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.165594:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1788361472.165604:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130686464:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361472.165617:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361472.165623:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000000c2a34b/0xf6a94c97d6614bdd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f363 expref: 6 pid: 35980 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.165637:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000000c2a34b/0xf6a94c97d6614bdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f363 expref: 6 pid: 35980 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.165661:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000c2a34b/0xf6a94c97d6614bdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f363 expref: 6 pid: 35980 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.165678:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361472.165682:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361472.165699:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.165709:0:35333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.165744:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361472.165791:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130686464:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 189us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.165799:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00010000:00010000:3.0:1788361472.165949:0:36286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.165959:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.165972:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.165981:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.166007:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361472.166382:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361472.166389:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.166399:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361472.166404:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.166414:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.166430:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.166437:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf58ba8c/0xf6a94c97d6614e53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.166472:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361472.166474:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361472.166475:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361472.167482:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3314:x1875232144210688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10746us (11148us total) trans 30064771082 rc 0/0 00000100:00100000:3.0:1788361472.167493:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000004:00080000:0.0:1788361472.167566:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a843ead80/2, rc 0, transno 30064771082 00000100:00100000:0.0:1788361472.167573:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144210688:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1788361472.190895:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771081 is committed 00000001:00080000:1.0:1788361472.190917:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771077 is committed 00000001:00080000:1.0:1788361472.190926:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771080 is committed 00000100:00100000:3.0:1788361472.190929:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130686336:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 32661us (32858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361472.190954:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1788361472.192937:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.194213:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130686720 00000100:00100000:1.0:1788361472.194224:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130686720 00000100:00100000:1.0:1788361472.194284:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:1.0:1788361472.194293:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:31531:x1875232130686720:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361472.194350:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361472.194378:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614e3e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f412 expref: 14 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.194397:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:1.0:1788361472.194403:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361472.194433:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.194448:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.194459:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361472.194618:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c24b02c7 reply state 00000000de0f1bf2 transno 30064771138 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361472.194627:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361472.194714:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:31531:x1875232130686720:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 421us (1782us total) trans 30064771138 rc 0/0 00000100:00100000:1.0:1788361472.194732:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:0.0:1788361472.197395:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1788361472.197478:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.197491:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.197497:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.197503:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361472.197508:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.197516:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.197534:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:3.0:1788361472.197537:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361472.197543:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.197549:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6614e5a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361472.197647:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130686848 00000100:00100000:1.0:1788361472.197655:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130686848 00000100:00100000:1.0:1788361472.197699:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:1.0:1788361472.197707:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130686848:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788361472.197910:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb size from disk: 409600 -> 409600 00002000:00010000:1.0:1788361472.197914:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 1788361472 -> 1788361469 00002000:00010000:1.0:1788361472.197916:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb atime from disk: 0 -> 1788361469 00002000:00010000:1.0:1788361472.197919:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1788361472 -> 1788361469 00002000:00010000:1.0:1788361472.197921:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 1027 00000100:00100000:1.0:1788361472.197975:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130686848:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 268us (586us total) trans 30064771083 rc 0/0 00000100:00100000:1.0:1788361472.197983:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:3.0:1788361472.199278:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.199378:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130687104 00000100:00100000:2.0:1788361472.199385:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130687104 00000100:00100000:2.0:1788361472.199427:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:2.0:1788361472.199435:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:31531:x1875232130687104:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788361472.199496:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.199513:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f404 expref: 14 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.199522:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.199554:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f404 expref: 14 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.199634:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f404 expref: 14 pid: 37122 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.199649:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144211072:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361472.199762:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361472.202689:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.203229:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144211072:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361472.203256:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.203317:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130687232 00000100:00100000:0.0:1788361472.203327:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130687232 00010000:00010000:0.0:1788361472.203365:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f404 expref: 15 pid: 37122 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.203408:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:0.0:1788361472.203418:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130687232:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361472.203440:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361472.203449:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f404 expref: 15 pid: 37122 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.203535:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f404 expref: 15 pid: 37122 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.203569:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6614e22 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f404 expref: 15 pid: 37122 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.203585:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:0.0:1788361472.203590:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.203600:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.203607:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.204281:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361472.204336:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130687232:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 917us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361472.204346:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00010000:00010000:2.0:1788361472.205033:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.205043:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.205073:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.205080:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.205105:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.205111:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.205116:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.205123:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.205137:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:2.0:1788361472.205140:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788361472.205144:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.205159:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e61 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.205219:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:31531:x1875232130687104:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 5784us (5943us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788361472.205237:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:3.0:1788361472.207591:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.208456:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130687360 00000100:00100000:2.0:1788361472.208467:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130687360 00000100:00100000:2.0:1788361472.208527:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:2.0:1788361472.208537:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130687360:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788361472.208585:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.208609:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 7 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.208618:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361472.208622:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361472.208627:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.208665:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 7 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.208680:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 7 pid: 36286 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.208696:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144211200:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361472.208777:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361472.212458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.212471:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144211200:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361472.212514:0:36286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361472.214380:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130687488 00000100:00100000:1.0:1788361472.214395:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130687488 00010000:00010000:1.0:1788361472.214442:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 8 pid: 36286 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361472.214472:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:1.0:1788361472.214480:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130687488:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361472.214496:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361472.214526:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 8 pid: 36286 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.214539:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 8 pid: 36286 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.214587:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6614e4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f420 expref: 8 pid: 36286 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.214604:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361472.214608:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361472.214615:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.214625:0:35333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.214656:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361472.214712:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130687488:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 233us (2263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361472.214721:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00010000:00010000:2.0:1788361472.214727:0:36286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.214740:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.214765:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.214773:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.214780:0:36286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.214793:0:36286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361472.214797:0:36286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.214806:0:36286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.214817:0:36286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.214833:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d6614e68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.214882:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130687360:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 6346us (7299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.214890:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788361472.218868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.218946:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130687744 00000100:00100000:2.0:1788361472.218964:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130687744 00000100:00100000:2.0:1788361472.219014:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:2.0:1788361472.219024:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:31531:x1875232130687744:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788361472.219178:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e6f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.219202:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e6f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.219214:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e6f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.219524:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.219651:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e30 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f40b expref: 14 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.219661:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.219704:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e30 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f40b expref: 14 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.219718:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e30 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f40b expref: 14 pid: 37122 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.219733:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144211328:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361472.219906:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361472.222475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.222835:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130687872 00000100:00100000:0.0:1788361472.222844:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130687872 00010000:00010000:0.0:1788361472.222878:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e30 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f40b expref: 15 pid: 37122 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.222918:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:0.0:1788361472.222927:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130687872:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361472.222941:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361472.222955:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e30 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f40b expref: 15 pid: 37122 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.222968:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e30 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f40b expref: 15 pid: 37122 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.222991:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:0.0:1788361472.222996:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.223007:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.223015:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.223031:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361472.223079:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130687872:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 153us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361472.223112:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00010000:00010000:2.0:1788361472.223229:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614e30 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f40b expref: 14 pid: 37122 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.223249:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144211328:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361472.223271:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.223281:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.223287:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361472.223447:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771139 00000001:00080000:2.0:1788361472.223576:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771140 00000001:00080000:2.0:1788361472.223615:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771141 00000100:00100000:2.0:1788361472.223682:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144211456:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788361472.223736:0:35346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361472.223753:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361472.224029:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144211456 00000100:00100000:0.0:1788361472.224034:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144211456 00000100:00100000:0.0:1788361472.224069:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788361472.224075:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35346:x1875232144211456:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788361472.224178:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35346:x1875232144211456:12345-0@lo:1000:mdt00_001.0 Request processed in 103us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361472.224186:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788361472.224333:0:35346:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771081 gen 2 00000004:00080000:2.0:1788361472.224338:0:35346:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771078 committed transno 30064771081 00000004:00080000:2.0:1788361472.224378:0:35346:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a843eaa00, transno 30064771081 00000100:00100000:2.0:1788361472.224399:0:35346:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8a843ead80 x1875232144210688/t30064771082(30064771082) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788361488 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788361472.224409:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144211456:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788361472.224913:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771142 00000100:00100000:2.0:1788361472.224962:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144211584:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788361472.224991:0:35346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361472.225006:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361472.225059:0:37379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144211584 00000100:00100000:0.0:1788361472.225063:0:37379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144211584 00000100:00100000:0.0:1788361472.225124:0:37379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788361472.225139:0:37379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:35346:x1875232144211584:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788361472.225300:0:37379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:35346:x1875232144211584:12345-0@lo:1000:mdt00_001.0 Request processed in 163us (307us total) trans 30064771084 rc 0/0 00000100:00100000:0.0:1788361472.225307:0:37379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788361472.225363:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144211584:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788361472.225396:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225406:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225414:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225421:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361472.225426:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225435:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225452:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:3.0:1788361472.225456:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361472.225461:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225467:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6614e76 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xa:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225501:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225508:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225514:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225526:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361472.225530:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225537:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225546:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:3.0:1788361472.225548:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361472.225554:0:35346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614dc7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3ef expref: 9 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225565:0:35346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614dc7 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3ef expref: 9 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225575:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614dc7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3ef expref: 9 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.225600:0:35346:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614dc7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3ef expref: 9 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361472.225610:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144211712:192.168.203.60@tcp:105: 00000100:00100000:3.0:1788361472.225777:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361472.228002:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144211712:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361472.228032:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228042:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614dc0 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228529:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e7d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228546:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e7d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228558:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e7d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228569:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e7d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228575:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e7d lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228592:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e7d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228598:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.228603:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e7d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228610:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e7d lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228621:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:2.0:1788361472.228624:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.228627:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e7d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228633:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6614e7d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228644:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e6f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228655:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e6f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228661:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e6f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228666:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.228669:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e6f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228683:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e6f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228691:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:2.0:1788361472.228693:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361472.228696:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e6f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.228711:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6614e6f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.228989:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+17:31531:x1875232130687744:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 9963us (10127us total) trans 30064771143 rc 0/0 00000100:00100000:2.0:1788361472.228999:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00000020:00080000:2.0:1788361472.229004:0:35346:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788361472.229071:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361472.229077:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361472.229155:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 4 count 4 00000040:00080000:0.0:1788361472.229166:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361472.229451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.229563:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130688000 00000100:00100000:2.0:1788361472.229570:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130688000 00000100:00100000:2.0:1788361472.229639:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361472.229648:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:31529:x1875232130688000:12345-192.168.203.60@tcp:49:mmap_sanity.0 00000100:00100000:2.0:1788361472.229828:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:31529:x1875232130688000:12345-192.168.203.60@tcp:49:mmap_sanity.0 Request processed in 180us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.229835:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361472.231500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.231534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.231594:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130688256 00000100:00100000:1.0:1788361472.231601:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130688256 00000100:00100000:1.0:1788361472.231644:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1788361472.231652:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:31531:x1875232130688256:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361472.232304:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130688384 00000100:00100000:2.0:1788361472.232309:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130688384 00000100:00100000:2.0:1788361472.232342:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1788361472.232349:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:31529:x1875232130688384:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361472.232360:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361472.232385:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6614e84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f427 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361472.232410:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 409600, mtime: 0x6a983afd, atime: 0x6a983afd, ctime: 0x6a983afd, blocks: 0x403 00010000:00010000:2.0:1788361472.232428:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=862s v=(0 0) 00010000:00010000:2.0:1788361472.232432:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361472.232443:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6614e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f427 expref: 6 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.232460:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6614e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f427 expref: 6 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.232473:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8400, rc 0) 00000100:00100000:2.0:1788361472.232525:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31529:x1875232130688384:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 177us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.232532:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000004:00080000:1.0:1788361472.232738:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0xa:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788361472.232833:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771144 00010000:00010000:1.0:1788361472.232870:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.232884:0:35348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.232902:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.232911:0:35348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.232917:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.232923:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.233047:0:35348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788361472.233128:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:31531:x1875232130688256:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1476us (1634us total) trans 30064771145 rc 0/0 00000100:00100000:1.0:1788361472.233135:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000020:00080000:1.0:1788361472.233138:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788361472.233301:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361472.233309:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.233316:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361472.233320:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.233328:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.233340:0:36289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xa:0x0].0x0 (ffff9a8984a32d00) 00010000:00010000:0.0:1788361472.233343:0:36289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361472.233348:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.233354:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6614e8b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.233373:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361472.233375:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361472.233377:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361472.235733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.235981:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130688512 00000100:00100000:0.0:1788361472.235990:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130688512 00002000:00100000:0.0:1788361472.236034:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->65535) req@ffff9a8ab6ab9c00 x1875232130688512/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/0 e 0 to 0 dl 1788361483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361472.236046:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6ab9c00 with x1875232130688512 ext(0->65535) 00002000:00010000:0.0:1788361472.236052:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6ab9c00 00000100:00100000:0.0:1788361472.236113:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361472.236124:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130688512:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:1.0:1788361472.245635:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130688512:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 9346us (9743us total) trans 0 rc 65536/65536 00000100:00100000:1.0:1788361472.245650:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00002000:00100000:1.0:1788361472.245664:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (0->65535) req@ffff9a8ab6ab9c00 x1875232130688512/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/440 e 0 to 0 dl 1788361483 ref 1 fl Complete:/600/0 rc 65536/65536 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361472.245675:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6ab9c00 with x1875232130688512 ext(0->65535) 00002000:00010000:1.0:1788361472.245682:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6ab9c00 00000100:00100000:3.0:1788361472.250573:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.251021:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130688640 00000100:00100000:0.0:1788361472.251030:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130688640 00002000:00100000:0.0:1788361472.251080:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (65536->102399) req@ffff9a8ab6abb480 x1875232130688640/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/0 e 0 to 0 dl 1788361483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361472.251120:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6abb480 with x1875232130688640 ext(65536->102399) 00002000:00010000:0.0:1788361472.251126:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6abb480 00000100:00100000:0.0:1788361472.251164:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788361472.251175:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2351:x1875232130688640:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361472.256290:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2351:x1875232130688640:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 5107us (5716us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788361472.256305:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00002000:00100000:0.0:1788361472.256319:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (65536->102399) req@ffff9a8ab6abb480 x1875232130688640/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/440 e 0 to 0 dl 1788361483 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361472.256330:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6abb480 with x1875232130688640 ext(65536->102399) 00002000:00010000:0.0:1788361472.256338:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6abb480 00000100:00100000:2.0:1788361472.262585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.262780:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130688768 00000100:00100000:1.0:1788361472.262791:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130688768 00002000:00100000:1.0:1788361472.262840:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (102400->139263) req@ffff9a8a843eb800 x1875232130688768/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/0 e 0 to 0 dl 1788361483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361472.262870:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a843eb800 with x1875232130688768 ext(102400->139263) 00002000:00010000:1.0:1788361472.262876:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a843eb800 00000100:00100000:1.0:1788361472.262955:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1788361472.262966:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130688768:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:1.0:1788361472.268539:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130688768:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 5565us (5954us total) trans 0 rc 36864/36864 00000100:00100000:1.0:1788361472.268553:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00002000:00100000:1.0:1788361472.268566:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc2:0x0] (102400->139263) req@ffff9a8a843eb800 x1875232130688768/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/440 e 0 to 0 dl 1788361483 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361472.268577:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a843eb800 with x1875232130688768 ext(102400->139263) 00002000:00010000:1.0:1788361472.268584:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a843eb800 00000100:00100000:2.0:1788361472.276958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.277136:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130688896 00000100:00100000:0.0:1788361472.277164:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130688896 00002000:00100000:0.0:1788361472.277216:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (139264->176127) req@ffff9a8a843eaa00 x1875232130688896/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/0 e 0 to 0 dl 1788361483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361472.277226:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a843eaa00 with x1875232130688896 ext(139264->176127) 00002000:00010000:0.0:1788361472.277233:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a843eaa00 00000100:00100000:0.0:1788361472.277265:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:0.0:1788361472.277274:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130688896:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361472.279460:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130688896:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 2178us (2502us total) trans 0 rc 36864/36864 00000100:00100000:0.0:1788361472.279471:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00002000:00100000:0.0:1788361472.279481:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (139264->176127) req@ffff9a8a843eaa00 x1875232130688896/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/440 e 0 to 0 dl 1788361483 ref 1 fl Complete:/600/0 rc 36864/36864 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361472.279490:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a843eaa00 with x1875232130688896 ext(139264->176127) 00002000:00010000:0.0:1788361472.279496:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a843eaa00 00000100:00100000:3.0:1788361472.294175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.294339:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130689152 00000100:00100000:0.0:1788361472.294350:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130689152 00000100:00100000:0.0:1788361472.294413:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:0.0:1788361472.294423:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:31529:x1875232130689152:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000001:00080000:0.0:1788361472.294759:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771146 00000100:00100000:0.0:1788361472.294876:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+12:31529:x1875232130689152:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 453us (710us total) trans 30064771147 rc 0/0 00000100:00100000:0.0:1788361472.294883:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000020:00080000:0.0:1788361472.294888:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788361472.297803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.298547:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130689408 00000100:00100000:0.0:1788361472.298558:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130689408 00000100:00100000:0.0:1788361472.298621:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361472.298630:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+12:31529:x1875232130689408:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000001:00080000:0.0:1788361472.300566:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771148 00000001:00080000:0.0:1788361472.300643:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771149 00000100:00100000:0.0:1788361472.301414:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+15:31529:x1875232130689408:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 2779us (3615us total) trans 30064771150 rc 0/0 00000100:00100000:0.0:1788361472.301426:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000020:00080000:0.0:1788361472.301432:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788361472.416453:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361472.657520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.657793:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130689664 00000100:00100000:1.0:1788361472.657803:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130689664 00000100:00100000:1.0:1788361472.658476:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1788361472.658490:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:31523:x1875232130689664:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788361472.658861:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130689664:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 374us (1456us total) trans 30064771151 rc 0/0 00000100:00100000:1.0:1788361472.658870:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361472.664012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.665612:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130689920 00000100:00100000:0.0:1788361472.665626:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130689920 00000100:00100000:0.0:1788361472.665759:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788361472.665770:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130689920:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:0.0:1788361472.666240:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:31523:x1875232130689920:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 470us (2236us total) trans 30064771152 rc 0/0 00000100:00100000:0.0:1788361472.666249:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1788361472.668981:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.669209:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130690048 00000100:00100000:1.0:1788361472.669218:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130690048 00000100:00100000:1.0:1788361472.669278:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:1.0:1788361472.669286:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+21:31523:x1875232130690048:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361472.669324:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361472.669347:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6614e92 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f42e expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.669423:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614e99 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.669440:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614e99 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.669452:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614e99 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.669467:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ea0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.669663:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ea0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.669673:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ea0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670167:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ea7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670178:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ea7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670185:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ea7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361472.670214:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x8:0x0]: returning size 409600 00000004:00200000:1.0:1788361472.670223:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361472.670243:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ea7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670254:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ea7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670262:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614e99 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670268:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614e99 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670274:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614e99 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670280:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361472.670283:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614e99 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670291:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614e99 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670303:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361472.670306:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361472.670310:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614e99 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670316:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614e99 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670327:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ea0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670343:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ea0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670349:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ea0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670354:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361472.670362:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ea0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670368:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ea0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670377:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff9a8984a32100) 00010000:00010000:1.0:1788361472.670380:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361472.670383:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ea0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670388:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ea0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670427:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6614e92 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f42e expref: 23 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670440:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ea7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f42e expref: 22 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.670448:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:1.0:1788361472.670450:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361472.670458:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622200, rc 0) 00000100:00100000:1.0:1788361472.670536:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130690048:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 1250us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361472.670544:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:2.0:1788361472.674868:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.674981:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130690304 00000100:00100000:1.0:1788361472.674990:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130690304 00000100:00100000:1.0:1788361472.675081:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:1.0:1788361472.675125:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130690304:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1788361472.675197:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788361472.675234:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614ea7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f42e expref: 22 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.675257:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6614dab lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3da expref: 21 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.675386:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:1.0:1788361472.675393:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361472.675489:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614eae lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.675505:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614eae lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.675516:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614eae lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.675532:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.675540:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.675560:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.676123:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614ebc lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.676133:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614ebc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.676141:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614ebc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361472.677518:0:35347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].3, 64 off8408 00000004:00080000:1.0:1788361472.677530:0:35347:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 862692443733ns, next at 863692440539ns, rc = 0 00010000:00010000:1.0:1788361472.677603:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677617:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677629:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677638:0:35347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677645:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677832:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677920:0:35347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361472.677944:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614ebc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677950:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614ebc lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677956:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614ebc lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677963:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361472.677967:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614ebc lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677975:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614ebc lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.677987:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:1.0:1788361472.677990:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788361472.677994:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614ebc lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.678000:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614ebc lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x8:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.678019:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614eae lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.678025:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614eae lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.678040:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614eae lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.678045:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361472.678048:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614eae lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.678055:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614eae lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.678062:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361472.678064:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361472.678067:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614eae lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.678073:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614eae lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361472.678104:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044fbc71d reply state 00000000014b6804 transno 30064771153 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361472.678114:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361472.678218:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130690304:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 3093us (3355us total) trans 30064771153 rc 0/0 00000100:00100000:1.0:1788361472.678228:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00010000:00010000:2.0:1788361472.680288:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361472.680302:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.680312:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361472.680316:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.680336:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.680353:0:35335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361472.680356:0:35335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361472.680360:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.680366:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6614ec3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.680380:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361472.680382:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361472.680384:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361472.681911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.682112:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130690432 00000100:00100000:2.0:1788361472.682122:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130690432 00000100:00100000:2.0:1788361472.682195:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:2.0:1788361472.682206:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130690432:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361472.682232:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361472.682254:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614eca lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f435 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682334:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ed1 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682350:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ed1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682361:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ed1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682389:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614ed8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682397:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614ed8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682404:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614ed8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.682454:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.682462:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.682483:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.682490:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361472.682493:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.682499:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.682510:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x397ecf4c (ffff9a8984a32f00) 00010000:00010000:1.0:1788361472.682512:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361472.682515:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682520:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614edf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.682520:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614eb5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x397ecf4c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682541:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614edf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682549:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614edf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361472.682582:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x7:0x0]: returning size 409600 00000004:00200000:2.0:1788361472.682587:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361472.682606:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614edf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682618:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614edf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682626:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ed1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682632:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ed1 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682649:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ed1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682666:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.682670:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ed1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682678:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ed1 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682687:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361472.682690:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.682692:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ed1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682698:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614ed1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682711:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614ed8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682718:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614ed8 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682724:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614ed8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682730:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.682732:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614ed8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682750:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614ed8 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682758:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff9a8a8beae600) 00010000:00010000:2.0:1788361472.682760:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.682763:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614ed8 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682768:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614ed8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682801:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614eca lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f435 expref: 23 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682821:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614edf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f435 expref: 22 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.682830:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:2.0:1788361472.682832:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361472.682835:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361472.682888:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130690432:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 684us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.682897:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:0.0:1788361472.686764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.686894:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130690688 00000100:00100000:2.0:1788361472.686905:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130690688 00000100:00100000:2.0:1788361472.686967:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:2.0:1788361472.686977:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130690688:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:2.0:1788361472.687054:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361472.687331:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614edf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f435 expref: 22 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.687352:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:2.0:1788361472.687357:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361472.687385:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ee6 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.687399:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ee6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.687420:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ee6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.687437:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.687444:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.687451:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.687560:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614ef4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.687569:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614ef4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.687576:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614ef4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361472.688848:0:35346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].5, 64 off8560 00010000:00010000:2.0:1788361472.688918:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.688932:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.688942:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.688951:0:35346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.688956:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.688962:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689026:0:35346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361472.689054:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614ef4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689061:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614ef4 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689068:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614ef4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689074:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.689079:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614ef4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689122:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614ef4 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689134:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:2.0:1788361472.689136:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361472.689141:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614ef4 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689156:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614ef4 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689178:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ee6 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689183:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ee6 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689189:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ee6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689194:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.689198:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ee6 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689203:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ee6 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689211:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361472.689213:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.689216:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ee6 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.689231:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614ee6 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361472.689242:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000020a69a29 reply state 00000000127e3e89 transno 30064771154 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.689251:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361472.689349:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+23:31523:x1875232130690688:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 2371us (2592us total) trans 30064771154 rc 0/0 00000100:00100000:2.0:1788361472.689358:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00010000:00010000:0.0:1788361472.690766:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361472.690832:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.690841:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361472.690845:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.690853:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.690883:0:36289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:0.0:1788361472.690886:0:36289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361472.690890:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.690896:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6614efb lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.690912:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361472.690914:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361472.690916:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361472.691558:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.691568:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.691574:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.691581:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361472.691584:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.691591:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.691601:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x3edd8f70 (ffff9a8a8beaeb00) 00010000:00010000:0.0:1788361472.691603:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361472.691606:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.691621:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6614eed lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x3edd8f70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.695376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.695437:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130690816 00000100:00100000:2.0:1788361472.695445:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130690816 00000100:00100000:2.0:1788361472.695491:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:2.0:1788361472.695501:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130690816:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361472.695525:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361472.695551:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614f02 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f43c expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695627:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f09 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695644:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f09 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695673:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f09 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695690:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f10 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695710:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695717:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695784:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f09 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695792:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f09 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695799:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f09 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695805:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.695809:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f09 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695816:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f09 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695828:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361472.695831:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.695835:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f09 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695840:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f09 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695852:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f10 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695863:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f10 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695869:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f10 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695874:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.695877:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f10 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695883:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f10 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695888:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff9a8a8beae600) 00010000:00010000:2.0:1788361472.695890:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.695892:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f10 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695896:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f10 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695925:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614f02 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f43c expref: 23 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695932:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361472.695934:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.695936:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6614f02 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f43c expref: 23 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.695949:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361472.695999:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130690816:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 499us (632us total) trans 0 rc 301/301 00000100:00100000:2.0:1788361472.696005:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:2.0:1788361472.698488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.698613:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130691072 00000100:00100000:1.0:1788361472.698622:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130691072 00000100:00100000:1.0:1788361472.698679:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788361472.698688:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130691072:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361472.698711:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361472.698731:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614f17 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f443 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.698854:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614f1e lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.698883:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614f1e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.698893:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614f1e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.698907:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.698914:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.698920:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.699877:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614f2c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.699887:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614f2c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.699893:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614f2c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361472.699901:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788361472.699927:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614f1e lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.699931:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614f1e lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.699936:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614f1e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.699945:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361472.699949:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614f1e lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.699954:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614f1e lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.699963:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361472.699965:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361472.699968:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614f1e lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.699972:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6614f1e lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361472.699980:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6441296 reply state 00000000c1d2090d transno 30064771155 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361472.699985:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361472.700013:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6614f17 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f443 expref: 25 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.700022:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614f2c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f443 expref: 24 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.700026:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:1.0:1788361472.700028:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788361472.700029:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622200, rc 0) 00000100:00100000:1.0:1788361472.700196:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+25:31523:x1875232130691072:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 1507us (1714us total) trans 30064771155 rc 0/0 00000100:00100000:1.0:1788361472.700209:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00010000:00010000:1.0:1788361472.701970:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.701985:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.701993:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.701999:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361472.702004:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.702020:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.702037:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff9a8984a32f00) 00010000:00010000:1.0:1788361472.702040:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361472.702043:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.702050:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6614f25 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.703507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.703759:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130691328 00000100:00100000:0.0:1788361472.703770:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130691328 00000100:00100000:0.0:1788361472.703896:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:0.0:1788361472.703912:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+24:31523:x1875232130691328:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788361472.704545:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.704565:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.704578:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361472.704629:0:37122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771156 00000004:00010000:0.0:1788361472.704657:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000390314c9 reply state 0000000002e8336e transno 30064771157 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.704666:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361472.704765:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:31523:x1875232130691328:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 854us (1263us total) trans 30064771157 rc 0/0 00000100:00100000:0.0:1788361472.704773:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000020:00080000:0.0:1788361472.704787:0:37122:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788361472.706448:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.706461:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.706480:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.706486:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361472.706490:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.706498:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.706514:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:0.0:1788361472.706518:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361472.706523:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.706529:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6614f3a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.710491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.710697:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130691712 00000100:00100000:3.0:1788361472.710707:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130691712 00000100:00100000:3.0:1788361472.710772:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:3.0:1788361472.710783:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:31523:x1875232130691712:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788361472.710853:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361472.710887:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d6614f2c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xb:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f443 expref: 26 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.710903:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:3.0:1788361472.710916:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361472.710944:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f41 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.710958:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f41 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.710969:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f41 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.710983:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.710991:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.711000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1788361472.711003:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.711044:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130691456 00000100:00100000:0.0:1788361472.711050:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130691456 00002000:00100000:0.0:1788361472.711166:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff9a8a834cf800 x1875232130691456/t0(0) o4->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/0 e 0 to 0 dl 1788361483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00010000:00010000:3.0:1788361472.711170:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f4f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711188:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f4f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1788361472.711191:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cf800 with x1875232130691456 ext(0->409599) 00010000:00010000:3.0:1788361472.711197:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f4f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361472.711200:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cf800 00000100:00100000:0.0:1788361472.711284:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788361472.711294:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2352:x1875232130691456:12345-192.168.203.60@tcp:4:mmap_sanity.0 00000004:00080000:3.0:1788361472.711546:0:35346:0:(mdd_dir.c:2033:mdd_finish_unlink()) Object [0x2000032e1:0xb:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1788361472.711654:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f4f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711662:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f4f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711668:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f4f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711675:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361472.711679:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f4f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711687:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f4f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711699:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:3.0:1788361472.711702:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788361472.711706:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f4f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711721:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f4f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711739:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f41 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711746:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f41 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711752:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f41 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711757:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361472.711759:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f41 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.711765:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f41 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.712240:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361472.712245:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361472.712249:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f41 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.712254:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f41 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361472.712265:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008a81fb4d reply state 00000000a70a4922 transno 30064771158 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361472.712274:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361472.712522:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:31523:x1875232130691712:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 1738us (2037us total) trans 30064771158 rc 0/0 00000100:00100000:3.0:1788361472.712530:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:0.0:1788361472.714795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.714863:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130691840 00000100:00100000:2.0:1788361472.714873:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130691840 00000100:00100000:2.0:1788361472.714927:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:2.0:1788361472.714937:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:31523:x1875232130691840:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361472.714958:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361472.714975:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f56 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f44a expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715032:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f5d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715043:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f5d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715051:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f5d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715059:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614f64 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715077:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614f64 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715110:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614f64 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715183:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f5d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715190:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f5d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715196:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f5d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715202:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.715206:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f5d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715213:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f5d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715224:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361472.715227:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.715232:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f5d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715238:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6614f5d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715251:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614f64 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715263:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614f64 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715282:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614f64 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715287:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.715290:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614f64 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715297:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614f64 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715306:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff9a8a8beae600) 00010000:00010000:2.0:1788361472.715308:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.715311:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614f64 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715318:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6614f64 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715351:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f56 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f44a expref: 28 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715361:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361472.715364:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.715368:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614f56 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f44a expref: 28 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.715388:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361472.715440:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:31523:x1875232130691840:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 505us (652us total) trans 0 rc 301/301 00000100:00100000:2.0:1788361472.715447:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00010000:00010000:1.0:1788361472.716251:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.716261:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.716278:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.716283:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcaa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361472.716287:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.716294:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.716306:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xc442db46 (ffff9a8a827d7800) 00010000:00010000:1.0:1788361472.716309:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361472.716313:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.716317:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6614f48 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xc442db46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.719945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.719984:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130692096 00000100:00100000:3.0:1788361472.720043:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130692096 00000100:00100000:2.0:1788361472.720116:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:2.0:1788361472.720127:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:31523:x1875232130692096:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361472.720193:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361472.720215:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614f6b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f451 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.720435:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614f72 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.720453:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614f72 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.720466:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614f72 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.720483:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.720490:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.720498:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.721236:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.721248:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.721257:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361472.721270:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 0 00010000:00010000:2.0:1788361472.721304:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614f72 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.721312:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614f72 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.721320:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614f72 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.721326:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1fc84f0) 00000100:00100000:1.0:1788361472.721330:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2352:x1875232130691456:12345-192.168.203.60@tcp:4:mmap_sanity.0 Request processed in 10034us (10331us total) trans 30064771085 rc 0/0 00010000:00010000:2.0:1788361472.721333:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614f72 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.721348:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614f72 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361472.721348:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00002000:00100000:1.0:1788361472.721362:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc3:0x0] (0->409599) req@ffff9a8a834cf800 x1875232130691456/t30064771085(0) o4->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/448 e 0 to 0 dl 1788361483 ref 1 fl Complete:/600/0 rc 0/0 job:'mmap_sanity.0' uid:0 gid:0 projid:100 00010000:00010000:2.0:1788361472.721365:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361472.721372:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.721379:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614f72 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1788361472.721379:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cf800 with x1875232130691456 ext(0->409599) 00002000:00010000:1.0:1788361472.721386:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cf800 00010000:00010000:2.0:1788361472.721408:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6614f72 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361472.721425:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e45dbf43 reply state 00000000fd9897c0 transno 30064771159 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.721434:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361472.721472:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6614f6b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f451 expref: 29 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.721486:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f451 expref: 28 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.721493:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361472.721495:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788361472.721497:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8200, rc 0) 00000100:00100000:2.0:1788361472.721525:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:31523:x1875232130692096:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 1401us (1586us total) trans 30064771159 rc 0/0 00000100:00100000:2.0:1788361472.721532:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00010000:00010000:0.0:1788361472.724330:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.724358:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.724365:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.724371:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361472.724376:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.724384:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.724401:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff9a8a8beaef00) 00010000:00010000:0.0:1788361472.724404:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361472.724409:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361472.724825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.724900:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130692352 00000100:00100000:3.0:1788361472.724949:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130692352 00000100:00100000:3.0:1788361472.725001:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:3.0:1788361472.725010:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:31523:x1875232130692352:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788361472.725139:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6614f79 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.725448:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.725463:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.725475:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361472.725520:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771160 00000004:00010000:3.0:1788361472.725539:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c807e22 reply state 00000000c1ed9d52 transno 30064771161 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361472.725545:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361472.725627:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:31523:x1875232130692352:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 617us (805us total) trans 30064771161 rc 0/0 00000100:00100000:3.0:1788361472.725636:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000020:00080000:3.0:1788361472.725641:0:35345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788361472.727066:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361472.727125:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130692480 00000100:00100000:1.0:1788361472.727133:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130692480 00000100:00100000:1.0:1788361472.727194:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361472.727212:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:30910:x1875232130692480:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361472.727226:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788361472.727244:0:35333:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb mtime from disk: 1788361469 -> 1788361472 00002000:00010000:1.0:1788361472.727248:0:35333:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc3:0x0] updating lvb ctime from disk: 1788361469 -> 1788361472 00010000:00010000:2.0:1788361472.727282:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.727283:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d6614e84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->409599) gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f427 expref: 8 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.727306:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.727315:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361472.727317:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361472.727337:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361472.727342:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.727351:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.727364:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00000100:00100000:1.0:1788361472.727368:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:30910:x1875232130692480:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 155us (305us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361472.727369:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361472.727376:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361472.727381:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00010000:00010000:2.0:1788361472.727389:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6614f8e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.729831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.730771:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130692736 00000100:00100000:3.0:1788361472.730780:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130692736 00000100:00100000:3.0:1788361472.730862:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:3.0:1788361472.730871:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+15:31523:x1875232130692736:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788361472.730899:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361472.730921:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f95 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f458 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731009:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6614f9c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731025:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6614f9c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731036:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6614f9c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731050:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fa3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731057:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fa3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731064:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fa3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731234:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614faa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731243:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614faa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731250:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614faa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361472.731273:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00010000:00010000:3.0:1788361472.731374:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6614f9c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731382:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6614f9c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731388:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6614f9c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731393:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361472.731398:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6614f9c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731406:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6614f9c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731431:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361472.731434:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361472.731439:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6614f9c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731446:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d6614f9c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731459:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fa3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731465:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fa3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731480:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fa3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731485:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361472.731489:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fa3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731495:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fa3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731502:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff9a8a827d7400) 00010000:00010000:3.0:1788361472.731505:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361472.731508:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fa3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731514:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fa3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731565:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614f95 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f458 expref: 18 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731580:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614faa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f458 expref: 17 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.731587:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:3.0:1788361472.731589:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361472.731592:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca800, rc 0) 00000100:00100000:3.0:1788361472.732017:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+17:31523:x1875232130692736:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 1145us (2193us total) trans 30064771162 rc 0/0 00000100:00100000:3.0:1788361472.732034:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:2.0:1788361472.732604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.732815:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130692864 00000100:00100000:3.0:1788361472.732822:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130692864 00002000:00100000:3.0:1788361472.732854:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (204800->409599) req@ffff9a8a89266d80 x1875232130692864/t0(0) o4->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/0 e 0 to 0 dl 1788361483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361472.732865:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89266d80 with x1875232130692864 ext(204800->409599) 00002000:00010000:3.0:1788361472.732870:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89266d80 00000100:00100000:3.0:1788361472.732893:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1788361472.732902:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2349:x1875232130692864:12345-192.168.203.60@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1788361472.737138:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:2349:x1875232130692864:12345-192.168.203.60@tcp:4:ldlm_bl.0 Request processed in 4226us (4524us total) trans 30064771081 rc 0/0 00000100:00100000:3.0:1788361472.737161:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00002000:00100000:3.0:1788361472.737173:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc2:0x0] (204800->409599) req@ffff9a8a89266d80 x1875232130692864/t30064771081(0) o4->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:533/0 lens 488/448 e 0 to 0 dl 1788361483 ref 1 fl Complete:/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361472.737184:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89266d80 with x1875232130692864 ext(204800->409599) 00002000:00010000:3.0:1788361472.737191:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89266d80 00000100:00100000:0.0:1788361472.738967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.739043:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130692992 00000100:00100000:3.0:1788361472.739052:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130692992 00000100:00100000:3.0:1788361472.739129:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1788361472.739139:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+10:30909:x1875232130692992:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361472.739162:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361472.739204:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000259755f4/0xf6a94c97d6614db9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 204800->208895) gid 0 flags: 0x44801000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3e8 expref: 10 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.739250:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361472.739309:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+9:30909:x1875232130692992:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 172us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361472.739317:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1788361472.740615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.740677:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130693248 00000100:00100000:3.0:1788361472.740683:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130693248 00000100:00100000:3.0:1788361472.740720:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1788361472.740726:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8419e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+17:31523:x1875232130693248:12345-192.168.203.60@tcp:103:mmap_sanity.0 00010000:00010000:3.0:1788361472.740735:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361472.740754:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614faa lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f458 expref: 17 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.740766:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:3.0:1788361472.740769:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361472.740805:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8419e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+16:31523:x1875232130693248:12345-192.168.203.60@tcp:103:mmap_sanity.0 Request processed in 79us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361472.740810:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361472.742436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.742555:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130693504 00000100:00100000:0.0:1788361472.742563:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130693504 00000100:00100000:0.0:1788361472.742609:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361472.742618:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+30:31532:x1875232130693504:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000004:00080000:0.0:1788361472.742853:0:35349:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0xb:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1788361472.742951:0:35349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.742976:0:35349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.742986:0:35349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.742993:0:35349:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.742997:0:35349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.743001:0:35349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361472.743221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361472.743247:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130693632 00000100:00100000:3.0:1788361472.743252:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130693632 00000100:00100000:3.0:1788361472.743281:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:3.0:1788361472.743289:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+16:31523:x1875232130693632:12345-192.168.203.60@tcp:58:mmap_sanity.0 00010000:00010000:3.0:1788361472.743357:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.743384:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f451 expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.743393:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.743432:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f451 expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.743446:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f451 expref: 31 pid: 35346 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.743447:0:35349:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788361472.743461:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6abb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144211840:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361472.743736:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:31532:x1875232130693504:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 1119us (1306us total) trans 30064771163 rc 0/0 00000100:00100000:0.0:1788361472.743744:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:3.0:1788361472.743750:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352f780 going to sleep for 11 seconds 00010000:00010000:2.0:1788361472.744759:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361472.744769:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.744778:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361472.744782:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.744791:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.744808:0:35334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xb:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:2.0:1788361472.744812:0:35334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361472.744828:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.744834:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6614fb8 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.744855:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361472.744856:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361472.744858:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361472.745313:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6abb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144211840:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361472.745334:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361472.745852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361472.745897:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130693760 00000100:00100000:0.0:1788361472.745904:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130693760 00010000:00010000:0.0:1788361472.745933:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f451 expref: 31 pid: 35346 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.746061:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361472.746073:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130693760:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361472.746102:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361472.746255:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f451 expref: 31 pid: 35346 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.746282:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f451 expref: 31 pid: 35346 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.746302:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6614f80 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f451 expref: 31 pid: 35346 timeout: 962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.746320:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:0.0:1788361472.746325:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.746334:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.746341:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361472.746364:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361472.746391:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361472.746399:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361472.746451:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+30:2349:x1875232130693760:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 378us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361472.746460:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000040:00080000:3.0:1788361472.746850:0:35345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].4, 136 off8736 00000100:00100000:3.0:1788361472.746921:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+16:31523:x1875232130693632:12345-192.168.203.60@tcp:58:mmap_sanity.0 Request processed in 3632us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361472.746929:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:3.0:1788361472.749036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361472.749298:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130693888 00000100:00100000:2.0:1788361472.749306:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130693888 00000100:00100000:2.0:1788361472.749347:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:2.0:1788361472.749355:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+16:31523:x1875232130693888:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361472.749376:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361472.749395:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614fc6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f45f expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.749451:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.749458:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614fc6 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f45f expref: 17 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.749473:0:35346:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.749483:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614fc6 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f45f expref: 17 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.749493:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361472.749505:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361472.749508:0:35346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614fc6 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f45f expref: 17 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361472.749513:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361472.749552:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+17:31523:x1875232130693888:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 199us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361472.749560:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000040:00080000:0.0:1788361473.248516:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361473.248525:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361473.248563:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:0.0:1788361473.248571:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361473.248881:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144211968:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361473.248982:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361473.251007:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144211968:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788361473.251753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.252334:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130694016 00000100:00100000:1.0:1788361473.252343:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130694016 00000100:00100000:1.0:1788361473.252398:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:1.0:1788361473.252407:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:31535:x1875232130694016:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788361473.252440:0:37122:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788361473.252546:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:31535:x1875232130694016:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 139us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361473.252554:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:3.0:1788361473.255360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.255500:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130694144 00000100:00100000:1.0:1788361473.255508:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130694144 00000100:00100000:1.0:1788361473.255568:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:1.0:1788361473.255578:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:31535:x1875232130694144:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788361473.255652:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614fcd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255800:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614fcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255815:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614fcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255832:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614fd4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255840:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255847:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255873:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255881:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255888:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361473.255928:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1788361473.255933:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361473.255946:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255957:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614fcd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255974:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614fcd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255982:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614fcd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.255987:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.255998:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614fcd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256006:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614fcd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256019:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:1.0:1788361473.256022:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.256028:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614fcd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256034:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6614fcd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256046:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614fd4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256396:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614fd4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256403:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256416:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.256426:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614fd4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256434:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614fd4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256442:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xadcadaa3 (ffff9a8984a32f00) 00010000:00010000:1.0:1788361473.256445:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.256448:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614fd4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256454:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614fd4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xadcadaa3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256476:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256481:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256486:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256490:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.256493:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256498:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256504:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361473.256506:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.256515:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.256521:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614fdb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.256600:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:31535:x1875232130694144:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 1019us (1243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361473.256608:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:0.0:1788361473.259798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361473.259951:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130694400 00000100:00100000:3.0:1788361473.259962:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130694400 00000100:00100000:3.0:1788361473.260017:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:3.0:1788361473.260027:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+30:31535:x1875232130694400:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361473.260051:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361473.260103:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614fe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f466 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260542:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fe9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260562:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fe9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260574:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fe9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361473.260589:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00010000:00010000:3.0:1788361473.260692:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fe9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260699:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fe9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260706:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fe9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260712:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361473.260716:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fe9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260741:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fe9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260755:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:3.0:1788361473.260758:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361473.260763:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fe9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260770:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6614fe9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260827:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614fe2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f466 expref: 32 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260839:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:3.0:1788361473.260841:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361473.260845:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6614fe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f466 expref: 32 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.260855:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca800, rc 0) 00000100:00100000:3.0:1788361473.260921:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:31535:x1875232130694400:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 895us (1132us total) trans 30064771164 rc 301/301 00000100:00100000:3.0:1788361473.260929:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:3.0:1788361473.264154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361473.264762:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130694528 00000100:00100000:2.0:1788361473.264772:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130694528 00000100:00100000:2.0:1788361473.264836:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:2.0:1788361473.264847:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:31535:x1875232130694528:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361473.264887:0:35346:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0xc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361473.264995:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:31535:x1875232130694528:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 149us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361473.265002:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:0.0:1788361473.268615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.269482:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130694784 00000100:00100000:1.0:1788361473.269492:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130694784 00000100:00100000:1.0:1788361473.269581:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:1.0:1788361473.269592:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:31535:x1875232130694784:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361473.269614:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361473.269638:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ff7 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f46d expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361473.270234:0:37122:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc3:0x0], index 1: 0 00010000:00010000:1.0:1788361473.270451:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614ffe lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.270466:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614ffe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.270478:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614ffe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.270544:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6614ff7 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f46d expref: 34 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.270579:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614ffe lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f46d expref: 33 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.270588:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:1.0:1788361473.270591:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361473.270595:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623a00, rc 0) 00000100:00100000:1.0:1788361473.270662:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+33:31535:x1875232130694784:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1072us (2056us total) trans 30064771165 rc 0/0 00000100:00100000:1.0:1788361473.270671:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:0.0:1788361473.273941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.274078:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130695040 00000100:00100000:1.0:1788361473.274116:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130695040 00000100:00100000:1.0:1788361473.274190:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:1.0:1788361473.274200:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+33:31535:x1875232130695040:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361473.274273:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361473.274313:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6614ffe lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f46d expref: 33 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274331:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:1.0:1788361473.274349:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361473.274374:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d661500c lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274390:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d661500c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274402:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d661500c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274432:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615013 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x109863bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274440:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615013 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x109863bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274448:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615013 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x109863bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274520:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d661500c lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274544:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d661500c lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274551:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d661500c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274557:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.274562:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d661500c lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274571:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d661500c lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274579:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361473.274583:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.274587:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d661500c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274593:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d661500c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274610:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615013 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x109863bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274616:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615013 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x109863bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274622:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615013 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x109863bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274628:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.274631:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615013 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x109863bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274637:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615013 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x109863bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274654:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x109863bc (ffff9a8984a32a00) 00010000:00010000:1.0:1788361473.274657:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.274660:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615013 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x109863bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.274666:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615013 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x109863bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.274750:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+32:31535:x1875232130695040:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 551us (816us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361473.274758:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:2.0:1788361473.277155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361473.277259:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130695168 00000100:00100000:3.0:1788361473.277277:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130695168 00000100:00100000:3.0:1788361473.277331:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:3.0:1788361473.277340:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:31535:x1875232130695168:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361473.277374:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361473.277396:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d661501a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f474 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.277502:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.277517:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.277529:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.277625:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d661501a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f474 expref: 34 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.277642:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f474 expref: 33 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.277940:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:3.0:1788361473.277945:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361473.277950:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb200, rc 0) 00000100:00100000:3.0:1788361473.278005:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:31535:x1875232130695168:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 665us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361473.278012:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:0.0:1788361473.280515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361473.280598:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130695424 00000100:00100000:2.0:1788361473.280608:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130695424 00000100:00100000:2.0:1788361473.280669:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:2.0:1788361473.280679:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:31535:x1875232130695424:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361473.280765:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.280784:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.280796:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361473.281221:0:35346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].4, 88 off8496 00000004:00010000:2.0:1788361473.281326:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c51c4145 reply state 0000000032b3c6a2 transno 30064771166 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361473.281341:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361473.281441:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:31535:x1875232130695424:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 762us (931us total) trans 30064771166 rc 0/0 00000100:00100000:2.0:1788361473.281449:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:0.0:1788361473.283492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.283915:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130695552 00000100:00100000:1.0:1788361473.283924:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130695552 00000100:00100000:1.0:1788361473.283980:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:1.0:1788361473.283998:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+35:31535:x1875232130695552:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361473.284022:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361473.284039:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.284041:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661502f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f47b expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.284061:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.284079:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.284126:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661502f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f47b expref: 36 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.284152:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661502f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f47b expref: 36 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.284170:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:1.0:1788361473.284173:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361473.284175:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623200, rc 0) 00000100:00100000:1.0:1788361473.284223:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+36:31535:x1875232130695552:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 226us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361473.284229:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00010000:00010000:3.0:1788361473.285822:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361473.285833:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.285856:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.285874:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:3.0:1788361473.285877:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788361473.285881:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.285888:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615028 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361473.288390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361473.288450:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130695680 00000100:00100000:3.0:1788361473.288465:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130695680 00000100:00100000:3.0:1788361473.288526:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1788361473.288536:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130695680:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788361473.289132:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2349:x1875232130695680:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 596us (749us total) trans 30064771082 rc 0/0 00000100:00100000:3.0:1788361473.289150:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:0.0:1788361473.291563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.291921:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130695936 00000100:00100000:1.0:1788361473.291931:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130695936 00000100:00100000:1.0:1788361473.292181:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361473.292192:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:31535:x1875232130695936:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788361473.292535:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:31535:x1875232130695936:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 345us (1026us total) trans 30064771167 rc 0/0 00000100:00100000:1.0:1788361473.292543:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:0.0:1788361473.294124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.294232:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130696192 00000100:00100000:1.0:1788361473.294239:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130696192 00000100:00100000:1.0:1788361473.294411:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:1.0:1788361473.294421:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+36:31535:x1875232130696192:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788361473.294560:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+36:31535:x1875232130696192:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 139us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361473.294567:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:2.0:1788361473.296454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.296514:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130696320 00000100:00100000:0.0:1788361473.296521:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130696320 00000100:00100000:0.0:1788361473.296557:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:0.0:1788361473.296563:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:31535:x1875232130696320:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361473.296580:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361473.296599:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615036 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f482 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.296660:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661503d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.296675:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661503d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.296688:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661503d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361473.296729:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361473.296767:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661503d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.296795:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615036 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f482 expref: 38 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.296812:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661503d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f482 expref: 37 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.296822:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:0.0:1788361473.296825:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788361473.296830:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:0.0:1788361473.297038:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:31535:x1875232130696320:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 473us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361473.297046:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:0.0:1788361473.299558:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361473.299647:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130696448 00000100:00100000:2.0:1788361473.299664:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130696448 00000100:00100000:2.0:1788361473.299718:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1788361473.299728:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2351:x1875232130696448:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361473.299748:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361473.299769:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615044 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f489 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361473.299797:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983b01, blocks: 0x1 00010000:00010000:2.0:1788361473.299818:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=863s v=(0 0) 00010000:00010000:2.0:1788361473.299823:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361473.299833:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615044 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f489 expref: 10 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.299931:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615044 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f489 expref: 10 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.299963:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9e00, rc 0) 00000100:00100000:2.0:1788361473.300062:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130696448:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 336us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361473.300070:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:1.0:1788361473.303556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361473.303806:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130696704 00000100:00100000:2.0:1788361473.303816:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130696704 00000100:00100000:2.0:1788361473.303910:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:2.0:1788361473.303924:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+37:31535:x1875232130696704:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788361473.304057:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+37:31535:x1875232130696704:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 138us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361473.304065:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:0.0:1788361473.306486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361473.306594:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130696832 00000100:00100000:2.0:1788361473.306603:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130696832 00000100:00100000:2.0:1788361473.306696:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:2.0:1788361473.306706:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:31535:x1875232130696832:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361473.306724:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361473.306745:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f490 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.306776:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615044 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f489 expref: 11 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.306785:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361473.306789:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361473.306808:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 11 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.306842:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615044 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f489 expref: 11 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.306870:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615044 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f489 expref: 11 pid: 35982 timeout: 963 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361473.306886:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89265f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36286:1875232144212096:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361473.306963:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361473.309204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361473.309309:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89265f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36286:1875232144212096:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361473.309333:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 11 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.309349:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8000, rc 0) 00000100:00100000:2.0:1788361473.309394:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+11:31535:x1875232130696832:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2690us (2917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361473.309401:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1788361473.309899:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130696960 00000100:00100000:3.0:1788361473.309906:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130696960 00010000:00010000:3.0:1788361473.309936:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615044 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f489 expref: 11 pid: 35982 timeout: 963 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361473.310014:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1788361473.310020:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130696960:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361473.310031:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361473.310051:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615044 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f489 expref: 11 pid: 35982 timeout: 963 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.310063:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615044 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f489 expref: 11 pid: 35982 timeout: 963 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.310106:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615044 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f489 expref: 11 pid: 35982 timeout: 963 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.310121:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361473.310125:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361473.310136:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 10 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.310156:0:35333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 10 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.310188:0:35333:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 10 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361473.310201:0:35333:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6abbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35333:1875232144212224:192.168.203.60@tcp:105: 00000100:00100000:3.0:1788361473.310267:0:35333:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361473.312075:0:35333:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6abbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35333:1875232144212224:192.168.203.60@tcp:105: 00010000:00010000:3.0:1788361473.312215:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361473.312443:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130696960:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 2420us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361473.312453:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:1.0:1788361473.314543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.314622:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130697088 00000100:00100000:0.0:1788361473.314631:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130697088 00002000:00100000:0.0:1788361473.314678:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff9a898705f800 x1875232130697088/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:534/0 lens 4584/0 e 0 to 0 dl 1788361484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788361473.314689:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705f800 with x1875232130697088 ext(0->4095) 00002000:00010000:0.0:1788361473.314695:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705f800 00000100:00100000:0.0:1788361473.314728:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1788361473.314736:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130697088:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361473.315185:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+12:2349:x1875232130697088:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 448us (647us total) trans 30064771083 rc 0/0 00000100:00100000:0.0:1788361473.315208:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00002000:00100000:0.0:1788361473.315216:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff9a898705f800 x1875232130697088/t30064771083(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:534/0 lens 4584/448 e 0 to 0 dl 1788361484 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788361473.315224:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705f800 with x1875232130697088 ext(0->4095) 00002000:00010000:0.0:1788361473.315228:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705f800 00000100:00100000:0.0:1788361473.317396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.320481:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130697216 00000100:00100000:1.0:1788361473.320494:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130697216 00000100:00100000:1.0:1788361473.320548:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:1.0:1788361473.320557:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+37:31535:x1875232130697216:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788361473.349849:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771163 is committed 00000001:00080000:3.0:1788361473.349869:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771150 is committed 00000001:00080000:3.0:1788361473.349882:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771167 is committed 00000004:00080000:3.0:1788361473.349894:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788361473.349919:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803892 batchid updated 00000020:00080000:3.0:1788361473.349939:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8aae3a2540 refcount 2 committed 0 result 0 batchid 25769803893 00000020:00080000:3.0:1788361473.349943:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a856e1900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8aae3a29c0 00000020:00080000:3.0:1788361473.349947:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a856e1e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ac1beec00 00000001:00080000:3.0:1788361473.349963:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771162 is committed 00000100:00100000:0.0:1788361473.350022:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000020:00080000:1.0:1788361473.350030:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803893 committed batchid 25769803892 00000100:00100000:0.0:1788361473.350040:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144212352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788361473.350124:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361473.350178:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144212352 00000100:00100000:0.0:1788361473.350185:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144212352 00000100:00100000:0.0:1788361473.350237:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788361473.350246:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144212352:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788361473.350275:0:35982:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:194 count 1 00000020:00080000:1.0:1788361473.350302:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803892 00002000:00010000:0.0:1788361473.350306:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc2:0x0] initial LVB size: 409600, mtime: 0x6a983aff, atime: 0x6a983afd, ctime: 0x6a983aff, blocks: 0x403 00010000:00010000:0.0:1788361473.350314:0:35982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615052 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361473.350327:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788361473.350331:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1788361473.350336:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361473.350344:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.350361:0:35982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.350391:0:35982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615052 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.350400:0:35982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.350426:0:35982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788361473.350446:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:31535:x1875232130697216:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 29888us (33054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361473.350454:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00010000:00010000:1.0:1788361473.350820:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361473.350828:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.350837:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361473.350842:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615052 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.350852:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615052 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.350871:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615052 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.350884:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615052 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.350902:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361473.350904:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361473.350906:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361473.351120:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144212352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 875us (995us total) trans 30064771084 rc 0/0 00000100:00100000:0.0:1788361473.351128:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:2.0:1788361473.351220:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a898b061180/2, rc 0, transno 30064771084 00000100:00100000:2.0:1788361473.351236:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b061180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144212352:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788361473.352333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.352443:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130697344 00000100:00100000:1.0:1788361473.352449:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130697344 00000100:00100000:1.0:1788361473.352491:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:1.0:1788361473.352500:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+12:2349:x1875232130697344:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788361473.376429:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771084 is committed 00000001:00080000:1.0:1788361473.376446:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771083 is committed 00000001:00080000:1.0:1788361473.376454:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771079 is committed 00000001:00080000:1.0:1788361473.376475:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771081 is committed 00000100:00100000:0.0:1788361473.376602:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130697344:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 24097us (24267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361473.376615:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:3.0:1788361473.379403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.379464:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130697600 00000100:00100000:1.0:1788361473.379474:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130697600 00000100:00100000:1.0:1788361473.379535:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:1.0:1788361473.379546:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:31535:x1875232130697600:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361473.379607:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361473.379637:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661503d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f482 expref: 13 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.379667:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:1.0:1788361473.379673:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361473.379706:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.379735:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.379745:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361473.379907:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f875a40 reply state 0000000062a2b2c6 transno 30064771168 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.379918:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361473.380024:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:31535:x1875232130697600:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 478us (625us total) trans 30064771168 rc 0/0 00000100:00100000:1.0:1788361473.380032:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00010000:00010000:1.0:1788361473.385008:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.385026:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.385034:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.385041:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.385046:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.385055:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.385072:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:1.0:1788361473.385121:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.385126:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.385130:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615059 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361473.385362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.385426:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130697728 00000100:00100000:1.0:1788361473.385436:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130697728 00000100:00100000:1.0:1788361473.385496:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:1.0:1788361473.385507:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130697728:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788361473.386300:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1788361473.386306:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 0 -> 1788361473 00002000:00010000:1.0:1788361473.386308:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb atime from disk: 0 -> 1788361473 00002000:00010000:1.0:1788361473.386311:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1788361473 -> 1788361473 00002000:00010000:1.0:1788361473.386313:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788361473.386373:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130697728:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 867us (1013us total) trans 30064771085 rc 0/0 00000100:00100000:1.0:1788361473.386382:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:2.0:1788361473.388629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.388852:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130697984 00000100:00100000:0.0:1788361473.388861:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130697984 00000100:00100000:0.0:1788361473.388923:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:0.0:1788361473.388934:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:31535:x1875232130697984:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788361473.389004:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.389024:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f474 expref: 13 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.389033:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.389125:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f474 expref: 13 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.389151:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f474 expref: 13 pid: 35345 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361473.389166:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b061880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144212480:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361473.389251:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a850870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361473.392137:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b061880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144212480:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361473.392176:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361473.392441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.393175:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130698112 00000100:00100000:0.0:1788361473.393183:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130698112 00010000:00010000:0.0:1788361473.393221:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f474 expref: 14 pid: 35345 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361473.393264:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:0.0:1788361473.393273:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130698112:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361473.393287:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361473.393295:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f474 expref: 14 pid: 35345 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.393308:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f474 expref: 14 pid: 35345 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.393348:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615021 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f474 expref: 14 pid: 35345 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.393363:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:0.0:1788361473.393368:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.393379:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.393388:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.393424:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361473.393484:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130698112:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 211us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361473.393492:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00010000:00010000:1.0:1788361473.393983:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.393994:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.394022:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.394029:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.394047:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.394054:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.394058:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.394067:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.394077:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:1.0:1788361473.394080:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788361473.394119:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.394126:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615060 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.394186:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:31535:x1875232130697984:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 5254us (5563us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788361473.394196:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:2.0:1788361473.397243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.397394:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130698240 00000100:00100000:0.0:1788361473.397404:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130698240 00000100:00100000:0.0:1788361473.397456:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1788361473.397465:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130698240:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788361473.397514:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.397537:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 7 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.397565:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361473.397570:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361473.397575:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.397611:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 7 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.397625:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 7 pid: 36286 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361473.397640:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b061880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36286:1875232144212608:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361473.397846:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a850870c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361473.400567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.400636:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130698368 00000100:00100000:1.0:1788361473.400643:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130698368 00010000:00010000:1.0:1788361473.400676:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 8 pid: 36286 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.400716:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788361473.400725:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6aba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130698368:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361473.400761:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361473.400788:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 8 pid: 36286 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.400801:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 8 pid: 36286 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361473.400802:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b061880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36286:1875232144212608:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361473.400823:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d7fab4b/0xf6a94c97d661504b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f490 expref: 8 pid: 36286 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.400828:0:36286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.400838:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361473.400842:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361473.400848:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.400857:0:35332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.400880:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361473.400896:0:36286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.400903:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.400926:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6aba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130698368:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 202us (366us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361473.400926:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.400933:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00010000:00010000:0.0:1788361473.400941:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.400949:0:36286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.400957:0:36286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361473.400961:0:36286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.400971:0:36286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.400984:0:36286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.400992:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d6615067 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361473.401054:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130698240:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 3586us (3817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361473.401062:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:3.0:1788361473.406256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.406421:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130698624 00000100:00100000:1.0:1788361473.406432:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130698624 00000100:00100000:1.0:1788361473.406512:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 136 00000100:00100000:1.0:1788361473.406523:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+12:31535:x1875232130698624:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788361473.406641:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d661506e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.406663:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d661506e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.406678:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d661506e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.406911:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.406924:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661502f lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f47b expref: 13 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.406933:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.406969:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661502f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f47b expref: 13 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.406985:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661502f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f47b expref: 13 pid: 37122 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.407001:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144212736:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361473.407107:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b966c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361473.409952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.410037:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130698752 00000100:00100000:0.0:1788361473.410046:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130698752 00010000:00010000:0.0:1788361473.410082:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661502f lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f47b expref: 14 pid: 37122 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361473.410180:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788361473.410190:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130698752:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361473.410206:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361473.410214:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661502f lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f47b expref: 14 pid: 37122 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.410228:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661502f lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f47b expref: 14 pid: 37122 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.410251:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:0.0:1788361473.410368:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.410382:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.410391:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.410424:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361473.410478:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130698752:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 290us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361473.410486:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00010000:00010000:1.0:1788361473.411716:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661502f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f47b expref: 13 pid: 37122 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.411754:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144212736:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361473.411780:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.411789:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.411795:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361473.411997:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771169 00000001:00080000:1.0:1788361473.412426:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771170 00000001:00080000:1.0:1788361473.412475:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771171 00000100:00100000:1.0:1788361473.412558:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144212864:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788361473.412625:0:35347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361473.412706:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96180 going to sleep for 11 seconds 00000100:00100000:3.0:1788361473.412794:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144212864 00000100:00100000:3.0:1788361473.412800:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144212864 00000100:00100000:3.0:1788361473.412848:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788361473.412857:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144212864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361473.412970:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144212864:12345-0@lo:1000:mdt00_002.0 Request processed in 115us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361473.412978:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788361473.413068:0:35347:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771084 gen 2 00000004:00080000:1.0:1788361473.413073:0:35347:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771078 committed transno 30064771084 00000004:00080000:1.0:1788361473.413108:0:35347:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a898b061180, transno 30064771084 00000100:00100000:1.0:1788361473.413172:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144212864:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788361473.413748:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771172 00000100:00100000:1.0:1788361473.413802:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144212992:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788361473.413833:0:35347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361473.415198:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144212992 00000100:00100000:1.0:1788361473.415202:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b966c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361473.415209:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144212992 00000100:00100000:2.0:1788361473.415271:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788361473.415278:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144212992:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361473.415515:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35347:x1875232144212992:12345-0@lo:1000:mdt00_002.0 Request processed in 237us (1681us total) trans 30064771086 rc 0/0 00000100:00100000:2.0:1788361473.415522:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788361473.415663:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144212992:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788361473.415700:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415721:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415729:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415735:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.415740:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415748:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415765:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:1.0:1788361473.415768:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361473.415774:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415780:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615075 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415810:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415817:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415823:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415828:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.415837:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415843:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415851:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361473.415854:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361473.415860:0:35347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614fc6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f45f expref: 10 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415871:0:35347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614fc6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f45f expref: 10 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415881:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614fc6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f45f expref: 10 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.415914:0:35347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614fc6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f45f expref: 10 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.415927:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144213120:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361473.415992:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361473.417909:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144213120:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361473.417937:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.417947:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6614fbf lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.417991:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661507c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418011:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661507c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418024:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661507c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418034:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661507c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418040:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661507c lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418046:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661507c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418052:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.418056:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661507c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418063:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661507c lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418074:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361473.418076:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.418080:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661507c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418182:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d661507c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418201:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d661506e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418212:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d661506e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418219:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d661506e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418225:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.418228:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d661506e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418235:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d661506e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418245:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361473.418247:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361473.418250:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d661506e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.418255:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d661506e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361473.418613:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+16:31535:x1875232130698624:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 12090us (12365us total) trans 30064771173 rc 0/0 00000100:00100000:2.0:1788361473.418626:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 136 00000020:00080000:2.0:1788361473.418631:0:35347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788361473.418932:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361473.418937:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361473.418966:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:0.0:1788361473.418973:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361473.420764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.421104:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130698880 00000100:00100000:0.0:1788361473.421114:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130698880 00000100:00080000:1.0:1788361473.421166:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361473.421236:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1788361473.421247:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+11:31523:x1875232130698880:12345-192.168.203.60@tcp:49:mmap_sanity.0 00000100:00100000:0.0:1788361473.421396:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+11:31523:x1875232130698880:12345-192.168.203.60@tcp:49:mmap_sanity.0 Request processed in 151us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361473.421413:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1788361473.422522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.422897:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130699136 00000100:00100000:1.0:1788361473.422904:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130699136 00000100:00100000:1.0:1788361473.422941:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1788361473.422948:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+16:31535:x1875232130699136:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361473.423464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000004:00080000:1.0:1788361473.423644:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788361473.423752:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771174 00010000:00010000:1.0:1788361473.423814:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361473.423899:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130699264 00000100:00100000:0.0:1788361473.423905:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130699264 00000100:00100000:0.0:1788361473.423971:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1788361473.423983:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:31523:x1875232130699264:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361473.423994:0:35348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.423998:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361473.424011:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.424016:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f497 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.424021:0:35348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.424034:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.424040:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361473.424065:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 4096, mtime: 0x6a983b01, atime: 0x6a983b01, ctime: 0x6a983b01, blocks: 0xb 00010000:00010000:0.0:1788361473.424117:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=863s v=(0 0) 00010000:00010000:0.0:1788361473.424123:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361473.424134:0:35348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361473.424136:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 6 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.424170:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 6 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.424185:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e600, rc 0) 00000100:00100000:1.0:1788361473.424226:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+18:31535:x1875232130699136:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1277us (1707us total) trans 30064771175 rc 0/0 00000100:00100000:0.0:1788361473.424233:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:31523:x1875232130699264:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 250us (767us total) trans 0 rc 0/0 00000100:00080000:2.0:1788361473.424235:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361473.424240:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000020:00080000:1.0:1788361473.424246:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788361473.424254:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00010000:00010000:3.0:1788361473.424720:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361473.424734:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.424741:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361473.424746:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.424754:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.424880:0:36289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xd:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:3.0:1788361473.424884:0:36289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788361473.424888:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.424894:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615083 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.424917:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361473.424919:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361473.424921:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361473.429506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361473.429664:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130699392 00000100:00100000:3.0:1788361473.429674:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130699392 00002000:00100000:3.0:1788361473.429810:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff9a898b065500 x1875232130699392/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:534/0 lens 488/0 e 0 to 0 dl 1788361484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361473.429822:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b065500 with x1875232130699392 ext(0->4095) 00002000:00010000:3.0:1788361473.429828:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b065500 00000100:00100000:3.0:1788361473.429868:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:3.0:1788361473.429879:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130699392:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:3.0:1788361473.430157:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130699392:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 279us (660us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788361473.430174:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00002000:00100000:3.0:1788361473.430181:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff9a898b065500 x1875232130699392/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:534/0 lens 488/4536 e 0 to 0 dl 1788361484 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361473.430190:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b065500 with x1875232130699392 ext(0->4095) 00002000:00010000:3.0:1788361473.430193:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b065500 00000100:00100000:1.0:1788361473.436065:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361473.436747:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130699520 00000100:00100000:2.0:1788361473.436758:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130699520 00000100:00100000:2.0:1788361473.437526:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:2.0:1788361473.437538:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+18:31523:x1875232130699520:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361473.437899:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361473.437923:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6615091 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f49e expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.438010:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6615091 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f49e expref: 19 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.438026:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6615091 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f49e expref: 19 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.438048:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361473.438051:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361473.438055:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8c00, rc 0) 00000100:00100000:2.0:1788361473.438135:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+19:31523:x1875232130699520:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 600us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361473.438150:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 137 00010000:00010000:2.0:1788361473.440207:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361473.441774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.441863:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130699648 00000100:00100000:1.0:1788361473.441873:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130699648 00000100:00100000:1.0:1788361473.441935:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1788361473.441946:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:31523:x1875232130699648:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361473.441965:0:35983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361473.441984:0:35983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4a5 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.442325:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 5 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.442405:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361473.442410:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361473.442418:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.442456:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 5 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.442470:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 5 pid: 35982 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.442485:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144213248:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361473.442624:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b966c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361473.448065:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.448196:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144213248:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361473.448234:0:35983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 7 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.448256:0:35983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623800, rc 0) 00000100:00100000:1.0:1788361473.448318:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:31523:x1875232130699648:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 6374us (6553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361473.448327:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:3.0:1788361473.448429:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130699776 00000100:00100000:3.0:1788361473.448437:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130699776 00002000:00100000:3.0:1788361473.448478:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff9a898b064a80 x1875232130699776/t0(0) o4->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:534/0 lens 4584/0 e 0 to 0 dl 1788361484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361473.448488:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b064a80 with x1875232130699776 ext(0->4095) 00010000:00010000:3.0:1788361473.448495:0:35987:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 6 pid: 35982 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.448509:0:35987:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 6 pid: 35982 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361473.448517:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a898b064a80 00000100:00100000:3.0:1788361473.448545:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1788361473.448553:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130699776:12345-192.168.203.60@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1788361473.449010:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2349:x1875232130699776:12345-192.168.203.60@tcp:4:ldlm_bl.0 Request processed in 457us (954us total) trans 30064771087 rc 0/0 00000100:00100000:3.0:1788361473.449017:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00002000:00100000:3.0:1788361473.449023:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff9a898b064a80 x1875232130699776/t30064771087(0) o4->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:534/0 lens 4584/448 e 0 to 0 dl 1788361484 ref 1 fl Complete:H/600/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:3.0:1788361473.449045:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b064a80 with x1875232130699776 ext(0->4095) 00010000:00010000:3.0:1788361473.449051:0:35987:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 8 pid: 35982 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.449063:0:35987:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 8 pid: 35982 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361473.449070:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a898b064a80 00000100:00100000:2.0:1788361473.451277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.451377:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130699904 00000100:00100000:1.0:1788361473.451387:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130699904 00010000:00010000:1.0:1788361473.451421:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 8 pid: 35982 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.451497:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1788361473.451506:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2350:x1875232130699904:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361473.451802:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788361473.451820:0:35333:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb mtime from disk: 1788361473 -> 1788361474 00002000:00010000:1.0:1788361473.451824:0:35333:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc3:0x0] updating lvb ctime from disk: 1788361473 -> 1788361474 00010000:00010000:1.0:1788361473.451830:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 8 pid: 35982 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.451843:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 8 pid: 35982 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.451869:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f442f86/0xf6a94c97d661508a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f497 expref: 8 pid: 35982 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.451885:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361473.451890:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361473.451900:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.451909:0:35333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.452025:0:35333:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.452040:0:35333:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35333:1875232144213376:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361473.452242:0:35333:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b966c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361473.454525:0:35333:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:35333:1875232144213376:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361473.454668:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361473.454868:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:2350:x1875232130699904:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3361us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361473.454879:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1788361473.454918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.455346:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130700032 00000100:00100000:0.0:1788361473.455355:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130700032 00002000:00100000:1.0:1788361473.455437:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff9a898b066a00 x1875232130700032/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:534/0 lens 488/0 e 0 to 0 dl 1788361484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361473.455447:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b066a00 with x1875232130700032 ext(0->4095) 00002000:00010000:1.0:1788361473.455453:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b066a00 00000100:00100000:1.0:1788361473.455521:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:1.0:1788361473.455539:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130700032:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:1.0:1788361473.455707:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130700032:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 171us (789us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788361473.455714:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00002000:00100000:1.0:1788361473.455720:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff9a898b066a00 x1875232130700032/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:534/0 lens 488/4536 e 0 to 0 dl 1788361484 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:1.0:1788361473.455729:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b066a00 with x1875232130700032 ext(0->4095) 00002000:00010000:1.0:1788361473.455745:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b066a00 00000100:00100000:3.0:1788361473.458188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.458313:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130700160 00000100:00100000:1.0:1788361473.458322:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130700160 00000100:00100000:1.0:1788361473.458373:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:1.0:1788361473.458384:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:31523:x1875232130700160:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361473.458402:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361473.458422:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d661509f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4ac expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.458456:0:35980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.458467:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361473.458472:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:1.0:1788361473.458477:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d661509f lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4ac expref: 8 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.458513:0:35980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.459011:0:35980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 6 pid: 35983 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.459030:0:35980:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:35980:1875232144213504:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361473.459420:0:35980:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8985b96000 going to sleep for 11 seconds 00000100:00100000:1.0:1788361473.461395:0:35980:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:35980:1875232144213504:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361473.461450:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d661509f lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4ac expref: 8 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.461471:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623200, rc 0) 00000100:00100000:1.0:1788361473.461634:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:31523:x1875232130700160:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 3146us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361473.461645:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788361473.461743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.461804:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130700288 00000100:00100000:0.0:1788361473.461823:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130700288 00010000:00010000:0.0:1788361473.461852:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 7 pid: 35983 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361473.461886:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:0.0:1788361473.461894:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8984bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130700288:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361473.461907:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361473.461931:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 7 pid: 35983 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.461945:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 7 pid: 35983 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.461969:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615098 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4a5 expref: 7 pid: 35983 timeout: 963 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.461983:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1788361473.461988:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(2 0) 00010000:00010000:0.0:1788361473.461997:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d661509f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4ac expref: 7 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.462007:0:36007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d661509f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4ac expref: 7 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.462350:0:36007:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d661509f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4ac expref: 7 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361473.462369:0:36007:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b061180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:36007:1875232144213632:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361473.462542:0:36007:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a850870c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361473.465188:0:36007:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b061180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:36007:1875232144213632:192.168.203.60@tcp:105: 00010000:00010000:0.0:1788361473.465221:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361473.465519:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8984bb7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130700288:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3624us (3778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361473.465531:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1788361473.465636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.465954:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130700416 00000100:00100000:0.0:1788361473.465962:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130700416 00002000:00100000:0.0:1788361473.466002:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff9a8ab6ab8e00 x1875232130700416/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:534/0 lens 488/0 e 0 to 0 dl 1788361484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361473.466012:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6ab8e00 with x1875232130700416 ext(0->4095) 00002000:00010000:0.0:1788361473.466016:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6ab8e00 00000100:00100000:0.0:1788361473.466115:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:0.0:1788361473.466126:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2350:x1875232130700416:12345-192.168.203.60@tcp:3:kworker.0 00000100:00100000:0.0:1788361473.466312:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:2350:x1875232130700416:12345-192.168.203.60@tcp:3:kworker.0 Request processed in 188us (676us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788361473.466319:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00002000:00100000:0.0:1788361473.466326:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc3:0x0] (0->4095) req@ffff9a8ab6ab8e00 x1875232130700416/t0(0) o3->f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008@192.168.203.60@tcp:534/0 lens 488/4536 e 0 to 0 dl 1788361484 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:100 00002000:00100000:0.0:1788361473.466352:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6ab8e00 with x1875232130700416 ext(0->4095) 00002000:00010000:0.0:1788361473.466356:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6ab8e00 00000100:00100000:2.0:1788361473.469887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.469935:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130700672 00000100:00100000:0.0:1788361473.469944:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130700672 00000100:00100000:0.0:1788361473.470000:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361473.470009:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+11:31523:x1875232130700672:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000001:00080000:1.0:1788361473.470341:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771176 00000100:00100000:1.0:1788361473.470443:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+13:31523:x1875232130700672:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 435us (564us total) trans 30064771177 rc 0/0 00000100:00100000:1.0:1788361473.470451:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000020:00080000:1.0:1788361473.470457:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788361473.473764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.473897:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130700928 00000100:00100000:1.0:1788361473.473907:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130700928 00000100:00100000:1.0:1788361473.473969:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:1.0:1788361473.473978:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:31523:x1875232130700928:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788361473.474412:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130700928:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 434us (660us total) trans 30064771178 rc 0/0 00000100:00100000:1.0:1788361473.474420:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:1.0:1788361473.477319:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361473.477456:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130701056 00000100:00100000:2.0:1788361473.477465:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130701056 00000100:00100000:2.0:1788361473.477522:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:2.0:1788361473.477533:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130701056:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361473.477561:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361473.477582:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66150a6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4b3 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.477670:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66150ad lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.477687:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66150ad lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.477711:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66150ad lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.477726:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66150b4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.477734:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66150b4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.477741:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66150b4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478018:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66150bb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478028:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66150bb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478035:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66150bb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361473.478069:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1788361473.478074:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361473.478130:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66150bb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478171:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66150bb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478180:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66150ad lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478186:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66150ad lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478192:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66150ad lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478198:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361473.478203:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66150ad lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478211:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66150ad lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478224:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361473.478227:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361473.478232:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66150ad lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478237:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66150ad lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478246:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66150b4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478250:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66150b4 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478258:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66150b4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478262:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361473.478263:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66150b4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478267:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66150b4 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478271:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361473.478272:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361473.478273:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66150b4 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478277:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66150b4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478300:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66150a6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4b3 expref: 22 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478309:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66150bb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4b3 expref: 21 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.478313:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361473.478315:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361473.478316:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:2.0:1788361473.478361:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:31523:x1875232130701056:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 831us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361473.478373:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:2.0:1788361473.480289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.480357:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130701312 00000100:00100000:1.0:1788361473.480365:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130701312 00000100:00100000:1.0:1788361473.480441:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:1.0:1788361473.480449:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+21:31523:x1875232130701312:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1788361473.480499:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788361473.480537:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66150bb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4b3 expref: 21 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.480570:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6615091 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f49e expref: 20 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.480591:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361473.480595:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361473.480617:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66150c2 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.480629:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66150c2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.480637:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66150c2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.480649:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.480654:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.480661:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.480919:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66150d0 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.480928:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66150d0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.480936:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66150d0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361473.481893:0:35345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].5, 64 off8560 00010000:00010000:1.0:1788361473.481955:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.481966:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.481975:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.481982:0:35345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.481988:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.481993:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482056:0:35345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361473.482079:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66150d0 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482103:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66150d0 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482110:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66150d0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482116:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.482119:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66150d0 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482134:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66150d0 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482154:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361473.482165:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788361473.482170:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66150d0 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482177:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66150d0 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xc:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482193:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66150c2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482199:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66150c2 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482203:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66150c2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482208:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.482210:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66150c2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482216:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66150c2 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482224:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361473.482226:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.482229:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66150c2 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.482249:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66150c2 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361473.482260:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000104a62d5 reply state 000000002be1d5df transno 30064771179 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.482261:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361473.482267:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.482267:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361473.482272:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361473.482275:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.482281:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.482289:0:35335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361473.482291:0:35335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361473.482293:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.482298:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66150d7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.482306:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361473.482308:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361473.482309:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361473.482337:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+21:31523:x1875232130701312:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 1887us (2054us total) trans 30064771179 rc 0/0 00000100:00100000:1.0:1788361473.482345:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 139 00010000:00010000:2.0:1788361473.483396:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.483408:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.483414:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.483431:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361473.483434:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.483441:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.483452:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xdddd5b93 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361473.483455:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361473.483458:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.483464:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d66150c9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xdddd5b93 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361473.484588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361473.485000:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130701568 00000100:00100000:3.0:1788361473.485010:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130701568 00000100:00100000:3.0:1788361473.485129:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 140 00000100:00100000:3.0:1788361473.485149:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:31523:x1875232130701568:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788361473.485177:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361473.485198:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d66150de lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4ba expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.485339:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66150e5 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.485355:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66150e5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.485367:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66150e5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.485396:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.485404:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.485423:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486282:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d66150f3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486294:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d66150f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486303:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d66150f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361473.486315:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788361473.486347:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66150e5 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486354:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66150e5 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486362:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66150e5 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486368:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361473.486372:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66150e5 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486391:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66150e5 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486623:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361473.486628:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361473.486635:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66150e5 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486641:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66150e5 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361473.486716:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000036c86d26 reply state 00000000fcf8080d transno 30064771180 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361473.486781:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788361473.486818:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d66150de lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4ba expref: 23 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486834:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d66150f3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4ba expref: 22 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.486841:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff9a8a827d7d00) 00010000:00010000:3.0:1788361473.486844:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788361473.486910:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca600, rc 0) 00000100:00100000:3.0:1788361473.486988:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+23:31523:x1875232130701568:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 1849us (2405us total) trans 30064771180 rc 0/0 00000100:00100000:3.0:1788361473.486997:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 140 00010000:00010000:1.0:1788361473.488713:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.488789:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.488796:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.488802:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcba00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.488806:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.488813:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.488829:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff9a8a827d7900) 00010000:00010000:1.0:1788361473.488832:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.488836:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.488925:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66150ec lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361473.574658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.574841:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130701824 00000100:00100000:1.0:1788361473.574859:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130701824 00000100:00100000:1.0:1788361473.574916:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361473.574927:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+22:31523:x1875232130701824:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788361473.575320:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+23:31523:x1875232130701824:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 394us (670us total) trans 30064771181 rc 0/0 00000100:00100000:1.0:1788361473.575329:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:2.0:1788361473.577515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.577601:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130702080 00000100:00100000:1.0:1788361473.577609:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130702080 00000100:00100000:1.0:1788361473.577662:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:1.0:1788361473.577671:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+23:31523:x1875232130702080:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:1.0:1788361473.577695:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361473.577718:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615101 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4c1 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.577837:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615108 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.577854:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615108 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.577867:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615108 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361473.577879:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788361473.577999:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615101 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4c1 expref: 26 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.578018:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615108 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4c1 expref: 25 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.578026:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff9a8a827d7d00) 00010000:00010000:1.0:1788361473.578029:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788361473.578032:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622800, rc 0) 00000100:00100000:1.0:1788361473.578131:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:31523:x1875232130702080:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 461us (622us total) trans 30064771182 rc 0/0 00000100:00100000:1.0:1788361473.578146:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:2.0:1788361473.630575:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.630686:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130702336 00000100:00100000:1.0:1788361473.630705:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130702336 00000100:00100000:1.0:1788361473.630775:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788361473.630784:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+25:31523:x1875232130702336:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788361473.631061:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:31523:x1875232130702336:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 277us (495us total) trans 30064771183 rc 0/0 00000100:00100000:1.0:1788361473.631068:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:2.0:1788361473.635887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361473.635944:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130702592 00000100:00100000:3.0:1788361473.635968:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130702592 00000100:00100000:3.0:1788361473.636068:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 142 00000100:00100000:3.0:1788361473.636080:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:31523:x1875232130702592:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:3.0:1788361473.636172:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788361473.636201:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615108 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4c1 expref: 26 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636223:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d66150f3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xe:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4ba expref: 25 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636234:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff9a8a827d7d00) 00010000:00010000:3.0:1788361473.636245:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361473.636268:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615116 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636282:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615116 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636292:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615116 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636305:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636312:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636317:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636422:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615124 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636436:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615124 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636443:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615124 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636799:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636808:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636816:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636823:0:35346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636830:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636836:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636857:0:35346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361473.636874:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615124 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636880:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615124 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636886:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615124 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636898:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361473.636902:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615124 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636910:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615124 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636918:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:3.0:1788361473.636921:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788361473.636924:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615124 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636930:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615124 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xe:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636943:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615116 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636948:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615116 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636954:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615116 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636959:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361473.636962:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615116 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636968:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615116 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.636982:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361473.636984:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361473.636988:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361473.636990:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.636992:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615116 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.637009:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361473.637010:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615116 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.637015:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361473.637022:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000826a231f reply state 000000000bc8a47f transno 30064771184 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.637025:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361473.637042:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361473.637047:0:36289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xe:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:0.0:1788361473.637051:0:36289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361473.637054:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.637061:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661512b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xe:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.637077:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361473.637079:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361473.637081:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361473.637154:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:31523:x1875232130702592:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 1075us (1274us total) trans 30064771184 rc 0/0 00000100:00100000:3.0:1788361473.637162:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 142 00010000:00010000:0.0:1788361473.639040:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.639055:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.639061:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.639067:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361473.639071:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.639077:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.639106:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x5e55773a (ffff9a8a827d7900) 00010000:00010000:0.0:1788361473.639110:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361473.639114:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.639120:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d661511d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x5e55773a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361473.640480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361473.640613:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130702848 00000100:00100000:0.0:1788361473.640624:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130702848 00000100:00100000:0.0:1788361473.640755:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:0.0:1788361473.640766:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+25:31523:x1875232130702848:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:0.0:1788361473.640793:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361473.640907:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615132 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4c8 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.641081:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615139 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.641115:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615139 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.641128:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615139 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.641155:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.641163:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.641169:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.642807:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615147 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.642822:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615147 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.642832:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615147 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361473.642846:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xf:0x0]: returning size 0 00010000:00010000:0.0:1788361473.642878:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615139 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.642885:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615139 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.642899:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615139 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.642905:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361473.642910:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615139 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.642917:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615139 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.642930:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361473.642933:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361473.642938:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615139 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.642945:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615139 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361473.642958:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006c4b1377 reply state 0000000092a47461 transno 30064771185 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361473.642969:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361473.643007:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615132 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4c8 expref: 28 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.643023:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615147 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4c8 expref: 27 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.643031:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:0.0:1788361473.643040:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788361473.643043:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f200, rc 0) 00000100:00100000:0.0:1788361473.643198:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+28:31523:x1875232130702848:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 2432us (3116us total) trans 30064771185 rc 0/0 00000100:00100000:0.0:1788361473.643208:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 143 00010000:00010000:1.0:1788361473.645066:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.645162:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.645171:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.645195:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.645199:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.645206:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.645223:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff9a8a90b43c00) 00010000:00010000:1.0:1788361473.645226:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.645333:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.645343:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615140 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361473.746591:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.746683:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130703104 00000100:00100000:1.0:1788361473.746692:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130703104 00000100:00100000:1.0:1788361473.746746:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:1.0:1788361473.746756:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:31523:x1875232130703104:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788361473.747160:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+28:31523:x1875232130703104:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 405us (578us total) trans 30064771186 rc 0/0 00000100:00100000:1.0:1788361473.747167:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:2.0:1788361473.749874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361473.750009:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130703360 00000100:00100000:3.0:1788361473.750019:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130703360 00000100:00100000:3.0:1788361473.750524:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:3.0:1788361473.750534:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+28:31523:x1875232130703360:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:3.0:1788361473.750560:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361473.750582:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615155 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4cf expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.750692:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d661515c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.750710:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d661515c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.750740:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d661515c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361473.750753:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0xf:0x0]: returning size 0 00010000:00010000:3.0:1788361473.750887:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615155 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4cf expref: 31 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.750907:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d661515c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4cf expref: 30 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361473.750916:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:3.0:1788361473.750919:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788361473.750923:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb800, rc 0) 00000100:00100000:3.0:1788361473.751026:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:31523:x1875232130703360:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 493us (1162us total) trans 30064771187 rc 0/0 00000100:00100000:3.0:1788361473.751034:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:0.0:1788361473.801169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.801409:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130703616 00000100:00100000:1.0:1788361473.801419:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130703616 00000100:00100000:1.0:1788361473.801515:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1788361473.801526:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+30:31523:x1875232130703616:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00100000:1.0:1788361473.801783:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:31523:x1875232130703616:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 250us (613us total) trans 30064771188 rc 0/0 00000100:00100000:1.0:1788361473.801805:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1788361473.804432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.804516:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130703872 00000100:00100000:1.0:1788361473.804525:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130703872 00000100:00100000:1.0:1788361473.804577:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:1.0:1788361473.804587:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:31523:x1875232130703872:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:1.0:1788361473.804733:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788361473.804762:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d661515c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xf:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4cf expref: 31 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.804785:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615147 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0xf:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4c8 expref: 30 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.804795:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff9a8a90b43200) 00010000:00010000:1.0:1788361473.804807:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361473.804832:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d661516a lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.804847:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d661516a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.804857:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d661516a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.804870:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.804877:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.804903:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805000:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615178 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805007:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615178 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805013:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615178 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805634:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805642:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805648:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805652:0:37122:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805658:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805665:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805720:0:37122:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361473.805741:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615178 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805754:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615178 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805761:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615178 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805767:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.805772:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615178 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805785:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615178 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805795:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:1.0:1788361473.805798:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788361473.805802:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615178 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805807:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615178 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0xf:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805824:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d661516a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.805834:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361473.805842:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.805849:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361473.805852:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.805866:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.805874:0:35334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xf:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:2.0:1788361473.805876:0:35334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361473.805879:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.805885:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d661517f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0xf:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.805901:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361473.805903:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361473.805904:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361473.805947:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d661516a lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805952:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d661516a lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805957:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361473.805965:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d661516a lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805971:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d661516a lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805978:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361473.805980:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361473.805983:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d661516a lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.805988:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d661516a lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361473.805997:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a44631a reply state 00000000877c719a transno 30064771189 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361473.806005:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361473.806082:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:31523:x1875232130703872:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 1496us (1657us total) trans 30064771189 rc 0/0 00000100:00100000:1.0:1788361473.806119:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:3.0:1788361473.809201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361473.809376:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130704128 00000100:00100000:2.0:1788361473.809386:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130704128 00000100:00100000:2.0:1788361473.809455:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 146 00000100:00100000:2.0:1788361473.809465:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:31523:x1875232130704128:12345-192.168.203.60@tcp:101:mmap_sanity.0 00010000:00010000:2.0:1788361473.809490:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361473.809512:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615186 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4d6 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.809701:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661518d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.809718:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661518d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.809730:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661518d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361473.809759:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788361473.809759:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.809770:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.809780:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.809786:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361473.809790:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.809798:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.809814:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x366f449e (ffff9a8984a32900) 00010000:00010000:0.0:1788361473.809817:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361473.809823:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361473.809829:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615171 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0x366f449e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.809913:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615186 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4d6 expref: 33 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.809931:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661518d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4d6 expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361473.809939:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff9a8984a32b00) 00010000:00010000:2.0:1788361473.809941:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361473.809944:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8000, rc 0) 00000100:00100000:2.0:1788361473.810005:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:31523:x1875232130704128:12345-192.168.203.60@tcp:101:mmap_sanity.0 Request processed in 541us (812us total) trans 30064771190 rc 0/0 00000100:00100000:2.0:1788361473.810013:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 146 00000100:00100000:0.0:1788361473.812850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361473.812924:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130704256 00000100:00100000:1.0:1788361473.812934:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130704256 00000100:00100000:1.0:1788361473.812998:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1788361473.813007:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+8:30910:x1875232130704256:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361473.813022:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361473.813063:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d661509f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4ac expref: 8 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361473.813116:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361473.813232:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:30910:x1875232130704256:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 225us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361473.813240:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:2.0:1788361474.464235:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361474.816736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361474.816837:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130704512 00000100:00100000:2.0:1788361474.816847:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130704512 00000100:00100000:2.0:1788361474.816927:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1788361474.816937:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:31523:x1875232130704512:12345-192.168.203.60@tcp:35:mmap_sanity.0 00000100:00080000:1.0:1788361474.817414:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361474.817453:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:31523:x1875232130704512:12345-192.168.203.60@tcp:35:mmap_sanity.0 Request processed in 516us (725us total) trans 30064771191 rc 0/0 00000100:00100000:2.0:1788361474.817462:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1788361474.821144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361474.821236:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130704768 00000100:00100000:0.0:1788361474.821247:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130704768 00000100:00100000:0.0:1788361474.821306:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:0.0:1788361474.821314:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:31523:x1875232130704768:12345-192.168.203.60@tcp:36:mmap_sanity.0 00010000:00010000:0.0:1788361474.821374:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788361474.821512:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661518d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4d6 expref: 33 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.821540:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841ee200/0xf6a94c97d6614960 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2c9 expref: 32 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.821552:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff9a8984a32b00) 00010000:00010000:0.0:1788361474.821570:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361474.821598:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661519b lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.821619:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661519b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.821630:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661519b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.821643:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.821650:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.821944:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822054:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66151a9 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822063:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66151a9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822071:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66151a9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822630:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822641:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822661:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822679:0:35345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822686:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822693:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822720:0:35345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361474.822743:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66151a9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822756:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66151a9 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822762:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66151a9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822768:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361474.822772:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66151a9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822781:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66151a9 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822791:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:0.0:1788361474.822794:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788361474.822799:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66151a9 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822804:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66151a9 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822819:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661519b lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822825:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661519b lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822831:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661519b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822836:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ee00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361474.822845:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661519b lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822851:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661519b lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822861:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361474.822863:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361474.822865:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661519b lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361474.822871:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d661519b lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361474.822881:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000622a6546 reply state 0000000091dc9bae transno 30064771192 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361474.822889:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361474.822971:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:31523:x1875232130704768:12345-192.168.203.60@tcp:36:mmap_sanity.0 Request processed in 1655us (1843us total) trans 30064771192 rc 0/0 00000100:00100000:0.0:1788361474.822980:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 147 00010000:00010000:1.0:1788361474.823120:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361474.823136:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.823143:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361474.823147:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.823154:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.823164:0:36289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361474.823166:0:36289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788361474.823169:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.823175:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66151b0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.823190:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361474.823192:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361474.823194:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361474.824710:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.824724:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.824745:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.824751:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ec00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361474.824754:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.824761:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.824772:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0xcf1d5a2f (ffff9a8a90b43400) 00010000:00010000:1.0:1788361474.824775:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361474.824779:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361474.824785:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66151a2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1:0x0].0xcf1d5a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361475.232317:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144213760:0@lo:400:kworker.0 00000100:00100000:2.0:1788361475.232344:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144214016:0@lo:400:kworker.0 00000100:00100000:0.0:1788361475.232418:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144213888:0@lo:400:kworker.0 00000004:00080000:1.0:1788361475.232494:0:35370:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 865247406725ns, next at 866247404532ns, rc = 0 00000100:00100000:3.0:1788361475.232504:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361475.232505:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361475.232577:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144214528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361475.232604:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361475.232630:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144214400:0@lo:400:kworker.0 00000100:00100000:2.0:1788361475.232650:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361475.232662:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144214272:0@lo:400:kworker.0 00000100:00100000:3.0:1788361475.232692:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361475.232710:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361475.232723:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144214144:0@lo:400:kworker.0 00000100:00100000:3.0:1788361475.232750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361475.232755:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144214016 00000100:00100000:0.0:1788361475.232762:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144214016 00000100:00100000:3.0:1788361475.232782:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144213760 00000100:00100000:3.0:1788361475.232793:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144213760 00000100:00100000:3.0:1788361475.232839:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788361475.232849:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144213760:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361475.232855:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361475.232863:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144214528 00000100:00100000:0.0:1788361475.232868:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144213888 00000100:00100000:2.0:1788361475.232870:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144214528 00000100:00100000:0.0:1788361475.232873:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144213888 00000100:00100000:1.0:1788361475.232887:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788361475.232900:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144214016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361475.232903:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144213760:12345-0@lo:400:kworker.0 Request processed in 54us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361475.232915:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361475.232916:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788361475.232916:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788361475.232930:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144214528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361475.232934:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144213888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361475.232958:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144214016:12345-0@lo:400:kworker.0 Request processed in 61us (456us total) trans 0 rc 0/0 00002000:00000024:2.0:1788361475.232962:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 1703936 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361475.232969:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788361475.232985:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3314:x1875232144213888:12345-0@lo:400:kworker.0 Request processed in 55us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361475.232994:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1788361475.233001:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361475.233011:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144214528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361475.233014:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144214272 00000100:00100000:3.0:1788361475.233020:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144214272 00000100:00100000:2.0:1788361475.233022:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788361475.233041:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b066300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144213888:0@lo:400:kworker.0 00000100:00100000:1.0:1788361475.233045:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144214528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361475.233061:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144214400 00000100:00100000:2.0:1788361475.233067:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144214400 00000100:00100000:1.0:1788361475.233067:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b065180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144214016:0@lo:400:kworker.0 00000100:00080000:0.0:1788361475.233077:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361475.233116:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144214144 00000100:00100000:2.0:1788361475.233121:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144214144 00000100:00100000:2.0:1788361475.233152:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788361475.233180:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361475.233189:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144214400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361475.233229:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144214400:12345-0@lo:400:kworker.0 Request processed in 42us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361475.233236:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788361475.233264:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b064380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144214400:0@lo:400:kworker.0 00000100:00100000:1.0:1788361475.233281:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788361475.233287:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144214144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361475.233320:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144214144:12345-0@lo:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361475.233326:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788361475.233331:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144214272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361475.233370:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144214272:12345-0@lo:400:kworker.0 Request processed in 210us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361475.233377:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788361475.233951:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b065c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144214272:0@lo:400:kworker.0 00000100:00100000:1.0:1788361475.233963:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b066680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144214144:0@lo:400:kworker.0 00000100:00100000:2.0:1788361475.233969:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b067100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144213760:0@lo:400:kworker.0 00010000:00010000:2.0:1788361475.488240:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788361475.744452:0:35368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 865759363491ns, next at 866759361118ns, rc = 0 00000100:00100000:3.0:1788361475.744481:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab710d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144214656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361475.744546:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361475.745004:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144214656 00000100:00100000:1.0:1788361475.745012:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144214656 00000100:00100000:1.0:1788361475.745073:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788361475.745082:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144214656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361475.745145:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3850371072 avail 3848273920 00000100:00100000:1.0:1788361475.745187:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144214656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361475.745194:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361475.746456:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab710d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144214656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361475.898732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361475.898892:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130704896 00000100:00100000:0.0:1788361475.898903:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130704896 00000100:00100000:0.0:1788361475.899033:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361475.899045:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+13:30909:x1875232130704896:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361475.899061:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0 00010000:00010000:0.0:1788361475.899368:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6614a9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f308 expref: 13 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.899392:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:0.0:1788361475.899404:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6614ae8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f31d expref: 12 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.899414:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x5:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:0.0:1788361475.899429:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6614fc6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f45f expref: 11 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.899440:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0xc:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:0.0:1788361475.899451:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6614dc7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f3ef expref: 10 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361475.899472:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788361475.899479:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x7:0x0].0x0 (ffff9a8984a32700) 00010000:00010000:0.0:1788361475.899497:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6614ce7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f39b expref: 9 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.899505:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x8:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:0.0:1788361475.899515:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6614ab7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f30f expref: 8 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.899524:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361475.899527:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361475.899583:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:30909:x1875232130704896:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 541us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361475.899590:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1788361475.902362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361475.902426:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130705024 00000100:00100000:1.0:1788361475.902434:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130705024 00000100:00100000:1.0:1788361475.903970:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1788361475.903986:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:30910:x1875232130705024:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361475.904021:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788361475.904061:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66148cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f29f expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361475.904099:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43700) 00010000:00010000:1.0:1788361475.904131:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d6614983 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f2d0 expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361475.904143:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361475.904165:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d66148aa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f298 expref: 30 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361475.904181:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:1.0:1788361475.904193:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661488e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f291 expref: 29 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361475.904203:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:1.0:1788361475.904209:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361475.904262:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:30910:x1875232130705024:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 281us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361475.904270:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1788361475.916468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361475.916863:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130705152 00000100:00100000:2.0:1788361475.916871:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130705152 00000100:00100000:2.0:1788361475.916990:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:2.0:1788361475.917001:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:31562:x1875232130705152:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:2.0:1788361475.917030:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361475.917057:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66151b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4dd expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.917206:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d66151be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.917223:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d66151be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.917237:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d66151be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361475.917441:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361475.917447:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361475.917562:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d66151be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.917594:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66151b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4dd expref: 30 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.917613:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d66151be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4dd expref: 29 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.917622:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361475.917625:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361475.917629:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9800, rc 0) 00000100:00100000:2.0:1788361475.917699:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:31562:x1875232130705152:12345-192.168.203.60@tcp:101:rm.0 Request processed in 699us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361475.917707:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:3.0:1788361475.920258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361475.920417:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130705280 00000100:00100000:0.0:1788361475.920424:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130705280 00000100:00100000:0.0:1788361475.920473:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:0.0:1788361475.920479:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:31562:x1875232130705280:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1788361475.920495:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361475.920510:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66151c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4e4 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.920613:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66151cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.920625:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66151cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.920644:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66151cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.920654:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66151d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.920659:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66151d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.920663:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66151d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.920973:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66151da lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.920981:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66151da lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.920988:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66151da lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361475.921028:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361475.921031:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361475.921050:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66151da lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921064:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66151cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921071:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66151cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921137:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66151cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921143:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361475.921148:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66151cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921158:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66151cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921170:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:0.0:1788361475.921174:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361475.921179:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66151cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921185:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66151cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921197:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66151d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921202:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66151d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921207:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66151d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921212:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361475.921215:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66151d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921231:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66151d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921239:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff9a8a90b43500) 00010000:00010000:0.0:1788361475.921242:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361475.921245:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66151d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921249:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66151d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921274:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66151c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4e4 expref: 31 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921283:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66151da lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4e4 expref: 30 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.921288:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:0.0:1788361475.921290:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361475.921291:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:0.0:1788361475.921340:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:31562:x1875232130705280:12345-192.168.203.60@tcp:101:rm.0 Request processed in 860us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361475.921346:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:0.0:1788361475.924472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361475.924551:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130705536 00000100:00100000:3.0:1788361475.924561:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130705536 00000100:00100000:3.0:1788361475.924615:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 150 00000100:00100000:3.0:1788361475.924624:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:31562:x1875232130705536:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:3.0:1788361475.924658:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361475.924679:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d66151e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4eb expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361475.924809:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788361475.925144:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d66151e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4eb expref: 32 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361475.925175:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:3.0:1788361475.925178:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361475.925182:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d66151e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4eb expref: 32 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361475.925195:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca800, rc 0) 00000100:00100000:3.0:1788361475.925253:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:31562:x1875232130705536:12345-192.168.203.60@tcp:101:rm.0 Request processed in 631us (789us total) trans 30064771193 rc 301/301 00000100:00100000:3.0:1788361475.925261:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 150 00000100:00100000:3.0:1788361475.928399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361475.928480:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130705664 00000100:00100000:2.0:1788361475.928489:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130705664 00000100:00100000:2.0:1788361475.928557:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788361475.928566:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:31562:x1875232130705664:12345-192.168.203.60@tcp:37:rm.0 00000100:00100000:1.0:1788361475.932431:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:31562:x1875232130705664:12345-192.168.203.60@tcp:37:rm.0 Request processed in 3856us (4031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361475.932449:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788361475.938164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361475.938452:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130705920 00000100:00100000:3.0:1788361475.938461:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130705920 00000100:00100000:1.0:1788361475.938635:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788361475.938649:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:31562:x1875232130705920:12345-192.168.203.60@tcp:35:rm.0 00000100:00100000:1.0:1788361475.939010:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:31562:x1875232130705920:12345-192.168.203.60@tcp:35:rm.0 Request processed in 364us (855us total) trans 30064771194 rc 0/0 00000100:00100000:1.0:1788361475.939018:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1788361475.941211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361475.941698:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130706176 00000100:00100000:2.0:1788361475.941708:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130706176 00000100:00100000:2.0:1788361475.941766:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:2.0:1788361475.941775:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:31562:x1875232130706176:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:2.0:1788361475.941835:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788361475.941864:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d66151da lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4e4 expref: 32 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.941884:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:2.0:1788361475.941904:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d66151be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4dd expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.941914:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361475.941921:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361475.941947:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66151ef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.941962:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66151ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.941972:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66151ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.941983:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.941989:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.942011:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.942470:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66151fd lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.942479:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66151fd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.942487:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66151fd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361475.943875:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1788361475.943893:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66151fd lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.943901:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66151fd lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.943909:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66151fd lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.943915:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361475.943920:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66151fd lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.943928:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66151fd lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.943941:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1:0x0].0x0 (ffff9a8a8beaeb00) 00010000:00010000:2.0:1788361475.943945:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788361475.943956:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66151fd lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.943962:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66151fd lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.943984:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66151ef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.943990:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66151ef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.943995:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66151ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.943999:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361475.944002:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66151ef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.944007:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66151ef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.944014:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:2.0:1788361475.944016:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361475.944019:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66151ef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361475.944030:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66151ef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361475.944043:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000eb69cfc5 reply state 000000009115ff7b transno 30064771195 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361475.944625:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361475.944720:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:31562:x1875232130706176:12345-192.168.203.60@tcp:36:rm.0 Request processed in 2942us (3513us total) trans 30064771195 rc 0/0 00000100:00100000:2.0:1788361475.944729:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 151 00010000:00010000:0.0:1788361475.946348:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.946376:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.946388:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.946402:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361475.946407:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.946415:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.946429:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x14aab1f5 (ffff9a8a8beaea00) 00010000:00010000:0.0:1788361475.946432:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361475.946437:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361475.946444:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66151f6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x14aab1f5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361476.512332:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361477.256759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361477.256798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361477.256829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361477.256857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361477.256882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361477.256883:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130706560 00000100:00100000:1.0:1788361477.256895:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130706560 00000100:00100000:3.0:1788361477.256900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361477.256925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361477.256950:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130707072 00000100:00100000:3.0:1788361477.256954:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130707072 00000100:00100000:1.0:1788361477.256955:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130706688 00000100:00100000:1.0:1788361477.256960:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130706688 00000100:00100000:3.0:1788361477.256982:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130706944 00000100:00100000:3.0:1788361477.256988:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130706944 00000100:00100000:1.0:1788361477.256992:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1788361477.257003:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130706560:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361477.257015:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1788361477.257025:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:2349:x1875232130707072:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361477.257081:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130706560:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361477.257121:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:2349:x1875232130707072:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361477.257135:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1788361477.257263:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130706304 00000100:00100000:2.0:1788361477.257277:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130706304 00000100:00100000:0.0:1788361477.257334:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130706816 00000100:00100000:0.0:1788361477.257341:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130706816 00000100:00100000:0.0:1788361477.257387:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130706432 00000100:00100000:0.0:1788361477.257389:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130706432 00000100:00100000:2.0:1788361477.257447:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:3.0:1788361477.258663:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1788361477.258675:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361477.258694:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1788361477.258696:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130706688:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361477.258705:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:2349:x1875232130706944:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361477.258751:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:2349:x1875232130706944:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 49us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361477.258758:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130706688:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 71us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361477.258762:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1788361477.258789:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361477.258907:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361477.258990:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:2349:x1875232130706816:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361477.259006:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00080000:1.0:1788361477.259031:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361477.259039:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361477.259042:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361477.259198:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+7:2349:x1875232130706816:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 344us (2310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361477.259206:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788361477.259349:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130706304:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361477.259506:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130706304:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 2050us (2754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361477.259517:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1788361477.260066:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130706432:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361477.260182:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130706432:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1265us (3298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361477.260207:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000001:00080000:1.0:1788361477.323253:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771084 is committed 00000001:00080000:1.0:1788361477.323276:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771085 is committed 00000001:00080000:1.0:1788361477.323288:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771083 is committed 00010000:00010000:1.0:1788361477.536339:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361478.562311:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788361478.854569:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771085 is committed 00000001:00080000:2.0:1788361478.854584:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771086 is committed 00000001:00080000:2.0:1788361478.854591:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771087 is committed 00000001:00080000:3.0:1788361478.863518:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771192 is committed 00000001:00080000:3.0:1788361478.863543:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771194 is committed 00000004:00080000:3.0:1788361478.863550:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:3.0:1788361478.863578:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771177 is committed 00000020:00080000:3.0:1788361478.863592:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8985b96180 refcount 2 committed 0 result 0 batchid 25769803894 00000020:00080000:3.0:1788361478.863597:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8aa9f1a600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8985b963c0 00000020:00080000:3.0:1788361478.863600:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a8698a200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8987247800 00000020:00080000:1.0:1788361478.863637:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803894 committed batchid 25769803892 00000020:00080000:1.0:1788361478.863846:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803892 00000020:00080000:3.0:1788361478.863918:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803893 batchid updated 00000001:00080000:3.0:1788361478.863931:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771195 is committed 00000004:00080000:3.0:1788361478.863946:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788361478.863955:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144214784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788361478.864036:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361478.866713:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144214784 00000100:00100000:3.0:1788361478.866732:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144214784 00000100:00100000:3.0:1788361478.866834:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788361478.866845:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144214784:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788361478.866946:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144214912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788361478.867031:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361478.867117:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144214784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 243us (3050us total) trans 30064771088 rc 0/0 00000100:00100000:3.0:1788361478.867125:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788361478.867146:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144214912 00000100:00100000:3.0:1788361478.867149:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144214912 00000100:00100000:0.0:1788361478.867242:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771086 gen 2 00000004:00080000:0.0:1788361478.867249:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771086 committed transno 30064771086 00000100:00100000:0.0:1788361478.867272:0:3313:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a898b060a80 x1875232144214784/t30064771088(30064771088) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788361494 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788361478.867285:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a898b060a80/2, rc 0, transno 30064771088 00000100:00100000:0.0:1788361478.867297:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144214784:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788361478.867344:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144215040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788361478.867381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361478.867633:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361478.867638:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361478.867824:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144215040 00000100:00100000:3.0:1788361478.867829:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144215040 00000100:00100000:3.0:1788361478.867843:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361478.867849:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144214912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788361478.867870:0:35980:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:195 count 1 00002000:00010000:3.0:1788361478.867911:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc3:0x0] initial LVB size: 409600, mtime: 0x6a983b00, atime: 0x6a983afd, ctime: 0x6a983b00, blocks: 0x403 00010000:00010000:3.0:1788361478.867920:0:35980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6615204 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.867937:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=868s v=(0 0) 00010000:00010000:3.0:1788361478.867942:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361478.867949:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6615204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.867966:0:35980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6615204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.867977:0:35980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6615204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.867996:0:35980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6615204 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.868021:0:35980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361478.868049:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361478.868057:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6615204 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361478.868067:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361478.868073:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6615204 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361478.868083:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6615204 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361478.868147:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6615204 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361478.868154:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a8ffe0/0xf6a94c97d6615204 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361478.868171:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361478.868173:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361478.868175:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361478.869406:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788361478.869420:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144215040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788361478.869448:0:35983:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:195 count 1 00002000:00010000:2.0:1788361478.869476:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc3:0x0] initial LVB size: 4096, mtime: 0x6a983b02, atime: 0x6a983b01, ctime: 0x6a983b02, blocks: 0xb 00010000:00010000:2.0:1788361478.869483:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661520b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361478.869497:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=868s v=(0 0) 00010000:00010000:2.0:1788361478.869587:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361478.869594:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661520b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361478.869608:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661520b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361478.869617:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661520b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361478.869626:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661520b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361478.869648:0:35983:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361478.869881:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788361478.869882:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144214912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2030us (2849us total) trans 30064771086 rc 0/0 00010000:00010000:1.0:1788361478.869889:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661520b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361478.869898:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361478.869903:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661520b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361478.869912:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661520b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361478.869928:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661520b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361478.869937:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661520b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361478.869953:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361478.869956:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361478.869957:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361478.870330:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361478.870390:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771084 gen 2 00000004:00080000:3.0:1788361478.870396:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a843ead80, transno 30064771082 00000004:00080000:3.0:1788361478.870416:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771084 committed transno 30064771084 00000100:00100000:3.0:1788361478.870437:0:3314:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a898b062a00 x1875232144214912/t30064771086(30064771086) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788361494 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788361478.870448:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a898b062a00/2, rc 0, transno 30064771086 00000100:00100000:3.0:1788361478.870452:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b062a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144214912:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788361478.870982:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144215040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1565us (3598us total) trans 30064771089 rc 0/0 00000100:00100000:2.0:1788361478.870991:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000004:00080000:1.0:1788361478.871144:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a898b061f80/2, rc 0, transno 30064771089 00000100:00100000:1.0:1788361478.871150:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b061f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144215040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788361478.888385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361478.888438:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130707200 00000100:00100000:3.0:1788361478.888448:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130707200 00000100:00100000:3.0:1788361478.888505:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00100000:3.0:1788361478.888516:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+5:31984:x1875232130707200:12345-192.168.203.60@tcp:101:lctl.0 00010000:00010000:3.0:1788361478.888536:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361478.888558:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4f2 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.888640:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615219 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.888665:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.888679:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361478.888858:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788361478.888863:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361478.888958:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.888986:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f2 expref: 7 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.889003:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f2 expref: 6 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361478.889012:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa900) 00010000:00010000:3.0:1788361478.889015:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361478.889019:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca400, rc 0) 00000100:00100000:3.0:1788361478.889076:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:31984:x1875232130707200:12345-192.168.203.60@tcp:101:lctl.0 Request processed in 562us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361478.889131:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00100000:3.0:1788361478.945470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361478.947231:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130707328 00000100:00100000:0.0:1788361478.947245:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130707328 00000100:00100000:0.0:1788361478.947321:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:0.0:1788361478.947338:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:31512:x1875232130707328:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788361478.947462:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:31512:x1875232130707328:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 131us (2001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361478.947470:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:2.0:1788361478.951205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361478.951921:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130707584 00000100:00100000:3.0:1788361478.951933:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130707584 00000100:00100000:3.0:1788361478.951995:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:3.0:1788361478.952008:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:31512:x1875232130707584:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361478.952712:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:31512:x1875232130707584:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 707us (1514us total) trans 30064771196 rc 0/0 00000100:00100000:3.0:1788361478.953204:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:3.0:1788361479.111043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361479.111245:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130707712 00000100:00100000:2.0:1788361479.111256:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130707712 00000100:00100000:2.0:1788361479.111337:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 154 00000100:00100000:2.0:1788361479.111350:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:32001:x1875232130707712:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:2.0:1788361479.111385:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788361479.111502:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788361479.111589:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615220 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f4f9 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361479.111685:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361479.111702:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361479.111716:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361479.111906:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361479.111912:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361479.112209:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361479.112237:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615220 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f9 expref: 7 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361479.112254:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f9 expref: 6 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361479.112263:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa900) 00010000:00010000:2.0:1788361479.112266:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361479.112270:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9c00, rc 0) 00000100:00100000:2.0:1788361479.112380:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:32001:x1875232130707712:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 1025us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361479.112388:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 154 00010000:00010000:2.0:1788361479.584285:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361480.352601:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144215168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361480.352683:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361480.352775:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144215168 00000100:00100000:2.0:1788361480.352799:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144215168 00000100:00100000:2.0:1788361480.352871:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788361480.352886:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144215168:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361480.352926:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144215552:0@lo:400:kworker.0 00002000:00000024:2.0:1788361480.352927:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 57868288 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361480.352968:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361480.352985:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144215168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361480.352995:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361480.352995:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361480.353007:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144215680:0@lo:400:kworker.0 00000100:00100000:1.0:1788361480.353038:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361480.353119:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144215296:0@lo:400:kworker.0 00000100:00080000:0.0:1788361480.353119:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361480.353152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361480.353172:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144215808:0@lo:400:kworker.0 00000100:00100000:3.0:1788361480.353196:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144215296 00000100:00100000:3.0:1788361480.353199:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144215296 00000100:00100000:3.0:1788361480.353223:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788361480.353230:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144215296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361480.353259:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144215296:12345-0@lo:400:kworker.0 Request processed in 31us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361480.353266:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788361480.353293:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144215424:0@lo:400:kworker.0 00000100:00100000:3.0:1788361480.353314:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361480.353344:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144215424 00000100:00100000:3.0:1788361480.353347:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144215424 00000100:00100000:3.0:1788361480.353380:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361480.353386:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144215424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361480.353416:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144215424:12345-0@lo:400:kworker.0 Request processed in 31us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361480.353431:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361480.353481:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144215424:0@lo:400:kworker.0 00000100:00100000:2.0:1788361480.353942:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144215168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361480.356068:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144215552 00000100:00100000:1.0:1788361480.356082:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144215552 00000100:00100000:1.0:1788361480.356163:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144215680 00000100:00100000:1.0:1788361480.356165:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144215680 00000100:00100000:1.0:1788361480.356190:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788361480.356197:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144215552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361480.356303:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788361480.356314:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144215680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361480.356341:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361480.356391:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144215296:0@lo:400:kworker.0 00000100:00100000:2.0:1788361480.356485:0:37122:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1788361480.356495:0:37122:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:3.0:1788361480.356820:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361480.356825:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361480.356840:0:35345:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788361480.356849:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144215808 00000100:00100000:3.0:1788361480.356852:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144215808 00000100:00100000:3.0:1788361480.356878:0:35345:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788361480.356885:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788361480.356891:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144215808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361480.356934:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144215808:12345-0@lo:400:kworker.0 Request processed in 43us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361480.356941:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788361480.356959:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361480.356976:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144215808:0@lo:400:kworker.0 00000100:00100000:3.0:1788361480.357561:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144215680:0@lo:400:kworker.0 00000100:00100000:3.0:1788361480.357576:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144215552:0@lo:400:kworker.0 00000100:00100000:0.0:1788361480.357834:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144215680:12345-0@lo:400:kworker.0 Request processed in 1522us (4793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361480.357843:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788361480.359995:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144215552:12345-0@lo:400:kworker.0 Request processed in 3789us (7018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361480.360009:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1788361480.608428:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361480.864628:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144215936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361480.864703:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361480.865982:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144215936 00000100:00100000:2.0:1788361480.865994:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144215936 00000100:00100000:2.0:1788361480.866056:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361480.866067:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144215936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361480.866141:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361480.866217:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144215936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (1515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361480.866224:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788361480.867953:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144215936:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788361481.079456:0:37589:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 5: Mmap 00000040:00080000:2.0:1788361481.632661:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361481.632671:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361481.632734:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 5 count 5 00000040:00080000:2.0:1788361481.632740:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361481.632928:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361482.014052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.014277:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130707840 00000100:00100000:3.0:1788361482.014286:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130707840 00000100:00100000:3.0:1788361482.014376:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 155 00000100:00100000:3.0:1788361482.014387:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:32261:x1875232130707840:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361482.014416:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361482.014448:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661522e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f500 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.014516:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615235 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.014532:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615235 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.014545:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615235 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.014559:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d661523c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.014565:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d661523c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.014571:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d661523c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.014970:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6615243 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.014981:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6615243 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.014988:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6615243 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361482.015072:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1788361482.015076:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361482.015216:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6615243 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015235:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615235 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015241:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615235 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015248:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615235 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015254:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.015259:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615235 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015267:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615235 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015282:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa900) 00010000:00010000:3.0:1788361482.015285:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361482.015290:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615235 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015296:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d6615235 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015307:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d661523c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015314:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d661523c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015319:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d661523c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015330:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.015334:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d661523c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015340:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d661523c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015348:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9a8a890fad00) 00010000:00010000:3.0:1788361482.015351:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361482.015353:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d661523c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015359:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d661523c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015393:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661522e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f500 expref: 9 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015407:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca600/0xf6a94c97d6615243 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f500 expref: 8 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.015414:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:3.0:1788361482.015417:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361482.015419:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca600, rc 0) 00000100:00100000:3.0:1788361482.015474:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:32261:x1875232130707840:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1089us (1431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.015482:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 155 00000100:00080000:0.0:1788361482.015940:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361482.021789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.021871:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130708096 00000100:00100000:3.0:1788361482.021893:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130708096 00000100:00100000:3.0:1788361482.021966:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 156 00000100:00100000:3.0:1788361482.021976:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+8:32261:x1875232130708096:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361482.022001:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361482.022021:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d661524a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f507 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022148:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615251 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022165:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615251 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022178:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615251 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022192:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615258 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022199:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615258 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022205:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615258 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022627:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d661525f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022637:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d661525f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022644:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d661525f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361482.022660:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788361482.022792:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615251 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022799:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615251 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022806:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615251 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022812:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.022816:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615251 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022823:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615251 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022836:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:3.0:1788361482.022839:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361482.022844:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615251 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022850:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615251 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022860:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615258 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022866:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615258 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022880:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615258 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022885:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.022888:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615258 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022894:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615258 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022901:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a890fad00) 00010000:00010000:3.0:1788361482.022903:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361482.022905:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615258 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.022911:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615258 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.023315:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d661524a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f507 expref: 11 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.023331:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca800/0xf6a94c97d661525f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f507 expref: 10 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.023339:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:3.0:1788361482.023342:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361482.023344:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca800, rc 0) 00000100:00100000:3.0:1788361482.023415:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+10:32261:x1875232130708096:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1440us (1635us total) trans 30064771197 rc 0/0 00000100:00100000:3.0:1788361482.023433:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 156 00000100:00100000:2.0:1788361482.029741:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.029801:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130708224 00000100:00100000:1.0:1788361482.029811:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130708224 00000100:00100000:1.0:1788361482.029875:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 157 00000100:00100000:1.0:1788361482.029886:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:32261:x1875232130708224:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788361482.029999:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:32261:x1875232130708224:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 114us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361482.030006:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 157 00000100:00100000:2.0:1788361482.141273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.141509:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130708480 00000100:00100000:3.0:1788361482.141520:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130708480 00000100:00100000:3.0:1788361482.141585:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:3.0:1788361482.141596:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:32275:x1875232130708480:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361482.141618:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361482.141625:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788361482.141654:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615219 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f2 expref: 10 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.141674:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa900) 00010000:00010000:3.0:1788361482.141679:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361482.141888:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d661526d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f50e expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.142384:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.142401:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f9 expref: 5 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.142410:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.142443:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f9 expref: 5 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.142457:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f9 expref: 5 pid: 35345 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.142481:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144216064:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361482.142581:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788361482.147381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.147616:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130708608 00000100:00100000:3.0:1788361482.147626:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130708608 00010000:00010000:3.0:1788361482.147685:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f9 expref: 6 pid: 35345 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.147729:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:3.0:1788361482.147738:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130708608:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361482.147754:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361482.147762:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f9 expref: 6 pid: 35345 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.147777:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f9 expref: 6 pid: 35345 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.147802:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa900) 00010000:00010000:3.0:1788361482.147809:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.147819:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.147826:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.147846:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361482.147924:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130708608:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 187us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.147932:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00080000:0.0:1788361482.148859:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788361482.150560:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615227 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f4f9 expref: 5 pid: 35345 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.150671:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144216064:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361482.150698:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.150710:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.150716:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.150785:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.150800:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.150811:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361482.153703:0:35345:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc4:0x0], index 0: 0 00010000:00010000:2.0:1788361482.153987:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154005:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154019:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154062:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154077:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154115:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154122:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361482.154127:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154135:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154150:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa900) 00010000:00010000:2.0:1788361482.154154:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361482.154160:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154166:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615274 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361482.154181:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bc36e6fe reply state 000000000ef1068e transno 30064771198 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.154190:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361482.154243:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d661526d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f50e expref: 12 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154265:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f50e expref: 11 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.154292:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361482.154294:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361482.154297:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8400, rc 0) 00000100:00100000:2.0:1788361482.154420:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:32275:x1875232130708480:12345-192.168.203.60@tcp:101:bash.0 Request processed in 12824us (13154us total) trans 30064771198 rc 0/0 00000100:00100000:2.0:1788361482.154430:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 158 00010000:00010000:1.0:1788361482.156878:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.156894:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.156902:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.156908:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361482.156925:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.156934:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.156962:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff9a8a8beae000) 00010000:00010000:1.0:1788361482.156966:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361482.156971:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.156976:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d661527b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.158032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.158142:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130708736 00000100:00100000:2.0:1788361482.158152:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130708736 00000100:00100000:2.0:1788361482.158217:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:2.0:1788361482.158227:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+5:2350:x1875232130708736:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361482.158244:0:35983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361482.158263:0:35983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6615290 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f515 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361482.158289:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361482.158310:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=872s v=(0 0) 00010000:00010000:2.0:1788361482.158315:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361482.158324:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6615290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f515 expref: 6 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.158342:0:35983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6615290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f515 expref: 6 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.158355:0:35983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361482.158426:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130708736:12345-192.168.203.60@tcp:101:bash.0 Request processed in 201us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.158434:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00080000:0.0:1788361482.158497:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361482.164279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.164440:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130708864 00000100:00100000:3.0:1788361482.164450:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130708864 00000100:00100000:3.0:1788361482.164551:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:3.0:1788361482.164561:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:32275:x1875232130708864:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361482.164581:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361482.164607:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f51c expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.164651:0:35980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6615290 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f515 expref: 7 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.164661:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361482.164666:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361482.164673:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 7 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.164708:0:35980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6615290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f515 expref: 7 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.164722:0:35980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6615290 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f515 expref: 7 pid: 35983 timeout: 972 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.164737:0:35980:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35980:1875232144216192:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361482.164839:0:35980:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361482.167531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.167659:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130708992 00000100:00100000:2.0:1788361482.167667:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130708992 00010000:00010000:2.0:1788361482.167706:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6615290 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f515 expref: 8 pid: 35983 timeout: 972 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.167732:0:35980:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35980:1875232144216192:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361482.167757:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00010000:00010000:0.0:1788361482.167766:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 3/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 8 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.167772:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130708992:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361482.167793:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361482.167800:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca400, rc 0) 00010000:00010000:2.0:1788361482.167818:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6615290 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f515 expref: 8 pid: 35983 timeout: 972 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.167833:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6615290 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f515 expref: 8 pid: 35983 timeout: 972 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.167860:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d6615290 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f515 expref: 8 pid: 35983 timeout: 972 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.167867:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:32275:x1875232130708864:12345-192.168.203.60@tcp:101:bash.0 Request processed in 3305us (3597us total) trans 0 rc 0/0 00010000:00010000:2.0:1788361482.167877:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:0.0:1788361482.167878:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00010000:00010000:2.0:1788361482.167886:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361482.167897:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 6 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.167908:0:35333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 6 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.167955:0:35333:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 6 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.167970:0:35333:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898764a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:35333:1875232144216320:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361482.168028:0:35333:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788361482.169741:0:35333:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898764a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:35333:1875232144216320:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361482.169764:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361482.169836:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130708992:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 2070us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361482.169843:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1788361482.172901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.172975:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130709248 00000100:00100000:1.0:1788361482.172983:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130709248 00000100:00100000:1.0:1788361482.173043:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:1.0:1788361482.173058:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+11:32275:x1875232130709248:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:1.0:1788361482.173448:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+12:32275:x1875232130709248:12345-192.168.203.60@tcp:35:bash.0 Request processed in 395us (555us total) trans 30064771199 rc 0/0 00000100:00100000:1.0:1788361482.173456:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:3.0:1788361482.230614:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.230722:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130709376 00000100:00100000:0.0:1788361482.230731:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130709376 00000100:00100000:0.0:1788361482.230795:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:0.0:1788361482.230805:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+12:32281:x1875232130709376:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361482.230832:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361482.230856:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661529e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f523 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.230934:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66152a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.230950:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66152a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.230978:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66152a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361482.231040:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361482.231045:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361482.231071:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66152a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.231244:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d661529e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f523 expref: 14 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.231266:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66152a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f523 expref: 13 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.231276:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:0.0:1788361482.231278:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361482.231282:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:0.0:1788361482.231344:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:32281:x1875232130709376:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 540us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.231351:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:2.0:1788361482.236886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.236997:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130709632 00000100:00100000:3.0:1788361482.237009:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130709632 00000100:00100000:3.0:1788361482.237069:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 160 00000100:00100000:3.0:1788361482.237113:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:32281:x1875232130709632:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361482.237147:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361482.237170:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66152ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f52a expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.237289:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66152b3 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.237306:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f50e expref: 14 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.237316:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66152b3 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.237506:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f50e expref: 14 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.237518:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f50e expref: 14 pid: 35345 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.237529:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144216448:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361482.237727:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84dab900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361482.240278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.240649:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130709760 00000100:00100000:0.0:1788361482.240658:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130709760 00010000:00010000:0.0:1788361482.240699:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f50e expref: 15 pid: 35345 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.240745:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1788361482.240754:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130709760:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361482.240787:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361482.240797:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f50e expref: 15 pid: 35345 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.240811:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f50e expref: 15 pid: 35345 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.240834:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:0.0:1788361482.240841:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66152b3 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.240851:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66152b3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.240859:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66152b3 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.240877:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361482.240934:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130709760:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 180us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.240941:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00010000:00010000:2.0:1788361482.241161:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615282 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f50e expref: 14 pid: 35345 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.241179:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144216448:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361482.241201:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66152b3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.241211:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66152b3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.241216:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66152b3 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361482.241236:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:2.0:1788361482.241415:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66152ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f52a expref: 15 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.241430:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66152b3 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f52a expref: 14 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.241452:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361482.241455:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788361482.241457:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcbc00, rc 0) 00000100:00100000:2.0:1788361482.241494:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:32281:x1875232130709632:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 4417us (4618us total) trans 30064771200 rc 0/0 00000100:00100000:2.0:1788361482.241501:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 160 00000100:00100000:3.0:1788361482.245417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.245613:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130710016 00000100:00100000:2.0:1788361482.245626:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130710016 00000100:00100000:2.0:1788361482.245723:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 161 00000100:00100000:2.0:1788361482.245733:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:32281:x1875232130710016:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361482.245761:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361482.245765:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361482.245796:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66152b3 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x10:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f52a expref: 14 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.245826:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361482.245839:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361482.245856:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d66152c1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f531 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.245974:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d66152c8 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.245990:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d66152c8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.246000:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d66152c8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361482.246027:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:2.0:1788361482.246200:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d66152c1 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f531 expref: 16 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.246218:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d66152c8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f531 expref: 15 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.246226:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:2.0:1788361482.246229:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361482.246231:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361482.246289:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+15:32281:x1875232130710016:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 557us (882us total) trans 30064771201 rc 0/0 00000100:00100000:2.0:1788361482.246297:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 161 00000100:00100000:3.0:1788361482.250622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.250708:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130710144 00000100:00100000:1.0:1788361482.250719:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130710144 00000100:00100000:1.0:1788361482.250785:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:1.0:1788361482.250820:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:32281:x1875232130710144:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361482.250849:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361482.250873:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66152d6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f538 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.250950:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66152d6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f538 expref: 16 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.251329:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66152d6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f538 expref: 16 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.251359:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:1.0:1788361482.251362:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361482.251367:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623800, rc 0) 00000100:00100000:1.0:1788361482.251440:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+16:32281:x1875232130710144:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 631us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361482.251447:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:3.0:1788361482.256335:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.257330:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130710272 00000100:00100000:2.0:1788361482.257350:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130710272 00000100:00100000:2.0:1788361482.257415:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:2.0:1788361482.257427:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130710272:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:2.0:1788361482.257482:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.257505:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 6 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.257515:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361482.257519:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361482.257524:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.257576:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 6 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.257593:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 6 pid: 35980 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.257618:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898764b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:35983:1875232144216576:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361482.257702:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361482.260857:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.260950:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898764b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:35983:1875232144216576:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361482.260977:0:35983:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.261201:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130710400 00000100:00100000:0.0:1788361482.261209:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130710400 00002000:00100000:0.0:1788361482.261257:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc4:0x0] (0->15) req@ffff9a8ab71b2680 x1875232130710400/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:543/0 lens 504/0 e 0 to 0 dl 1788361493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361482.261266:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b2680 with x1875232130710400 ext(0->15) 00010000:00010000:0.0:1788361482.261274:0:35986:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 7 pid: 35980 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.261307:0:35986:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 7 pid: 35980 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361482.261315:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8ab71b2680 00000100:00100000:0.0:1788361482.261351:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:0.0:1788361482.261361:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130710400:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:0.0:1788361482.262028:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+9:2349:x1875232130710400:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 665us (1177us total) trans 30064771087 rc 0/0 00000100:00100000:0.0:1788361482.262037:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00002000:00100000:0.0:1788361482.262053:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc4:0x0] (0->15) req@ffff9a8ab71b2680 x1875232130710400/t30064771087(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:543/0 lens 504/448 e 0 to 0 dl 1788361493 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361482.262062:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b2680 with x1875232130710400 ext(0->15) 00010000:00010000:0.0:1788361482.262068:0:35986:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 9 pid: 35980 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.262130:0:35986:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 9 pid: 35980 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361482.262146:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8ab71b2680 00000100:00100000:0.0:1788361482.266536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.266759:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130710528 00000100:00100000:1.0:1788361482.266771:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130710528 00010000:00010000:1.0:1788361482.266881:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 9 pid: 35980 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361482.266932:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:1.0:1788361482.266941:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8984bb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130710528:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361482.266956:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788361482.266976:0:35332:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb size from disk: 0 -> 16 00002000:00010000:1.0:1788361482.266980:0:35332:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb mtime from disk: 0 -> 1788361482 00002000:00010000:1.0:1788361482.266995:0:35332:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb atime from disk: 0 -> 1788361482 00002000:00010000:1.0:1788361482.266998:0:35332:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc4:0x0] updating lvb ctime from disk: 0 -> 1788361482 00010000:00010000:1.0:1788361482.267006:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 9 pid: 35980 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.267021:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 9 pid: 35980 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.267420:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615297 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f51c expref: 9 pid: 35980 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.267441:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361482.267445:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361482.267451:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.267462:0:35332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.267495:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361482.267605:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8984bb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130710528:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 656us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361482.267614:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00010000:00010000:2.0:1788361482.267768:0:35983:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.267778:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.267815:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.267824:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.267846:0:35983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.267854:0:35983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361482.267859:0:35983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.267867:0:35983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.267879:0:35983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.267885:0:35983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003627fb0/0xf6a94c97d66152dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.267936:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130710272:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 10511us (11608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.267945:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:3.0:1788361482.272723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.272828:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130710784 00000100:00100000:1.0:1788361482.272846:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130710784 00000100:00100000:1.0:1788361482.272924:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:1.0:1788361482.272935:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+16:32281:x1875232130710784:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:1.0:1788361482.273318:0:35348:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x10:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d66152c8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f531 expref: 16 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361482.273725:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771202 00000001:00080000:1.0:1788361482.273773:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771203 00000001:00080000:1.0:1788361482.274470:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771204 00010000:00010000:1.0:1788361482.275123:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.275145:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66152d6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f538 expref: 20 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.275155:0:35348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.275194:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66152d6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f538 expref: 20 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.275210:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66152d6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f538 expref: 20 pid: 35346 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361482.275405:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f586d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144216704:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361482.276526:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361482.278533:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f586d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144216704:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361482.278564:0:35348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.278951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.279234:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130710912 00000100:00100000:0.0:1788361482.279242:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130710912 00010000:00010000:0.0:1788361482.279275:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66152d6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f538 expref: 21 pid: 35346 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.279354:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:0.0:1788361482.279363:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+21:2349:x1875232130710912:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361482.279378:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361482.279386:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66152d6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f538 expref: 21 pid: 35346 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.279399:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66152d6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f538 expref: 21 pid: 35346 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.279419:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66152d6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f538 expref: 21 pid: 35346 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.279431:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:0.0:1788361482.279435:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.279443:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.279449:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.279479:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361482.279538:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+20:2349:x1875232130710912:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 175us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.279545:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00010000:00010000:3.0:1788361482.279596:0:35348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.279604:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361482.279735:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771205 00000001:00080000:3.0:1788361482.280005:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771206 00000100:00100000:3.0:1788361482.280160:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144216832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788361482.280214:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361482.280243:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361482.280263:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144216832 00000100:00100000:3.0:1788361482.280268:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144216832 00000100:00100000:3.0:1788361482.280322:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788361482.280329:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35348:x1875232144216832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788361482.280399:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35348:x1875232144216832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.280406:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788361482.280459:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361482.280588:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144216832:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788361482.281904:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771207 00000100:00100000:3.0:1788361482.281989:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144216960:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788361482.282047:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361482.282108:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788361482.282179:0:37379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144216960 00000100:00100000:0.0:1788361482.282191:0:37379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144216960 00000100:00100000:0.0:1788361482.282267:0:37379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788361482.282277:0:37379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:35348:x1875232144216960:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788361482.282450:0:37379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:35348:x1875232144216960:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 174us (402us total) trans 30064771088 rc 0/0 00000100:00100000:0.0:1788361482.282458:0:37379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788361482.282529:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144216960:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788361482.282579:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771208 00010000:00010000:3.0:1788361482.282615:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.282626:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.282634:0:35348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.282641:0:35348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.282645:0:35348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.282653:0:35348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.282680:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:3.0:1788361482.282683:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788361482.282689:0:35348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.282696:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66152e4 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361482.282923:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x11:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788361482.283001:0:35348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].6, 64 off8624 00000004:00080000:3.0:1788361482.283017:0:35348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 872297930469ns, next at 873297928907ns, rc = 0 00000001:00080000:3.0:1788361482.283023:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771209 00010000:00010000:3.0:1788361482.283053:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae600) 00010000:00010000:3.0:1788361482.283056:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788361482.283063:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d66152c8 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f531 expref: 24 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.283224:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+23:32281:x1875232130710784:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 10290us (10514us total) trans 30064771210 rc 0/0 00000100:00100000:3.0:1788361482.283231:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000020:00080000:3.0:1788361482.283235:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788361482.284875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.284941:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130711040 00000100:00100000:2.0:1788361482.284949:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130711040 00000100:00100000:2.0:1788361482.284999:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:2.0:1788361482.285007:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+23:32281:x1875232130711040:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361482.285030:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361482.285064:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66152eb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f53f expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.285180:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66152eb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f53f expref: 24 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.285196:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66152eb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f53f expref: 24 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.285218:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361482.285222:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361482.285226:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:2.0:1788361482.285280:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+24:32281:x1875232130711040:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 273us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.285286:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:2.0:1788361482.289503:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.289581:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130711296 00000100:00100000:1.0:1788361482.289592:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130711296 00000100:00100000:1.0:1788361482.290437:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:1.0:1788361482.290454:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+24:32281:x1875232130711296:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788361482.290709:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:32281:x1875232130711296:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 261us (1214us total) trans 30064771211 rc 0/0 00000100:00100000:1.0:1788361482.290718:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1788361482.362598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.362709:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130711424 00000100:00100000:2.0:1788361482.362719:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130711424 00000100:00100000:2.0:1788361482.362778:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 164 00000100:00100000:2.0:1788361482.362788:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+25:32291:x1875232130711424:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361482.363181:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66152f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363201:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66152f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363214:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66152f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363251:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66152f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363259:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66152f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363265:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66152f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363368:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363376:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363383:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361482.363430:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363444:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66152f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363452:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66152f2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363459:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66152f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363466:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361482.363470:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66152f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363485:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66152f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363497:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:2.0:1788361482.363500:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361482.363506:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66152f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363511:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66152f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363525:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66152f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363531:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66152f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363537:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66152f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363543:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361482.363546:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66152f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363551:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66152f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363557:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff9a8a8beae200) 00010000:00010000:2.0:1788361482.363560:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361482.363562:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66152f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363578:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66152f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363594:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363601:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363607:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363612:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361482.363615:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363621:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363629:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:2.0:1788361482.363631:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361482.363633:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.363639:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615300 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.363725:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+25:32291:x1875232130711424:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 937us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.363733:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 164 00000100:00100000:2.0:1788361482.378015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.378410:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.378442:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.378535:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130711552 00000100:00100000:3.0:1788361482.378545:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130711552 00000100:00100000:3.0:1788361482.378609:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:3.0:1788361482.378619:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130711552:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361482.378695:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130711552:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 77us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.378703:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:2.0:1788361482.379057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.379172:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130711680 00000100:00100000:0.0:1788361482.379177:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130711680 00000100:00100000:0.0:1788361482.379212:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130711808 00000100:00100000:0.0:1788361482.379215:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130711808 00000100:00100000:0.0:1788361482.379240:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361482.379248:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+5:2349:x1875232130711680:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361482.379290:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+5:2349:x1875232130711680:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 44us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.379297:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361482.379310:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361482.379316:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130711808:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361482.379337:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130711808:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 22us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.379343:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00080000:1.0:1788361482.379486:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361482.379490:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361482.379709:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130711936 00000100:00100000:3.0:1788361482.379714:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130711936 00000100:00080000:1.0:1788361482.379769:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361482.379800:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788361482.379807:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130711936:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361482.379876:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130711936:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 69us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.379882:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788361482.390939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.391188:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130712064 00000100:00100000:3.0:1788361482.391201:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130712064 00000100:00100000:3.0:1788361482.391330:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:3.0:1788361482.391340:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+25:32292:x1875232130712064:12345-192.168.203.60@tcp:101:mmap_cat.0 00010000:00010000:3.0:1788361482.391373:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361482.391407:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6615307 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f546 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391479:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661530e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391494:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661530e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391508:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661530e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391521:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615315 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391528:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391535:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391640:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661531c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391648:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661531c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391654:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661531c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361482.391694:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:3.0:1788361482.391700:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361482.391738:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661531c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391759:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661531c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391769:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661530e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391776:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661530e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391783:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661530e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391788:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.391793:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661530e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391799:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661530e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391812:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:3.0:1788361482.391815:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361482.391820:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661530e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391825:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661530e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391838:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615315 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391843:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615315 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391854:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615315 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391859:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.391862:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615315 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391868:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615315 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391876:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff9a8a890fad00) 00010000:00010000:3.0:1788361482.391878:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361482.391880:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615315 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391886:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615315 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391917:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6615307 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f546 expref: 27 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391930:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661531c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f546 expref: 26 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.391937:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:3.0:1788361482.391939:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361482.391941:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb200, rc 0) 00000100:00100000:3.0:1788361482.392232:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+26:32292:x1875232130712064:12345-192.168.203.60@tcp:101:mmap_cat.0 Request processed in 892us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.392249:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:1.0:1788361482.396552:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.396701:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130712320 00000100:00100000:0.0:1788361482.396711:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130712320 00000100:00100000:0.0:1788361482.396771:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:0.0:1788361482.396780:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+26:32292:x1875232130712320:12345-192.168.203.60@tcp:101:mmap_cat.0 00010000:00010000:0.0:1788361482.396803:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361482.396825:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615323 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f54d expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.396937:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661532a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.396954:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661532a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.396966:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661532a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361482.396978:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:0.0:1788361482.397182:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615323 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f54d expref: 29 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.397202:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661532a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f54d expref: 28 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.397211:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:0.0:1788361482.397214:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361482.397218:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f400, rc 0) 00000100:00100000:0.0:1788361482.397280:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+28:32292:x1875232130712320:12345-192.168.203.60@tcp:101:mmap_cat.0 Request processed in 501us (740us total) trans 30064771212 rc 0/0 00000100:00100000:0.0:1788361482.397300:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:0.0:1788361482.403987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.404023:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130712448 00000100:00100000:0.0:1788361482.404032:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130712448 00000100:00100000:0.0:1788361482.404557:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1788361482.404568:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+28:2352:x1875232130712448:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361482.404584:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361482.404610:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661532a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f54d expref: 28 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.404628:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:0.0:1788361482.404633:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361482.404684:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+27:2352:x1875232130712448:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 119us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.404691:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1788361482.407683:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.407723:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130712704 00000100:00100000:3.0:1788361482.407731:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130712704 00000100:00100000:3.0:1788361482.407772:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:3.0:1788361482.407780:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:32292:x1875232130712704:12345-192.168.203.60@tcp:35:mmap_cat.0 00000100:00100000:3.0:1788361482.408003:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:32292:x1875232130712704:12345-192.168.203.60@tcp:35:mmap_cat.0 Request processed in 223us (328us total) trans 30064771213 rc 0/0 00000100:00100000:3.0:1788361482.408011:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1788361482.420722:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.421021:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130712960 00000100:00100000:1.0:1788361482.421042:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130712960 00000100:00100000:1.0:1788361482.421131:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361482.421141:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+28:32293:x1875232130712960:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:1.0:1788361482.421157:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788361482.421186:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661531c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f546 expref: 28 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.421207:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66152eb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f53f expref: 27 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.421221:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beaed00) 00010000:00010000:1.0:1788361482.421235:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361482.421284:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:32293:x1875232130712960:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 145us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361482.421291:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1788361482.425234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.425362:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130713088 00000100:00100000:2.0:1788361482.425373:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130713088 00000100:00100000:2.0:1788361482.425436:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:2.0:1788361482.425446:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:32293:x1875232130713088:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:2.0:1788361482.425559:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615338 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.425578:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615338 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.425591:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615338 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361482.425859:0:35346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].5, 136 off8872 00000100:00100000:2.0:1788361482.425995:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:32293:x1875232130713088:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 549us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.426003:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 167 00000001:00080000:3.0:1788361482.435148:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771088 is committed 00000001:00080000:3.0:1788361482.435169:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771087 is committed 00000100:00100000:1.0:1788361482.443125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.443234:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130713216 00000100:00100000:3.0:1788361482.443244:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130713216 00000100:00100000:3.0:1788361482.443510:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:3.0:1788361482.443521:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+26:32295:x1875232130713216:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361482.443546:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361482.443570:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d661533f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f554 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.443778:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615346 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.443796:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.443809:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.443842:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661534d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.443851:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661534d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.443858:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661534d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.443970:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.443980:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.443988:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361482.444029:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:3.0:1788361482.444034:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361482.444055:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444069:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444116:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615346 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444124:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615346 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444142:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615346 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444149:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.444154:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615346 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444163:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615346 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444176:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:3.0:1788361482.444179:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361482.444184:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615346 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444191:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615346 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444205:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661534d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444212:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661534d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444218:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661534d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444223:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.444226:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661534d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444243:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661534d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444252:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff9a8a890fa300) 00010000:00010000:3.0:1788361482.444254:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361482.444258:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661534d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444332:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661534d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444443:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d661533f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f554 expref: 28 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444458:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f554 expref: 27 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.444466:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:3.0:1788361482.444469:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361482.444471:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb000, rc 0) 00000100:00100000:3.0:1788361482.444537:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+27:32295:x1875232130713216:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1018us (1471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.444545:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 168 00000040:00080000:0.0:1788361482.656460:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361482.656470:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361482.656518:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:0.0:1788361482.656524:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361482.656666:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b066300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144217088:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361482.656765:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86477a80 going to sleep for 11 seconds 00010000:00010000:3.0:1788361482.657140:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361482.662269:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b066300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144217088:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361482.669844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.669910:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130713344 00000100:00100000:2.0:1788361482.669921:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130713344 00000100:00100000:2.0:1788361482.669983:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:2.0:1788361482.669993:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:32306:x1875232130713344:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361482.670029:0:35345:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361482.670191:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:32306:x1875232130713344:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 193us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.670220:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:1.0:1788361482.678418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.678557:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130713472 00000100:00100000:0.0:1788361482.678568:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130713472 00000100:00100000:0.0:1788361482.678646:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:0.0:1788361482.678656:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:32306:x1875232130713472:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788361482.678736:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661535b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678756:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661535b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678770:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661535b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678792:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615362 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678800:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615362 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678806:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615362 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678837:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678846:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678853:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361482.678894:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:0.0:1788361482.678899:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361482.678913:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678931:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661535b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678938:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661535b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678945:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661535b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678951:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361482.678955:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661535b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678963:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661535b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678974:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:0.0:1788361482.678977:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361482.678982:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661535b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.678988:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d661535b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679000:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615362 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679006:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615362 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679012:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615362 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679021:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361482.679024:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615362 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679029:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615362 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679036:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x743283ca (ffff9a8a90b43b00) 00010000:00010000:0.0:1788361482.679038:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361482.679041:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615362 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679046:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615362 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x743283ca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679059:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679064:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679070:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679117:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361482.679121:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679128:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679145:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:0.0:1788361482.679148:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361482.679151:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.679487:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615369 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.679594:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:32306:x1875232130713472:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 939us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.679603:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:0.0:1788361482.691404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.691465:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130713728 00000100:00100000:3.0:1788361482.691474:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130713728 00000100:00100000:3.0:1788361482.691524:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:3.0:1788361482.691533:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+27:32306:x1875232130713728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361482.691562:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361482.691582:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6615370 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f55b expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.691688:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615377 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.691705:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615377 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.691755:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615377 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361482.691773:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:3.0:1788361482.691888:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615377 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.691897:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615377 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.691904:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615377 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.691911:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.691915:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615377 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.691924:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615377 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.691939:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:3.0:1788361482.691950:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361482.691957:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615377 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.691964:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615377 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.692006:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6615370 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f55b expref: 29 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.692016:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:3.0:1788361482.692018:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361482.692022:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d6615370 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f55b expref: 29 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.692032:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcba00, rc 0) 00000100:00100000:3.0:1788361482.692561:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+28:32306:x1875232130713728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1026us (1275us total) trans 30064771214 rc 301/301 00000100:00100000:3.0:1788361482.692570:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:0.0:1788361482.695869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.695949:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130713856 00000100:00100000:2.0:1788361482.695958:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130713856 00000100:00100000:2.0:1788361482.696015:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00100000:2.0:1788361482.696025:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:32306:x1875232130713856:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361482.696069:0:35346:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x10:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361482.699323:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:32306:x1875232130713856:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 3286us (3448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.699348:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00100000:2.0:1788361482.704129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.704168:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130714112 00000100:00100000:0.0:1788361482.704178:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130714112 00000100:00100000:0.0:1788361482.704246:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:0.0:1788361482.704257:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+28:32306:x1875232130714112:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361482.704282:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361482.704286:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788361482.704315:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66152a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f523 expref: 28 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.704333:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:0.0:1788361482.704353:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361482.704373:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615385 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f562 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361482.704794:0:37122:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc4:0x0], index 1: 0 00010000:00010000:0.0:1788361482.705013:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661538c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.705030:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661538c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.705041:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661538c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.705132:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615385 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f562 expref: 30 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.705153:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661538c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f562 expref: 29 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.705166:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:0.0:1788361482.705170:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361482.705172:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e200, rc 0) 00000100:00100000:0.0:1788361482.705235:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:32306:x1875232130714112:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 981us (1117us total) trans 30064771215 rc 0/0 00000100:00100000:0.0:1788361482.705244:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:1.0:1788361482.707775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.707831:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130714240 00000100:00100000:3.0:1788361482.707840:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130714240 00000100:00100000:3.0:1788361482.707943:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:3.0:1788361482.707954:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+29:32306:x1875232130714240:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361482.707979:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361482.708002:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d661539a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f569 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.708073:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66153a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.708136:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66153a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.708149:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66153a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361482.708207:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788361482.708211:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361482.708237:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66153a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.708277:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d661539a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f569 expref: 31 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.708293:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66153a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f569 expref: 30 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.708302:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:3.0:1788361482.708305:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361482.708308:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca200, rc 0) 00000100:00100000:3.0:1788361482.708365:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+30:32306:x1875232130714240:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 413us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.708372:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:1.0:1788361482.712534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.712693:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130714496 00000100:00100000:2.0:1788361482.712703:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130714496 00000100:00100000:2.0:1788361482.712872:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 175 00000100:00100000:2.0:1788361482.712884:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+30:32306:x1875232130714496:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361482.712947:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788361482.712977:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d661538c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f562 expref: 30 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.712999:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43500) 00010000:00010000:2.0:1788361482.713015:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66153a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f569 expref: 29 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713025:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:2.0:1788361482.713032:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361482.713061:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66153a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713290:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66153a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713302:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66153a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713315:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6481beca bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713322:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6481beca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713328:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6481beca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713476:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66153a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713483:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66153a8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713489:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66153a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713495:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361482.713500:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66153a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713508:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66153a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713516:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361482.713527:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361482.713532:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66153a8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713538:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66153a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713553:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6481beca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713559:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153af lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6481beca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713565:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6481beca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713569:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361482.713572:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153af lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6481beca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713578:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153af lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6481beca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713585:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6481beca (ffff9a8a8beaee00) 00010000:00010000:2.0:1788361482.713588:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361482.713590:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153af lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6481beca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.713595:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153af lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6481beca bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.713739:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:32306:x1875232130714496:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 856us (1214us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361482.713754:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 175 00000100:00100000:2.0:1788361482.717699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.717800:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130714624 00000100:00100000:0.0:1788361482.717811:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130714624 00000100:00100000:0.0:1788361482.717902:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 176 00000100:00100000:0.0:1788361482.717913:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+28:32306:x1875232130714624:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361482.717936:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361482.717968:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66153b6 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f570 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.718012:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.718028:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.718041:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.718184:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66153b6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f570 expref: 30 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.718205:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f570 expref: 29 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.718215:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:0.0:1788361482.718217:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361482.718221:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:0.0:1788361482.718276:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:32306:x1875232130714624:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 365us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.718283:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 176 00000100:00100000:1.0:1788361482.725740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.725806:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130714880 00000100:00100000:3.0:1788361482.725816:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130714880 00000100:00100000:3.0:1788361482.725873:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 177 00000100:00100000:3.0:1788361482.725883:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+29:32306:x1875232130714880:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788361482.725975:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.726003:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.726017:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361482.726984:0:37551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].6, 88 off8648 00000004:00080000:2.0:1788361482.727001:0:37551:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 872741914814ns, next at 873741911466ns, rc = 0 00000004:00010000:2.0:1788361482.727142:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d5d8340a reply state 00000000df5aae80 transno 30064771216 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.727154:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361482.727277:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+31:32306:x1875232130714880:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1392us (1544us total) trans 30064771216 rc 0/0 00000100:00100000:2.0:1788361482.727286:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 177 00010000:00010000:0.0:1788361482.731452:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.731472:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.731481:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.731496:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcba00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361482.731502:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.731511:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.731529:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:0.0:1788361482.731533:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788361482.731538:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.731545:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153c4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.733457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.733496:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130715008 00000100:00100000:2.0:1788361482.733506:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130715008 00000100:00100000:2.0:1788361482.733591:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00100000:2.0:1788361482.733602:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+30:32306:x1875232130715008:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361482.733628:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361482.733648:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153cb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f577 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.733715:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153cb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f577 expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.733733:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153cb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f577 expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.733754:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:2.0:1788361482.733765:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361482.733769:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9e00, rc 0) 00000100:00100000:2.0:1788361482.733822:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:32306:x1875232130715008:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 223us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.733829:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00100000:2.0:1788361482.738234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.739348:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130715136 00000100:00100000:3.0:1788361482.739359:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130715136 00000100:00100000:3.0:1788361482.739419:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:3.0:1788361482.739429:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+5:2349:x1875232130715136:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788361482.739723:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130715136:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 296us (1494us total) trans 30064771090 rc 0/0 00000100:00100000:3.0:1788361482.739732:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:2.0:1788361482.745265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.747956:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130715392 00000100:00100000:0.0:1788361482.747971:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130715392 00000100:00100000:0.0:1788361482.748029:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:0.0:1788361482.748038:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:32306:x1875232130715392:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361482.748359:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:32306:x1875232130715392:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 321us (3100us total) trans 30064771217 rc 0/0 00000100:00100000:0.0:1788361482.748367:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1788361482.753004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.753113:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130715648 00000100:00100000:3.0:1788361482.753122:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130715648 00000100:00100000:3.0:1788361482.753178:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00100000:3.0:1788361482.753190:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+32:32306:x1875232130715648:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788361482.753314:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+32:32306:x1875232130715648:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 126us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.753322:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00100000:1.0:1788361482.755313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.755649:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130715776 00000100:00100000:3.0:1788361482.755658:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130715776 00000100:00100000:3.0:1788361482.755742:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 180 00000100:00100000:3.0:1788361482.755752:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+32:32306:x1875232130715776:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361482.755774:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361482.755804:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66153d2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f57e expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.755881:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153d9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.755898:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153d9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.755911:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153d9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361482.755952:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361482.755974:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153d9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.756002:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66153d2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f57e expref: 34 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.756018:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153d9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f57e expref: 33 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.756024:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361482.756026:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788361482.756029:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcaa00, rc 0) 00000100:00100000:3.0:1788361482.756107:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+33:32306:x1875232130715776:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 325us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.756116:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 180 00000100:00100000:0.0:1788361482.759545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.759627:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130715904 00000100:00100000:1.0:1788361482.759637:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130715904 00000100:00100000:1.0:1788361482.759694:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:1.0:1788361482.759704:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130715904:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361482.759737:0:35983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361482.759757:0:35983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d66153e0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f585 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361482.759783:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983b0b, blocks: 0x1 00010000:00010000:1.0:1788361482.759804:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=872s v=(0 0) 00010000:00010000:1.0:1788361482.759809:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361482.759819:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d66153e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f585 expref: 7 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.759840:0:35983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d66153e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f585 expref: 7 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.759855:0:35983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623200, rc 0) 00000100:00100000:1.0:1788361482.760501:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130715904:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 795us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361482.760510:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:1.0:1788361482.764046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.764168:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130716160 00000100:00100000:0.0:1788361482.764177:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130716160 00000100:00100000:0.0:1788361482.764237:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:0.0:1788361482.764246:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:32306:x1875232130716160:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788361482.764361:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:32306:x1875232130716160:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 115us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.764370:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:3.0:1788361482.768161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.768237:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130716288 00000100:00100000:1.0:1788361482.768247:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130716288 00000100:00100000:1.0:1788361482.768303:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:1.0:1788361482.768313:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+7:32306:x1875232130716288:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361482.768332:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361482.768354:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f58c expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.768391:0:35982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d66153e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f585 expref: 8 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.768401:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361482.768406:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361482.768414:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 8 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.768449:0:35982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d66153e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f585 expref: 8 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.768465:0:35982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d66153e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f585 expref: 8 pid: 35983 timeout: 972 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361482.768495:0:35982:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:35982:1875232144217216:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361482.768586:0:35982:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361482.774285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.774352:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130716416 00000100:00100000:2.0:1788361482.774362:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130716416 00010000:00010000:2.0:1788361482.774405:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d66153e0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f585 expref: 9 pid: 35983 timeout: 972 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.774452:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1788361482.774459:0:35982:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:35982:1875232144217216:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361482.774464:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130716416:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361482.774483:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361482.774508:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d66153e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f585 expref: 9 pid: 35983 timeout: 972 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.774516:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 9 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.774529:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d66153e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f585 expref: 9 pid: 35983 timeout: 972 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.774610:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000c2a34b/0xf6a94c97d66153e0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f585 expref: 9 pid: 35983 timeout: 972 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.774612:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361482.774622:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361482.774634:0:35982:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 8 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.774646:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 8 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.774660:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361482.774697:0:35982:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 8 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.774713:0:35982:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:35982:1875232144217344:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361482.774721:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130716416:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 260us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.774735:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1788361482.774765:0:35982:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85244cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361482.779263:0:35982:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:35982:1875232144217344:192.168.203.60@tcp:105: 00010000:00010000:0.0:1788361482.779290:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622400, rc 0) 00000100:00100000:0.0:1788361482.779414:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+7:32306:x1875232130716288:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 11102us (11262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.779424:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:0.0:1788361482.784004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.784199:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130716544 00000100:00100000:1.0:1788361482.784209:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130716544 00002000:00100000:1.0:1788361482.784256:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc4:0x0] (0->15) req@ffff9a898b123800 x1875232130716544/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:543/0 lens 504/0 e 0 to 0 dl 1788361493 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361482.784267:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b123800 with x1875232130716544 ext(0->15) 00002000:00010000:1.0:1788361482.784273:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b123800 00000100:00100000:1.0:1788361482.784301:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:1.0:1788361482.784311:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130716544:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361482.784748:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b123800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130716544:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 436us (751us total) trans 30064771091 rc 0/0 00000100:00100000:1.0:1788361482.784756:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00002000:00100000:1.0:1788361482.784762:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc4:0x0] (0->15) req@ffff9a898b123800 x1875232130716544/t30064771091(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:543/0 lens 504/448 e 0 to 0 dl 1788361493 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361482.784770:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b123800 with x1875232130716544 ext(0->15) 00002000:00010000:1.0:1788361482.784774:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b123800 00000100:00100000:2.0:1788361482.791984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.792117:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130716672 00000100:00100000:1.0:1788361482.792126:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130716672 00000100:00100000:1.0:1788361482.792185:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 182 00000100:00100000:1.0:1788361482.792195:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:32306:x1875232130716672:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788361482.828004:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771217 is committed 00000020:00080000:3.0:1788361482.828043:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803894 batchid updated 00000004:00080000:3.0:1788361482.828063:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:2.0:1788361482.828083:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+23:32306:x1875232130716672:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 35874us (36093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.828115:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 182 00000004:00080000:3.0:1788361482.828126:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788361482.828146:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8ab76a5cc0 refcount 2 committed 0 result 0 batchid 25769803895 00000020:00080000:3.0:1788361482.828151:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a898afcf300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ab76a50c0 00000020:00080000:3.0:1788361482.828154:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a898afcf700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8abc8b3c00 00000020:00080000:1.0:1788361482.828852:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803895 committed batchid 25769803894 00000020:00080000:1.0:1788361482.829682:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803894 00000100:00100000:2.0:1788361482.830147:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144217472:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788361482.830211:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361482.830260:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361482.830267:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144217600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788361482.830296:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361482.830382:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144217472 00000100:00100000:1.0:1788361482.830390:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144217472 00000100:00080000:2.0:1788361482.830454:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361482.830454:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144217600 00000100:00100000:1.0:1788361482.830460:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144217600 00000100:00100000:1.0:1788361482.830497:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788361482.830507:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144217472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788361482.830523:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788361482.830535:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144217600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788361482.830556:0:35982:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:196 count 1 00002000:00010000:2.0:1788361482.830591:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc4:0x0] initial LVB size: 16, mtime: 0x6a983b0a, atime: 0x6a983b0a, ctime: 0x6a983b0a, blocks: 0xb 00010000:00010000:2.0:1788361482.830601:0:35982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d66153ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.830619:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=872s v=(0 0) 00010000:00010000:2.0:1788361482.830624:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361482.830632:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d66153ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.830647:0:35982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d66153ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361482.830658:0:35983:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb size from disk: 0 -> 16 00010000:00010000:2.0:1788361482.830671:0:35982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d66153ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361482.830676:0:35983:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb mtime from disk: 0 -> 1788361483 00002000:00010000:1.0:1788361482.830681:0:35983:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361482.830685:0:35983:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb ctime from disk: 1788361483 -> 1788361483 00010000:00010000:2.0:1788361482.830686:0:35982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d66153ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361482.830689:0:35983:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:2.0:1788361482.830711:0:35982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788361482.830738:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1875232144217472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (525us total) trans 30064771092 rc 0/0 00000100:00100000:1.0:1788361482.830747:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788361482.831292:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88447c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144217600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 759us (994us total) trans 30064771089 rc 0/0 00000100:00100000:2.0:1788361482.831299:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:2.0:1788361482.831439:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361482.831448:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d66153ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.831457:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361482.831462:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d66153ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.831471:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d66153ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.831490:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d66153ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.831498:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b58f8900/0xf6a94c97d66153ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.831520:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361482.831522:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361482.831524:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361482.831552:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771088 gen 2 00000004:00080000:2.0:1788361482.831559:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a898b062a00, transno 30064771086 00000004:00080000:2.0:1788361482.831573:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771088 committed transno 30064771088 00000100:00100000:2.0:1788361482.831593:0:3311:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8a8926d180 x1875232144217600/t30064771089(30064771089) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788361498 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788361482.831604:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a8926d180/2, rc 0, transno 30064771089 00000100:00100000:2.0:1788361482.831610:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144217600:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788361482.831627:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ab71b1500/2, rc 0, transno 30064771092 00000100:00100000:2.0:1788361482.831631:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144217472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788361482.833898:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.833939:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130716800 00000100:00100000:1.0:1788361482.833948:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130716800 00000100:00100000:1.0:1788361482.834028:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:1.0:1788361482.834038:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130716800:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788361482.868800:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771092 is committed 00000001:00080000:3.0:1788361482.868823:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771091 is committed 00000100:00100000:1.0:1788361482.868898:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130716800:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 34856us (35001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361482.868909:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:2.0:1788361482.874915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.875645:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130717056 00000100:00100000:3.0:1788361482.875658:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130717056 00000100:00100000:3.0:1788361482.875722:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 183 00000100:00100000:3.0:1788361482.875732:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+11:32306:x1875232130717056:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788361482.875792:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361482.875822:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153d9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f57e expref: 11 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.875842:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361482.875847:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361482.875880:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.875894:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.875905:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361482.876864:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079de3454 reply state 00000000464ad6d6 transno 30064771218 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.876879:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361482.877030:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+12:32306:x1875232130717056:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1297us (2122us total) trans 30064771218 rc 0/0 00000100:00100000:3.0:1788361482.877040:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 183 00000100:00100000:2.0:1788361482.883987:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361482.884155:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130717184 00000100:00100000:0.0:1788361482.884165:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130717184 00000100:00100000:0.0:1788361482.884218:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1788361482.884231:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130717184:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00010000:00010000:1.0:1788361482.884232:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.884247:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.884271:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.884277:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcba00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361482.884282:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.884290:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.884319:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:1.0:1788361482.884323:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361482.884329:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.884335:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66153f5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361482.884485:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb size from disk: 16 -> 16 00002000:00010000:0.0:1788361482.884489:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb mtime from disk: 1788361483 -> 1788361482 00002000:00010000:0.0:1788361482.884491:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb atime from disk: 0 -> 1788361482 00002000:00010000:0.0:1788361482.884493:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb ctime from disk: 1788361483 -> 1788361482 00002000:00010000:0.0:1788361482.884495:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788361482.884559:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130717184:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 330us (580us total) trans 30064771093 rc 0/0 00000100:00100000:0.0:1788361482.884566:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:1.0:1788361482.886920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.887001:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130717440 00000100:00100000:3.0:1788361482.887009:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130717440 00000100:00100000:3.0:1788361482.887280:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:3.0:1788361482.887291:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+11:32306:x1875232130717440:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788361482.887386:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.887406:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f570 expref: 11 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.887415:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.887451:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f570 expref: 11 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.887466:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f570 expref: 11 pid: 37122 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.887482:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144217728:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361482.887567:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5540 going to sleep for 11 seconds 00000100:00100000:3.0:1788361482.889561:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144217728:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361482.890611:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1788361482.890726:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.891557:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130717568 00000100:00100000:0.0:1788361482.891567:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130717568 00010000:00010000:0.0:1788361482.891666:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f570 expref: 12 pid: 37122 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.891716:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1788361482.891726:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130717568:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361482.891742:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361482.891750:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f570 expref: 12 pid: 37122 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.891763:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f570 expref: 12 pid: 37122 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.891790:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d66153bd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f570 expref: 12 pid: 37122 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.891807:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:0.0:1788361482.891812:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.891823:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.891832:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.891896:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361482.891963:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2350:x1875232130717568:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 240us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.891971:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00010000:00010000:3.0:1788361482.892791:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.892801:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.892833:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.892847:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.892854:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.892861:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcaa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.892865:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.892873:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.892887:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361482.892890:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788361482.892894:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.892900:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66153fc lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.892996:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:32306:x1875232130717440:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 5706us (6080us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788361482.893005:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:1.0:1788361482.897434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.897480:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130717696 00000100:00100000:1.0:1788361482.897501:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130717696 00000100:00100000:1.0:1788361482.897560:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:1.0:1788361482.897572:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130717696:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788361482.897621:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.897644:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 7 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.897662:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361482.897668:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361482.897673:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.897712:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 7 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.897728:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 7 pid: 35982 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361482.897746:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36286:1875232144217856:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361482.897844:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85678180 going to sleep for 11 seconds 00000100:00100000:2.0:1788361482.901151:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36286:1875232144217856:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361482.901184:0:36286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.901326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.901681:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130717824 00000100:00100000:2.0:1788361482.901689:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130717824 00010000:00010000:2.0:1788361482.901726:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 8 pid: 35982 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.901765:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:2.0:1788361482.901780:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130717824:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361482.901796:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361482.901821:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 8 pid: 35982 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.901836:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 8 pid: 35982 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.901863:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006daa39b9/0xf6a94c97d66153e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f58c expref: 8 pid: 35982 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.901947:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361482.901953:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361482.901961:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.901972:0:35332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.902007:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361482.902068:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130717824:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 286us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361482.902113:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00010000:00010000:3.0:1788361482.902118:0:36286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.902131:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.902170:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.902179:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.902187:0:36286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.902195:0:36286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361482.902199:0:36286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.902208:0:36286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.902221:0:36286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.902229:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a7db8cb/0xf6a94c97d6615403 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.902291:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130717696:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 4720us (4866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.902309:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:1.0:1788361482.904350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361482.904426:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130718080 00000100:00100000:2.0:1788361482.904618:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130718080 00000100:00100000:2.0:1788361482.904753:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00100000:2.0:1788361482.904764:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:32306:x1875232130718080:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788361482.904855:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661540a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.904873:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661540a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.904886:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661540a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.905156:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.905169:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153cb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f577 expref: 11 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.905179:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.905210:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153cb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f577 expref: 11 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.905226:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153cb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f577 expref: 11 pid: 35346 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.905241:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987649880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144217984:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361482.905317:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361482.907618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.907790:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130718208 00000100:00100000:3.0:1788361482.907799:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130718208 00010000:00010000:3.0:1788361482.907836:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153cb lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f577 expref: 12 pid: 35346 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.907876:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1788361482.907885:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8984bb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130718208:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361482.907901:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361482.907909:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153cb lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f577 expref: 12 pid: 35346 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.907924:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153cb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f577 expref: 12 pid: 35346 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.907950:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361482.907955:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.907965:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.907973:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.907992:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361482.908036:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8984bb7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130718208:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 152us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.908053:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00010000:00010000:2.0:1788361482.910483:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d66153cb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f577 expref: 11 pid: 35346 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361482.910522:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987649880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144217984:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361482.910547:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.910556:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361482.910563:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361482.910815:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771219 00000001:00080000:2.0:1788361482.910963:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771220 00000001:00080000:2.0:1788361482.911006:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771221 00000100:00100000:2.0:1788361482.911124:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987649880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35345:1875232144218112:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788361482.911183:0:35345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361482.911973:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f303c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361482.912022:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144218112 00000100:00100000:1.0:1788361482.912030:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144218112 00000100:00100000:3.0:1788361482.912205:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788361482.912217:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35345:x1875232144218112:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788361482.912352:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35345:x1875232144218112:12345-0@lo:1000:mdt00_000.0 Request processed in 137us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361482.912360:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788361482.912706:0:35345:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771092 gen 2 00000004:00080000:2.0:1788361482.912711:0:35345:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a898b060a80, transno 30064771088 00000004:00080000:2.0:1788361482.912759:0:35345:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a898b061f80, transno 30064771089 00000004:00080000:2.0:1788361482.913268:0:35345:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ab71b1500, transno 30064771092 00000100:00100000:2.0:1788361482.913279:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987649880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35345:1875232144218112:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788361482.913983:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771222 00000100:00100000:2.0:1788361482.914051:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987649880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35345:1875232144218240:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788361482.914274:0:35345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361482.914347:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361482.914937:0:37379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144218240 00000100:00100000:2.0:1788361482.914945:0:37379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144218240 00000100:00100000:2.0:1788361482.914990:0:37379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788361482.914999:0:37379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:35345:x1875232144218240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788361482.915243:0:37379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:35345:x1875232144218240:12345-0@lo:1000:mdt00_000.0 Request processed in 244us (968us total) trans 30064771094 rc 0/0 00000100:00100000:2.0:1788361482.915251:0:37379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788361482.915373:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987649880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35345:1875232144218240:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788361482.915524:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771223 00010000:00010000:3.0:1788361482.915558:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915570:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915578:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915584:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.915600:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915609:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915627:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361482.915630:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361482.915636:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915653:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615411 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x12:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915683:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615338 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915690:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615338 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915696:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615338 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915707:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361482.915710:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615338 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915716:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615338 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915725:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:3.0:1788361482.915727:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361482.915730:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615338 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915736:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615338 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915757:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915772:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f554 expref: 15 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915795:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915827:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f554 expref: 15 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.915846:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f554 expref: 15 pid: 37551 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361482.915860:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144218368:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361482.915989:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5300 going to sleep for 11 seconds 00000100:00100000:1.0:1788361482.921786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361482.921957:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144218368:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361482.921984:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.922043:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130718336 00000100:00100000:0.0:1788361482.922050:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130718336 00010000:00010000:0.0:1788361482.922196:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f554 expref: 16 pid: 37551 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361482.922234:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1788361482.922244:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+16:2349:x1875232130718336:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361482.922259:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361482.922266:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f554 expref: 16 pid: 37551 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.922278:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f554 expref: 16 pid: 37551 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.922302:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d6615354 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f554 expref: 16 pid: 37551 timeout: 972 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.922316:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:0.0:1788361482.922321:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.922331:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.922339:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361482.922362:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361482.922413:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130718336:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 170us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361482.922430:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00010000:00010000:1.0:1788361482.922646:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922654:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922667:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922680:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922687:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922693:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcaa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361482.922697:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922706:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922715:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:1.0:1788361482.922718:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361482.922722:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922727:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d6615418 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922738:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661540a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922744:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661540a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922750:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661540a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922754:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361482.922764:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661540a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922771:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661540a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922784:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:1.0:1788361482.922787:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361482.922791:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661540a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.922797:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d661540a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361482.923029:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:32306:x1875232130718080:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 18267us (18684us total) trans 30064771224 rc 0/0 00000100:00100000:1.0:1788361482.923038:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 185 00000020:00080000:1.0:1788361482.923042:0:35345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:0.0:1788361482.923268:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361482.923274:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361482.923304:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:0.0:1788361482.923310:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361482.927183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361482.927318:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130718592 00000100:00100000:1.0:1788361482.927330:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130718592 00000100:00100000:1.0:1788361482.927422:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:1.0:1788361482.927434:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:32306:x1875232130718592:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788361482.928208:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x12:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788361482.928331:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771225 00010000:00010000:1.0:1788361482.928379:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.928398:0:35348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.928411:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.928427:0:35348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.928434:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.928441:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361482.928465:0:35348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788361482.928553:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+16:32306:x1875232130718592:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1119us (1376us total) trans 30064771226 rc 0/0 00000100:00100000:1.0:1788361482.928562:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000020:00080000:1.0:1788361482.928569:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788361482.928671:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361482.928681:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.928689:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361482.928694:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.928703:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.928717:0:36289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x12:0x0].0x0 (ffff9a8984a32000) 00010000:00010000:3.0:1788361482.929420:0:36289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788361482.929429:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.929437:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d661541f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x12:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361482.929464:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361482.929466:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361482.929469:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361482.998379:0:37643:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361482.998390:0:37643:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361482.998453:0:37643:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:3.0:1788361482.998460:0:37643:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361483.097182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361483.097576:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130718720 00000100:00100000:2.0:1788361483.097585:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130718720 00000100:00100000:2.0:1788361483.097635:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 186 00000100:00100000:2.0:1788361483.097645:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+16:32316:x1875232130718720:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361483.097671:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361483.097696:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6615426 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f593 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.097765:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661542d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.097781:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661542d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.097796:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661542d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361483.097967:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361483.097972:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361483.098051:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661542d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.098106:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9e00/0xf6a94c97d6615426 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f593 expref: 18 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.098123:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661542d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f593 expref: 17 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.098139:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361483.098141:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361483.098145:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8200, rc 0) 00000100:00100000:2.0:1788361483.098201:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+17:32316:x1875232130718720:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 557us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361483.098208:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 186 00000100:00100000:0.0:1788361483.104259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361483.106788:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130718848 00000100:00100000:3.0:1788361483.106811:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130718848 00000100:00100000:3.0:1788361483.106868:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 187 00000100:00100000:3.0:1788361483.106880:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:32316:x1875232130718848:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788361483.107497:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615434 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.107519:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.107534:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.107553:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661543b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.107561:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661543b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.107580:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661543b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.107892:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.107903:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.107911:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361483.108047:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108061:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615434 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108068:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615434 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108100:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615434 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108107:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361483.108111:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615434 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108120:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615434 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108133:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:3.0:1788361483.108142:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361483.108148:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615434 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108155:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615434 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108166:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661543b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108173:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661543b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108178:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661543b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108184:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361483.108187:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661543b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108193:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661543b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108201:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff9a8a890fa400) 00010000:00010000:3.0:1788361483.108205:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361483.108207:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661543b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108213:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661543b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108230:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108242:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108247:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108253:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361483.108256:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108262:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108269:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8a890fa000) 00010000:00010000:3.0:1788361483.108271:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361483.108273:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361483.108280:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615442 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361483.108637:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:32316:x1875232130718848:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1756us (4382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361483.108647:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 187 00000100:00100000:2.0:1788361483.130863:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361483.131163:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130718976 00000100:00100000:1.0:1788361483.131172:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130718976 00000100:00100000:1.0:1788361483.131273:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:1.0:1788361483.131285:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:32317:x1875232130718976:12345-192.168.203.60@tcp:101:mmap_cat.0 00010000:00010000:1.0:1788361483.131309:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361483.131331:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615449 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f59a expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131402:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615450 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131419:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615450 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131431:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615450 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131460:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615457 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131467:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131474:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131777:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d661545e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131787:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d661545e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131794:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d661545e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361483.131836:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00000004:00200000:1.0:1788361483.131841:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361483.131866:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d661545e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131879:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d661545e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131889:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615450 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131896:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615450 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131913:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615450 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131919:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361483.131924:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615450 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131932:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615450 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131945:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:1.0:1788361483.131948:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361483.131953:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615450 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131959:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615450 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131972:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615457 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131977:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615457 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131983:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615457 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.131988:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361483.131991:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615457 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.132018:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615457 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.132027:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x35de2039 (ffff9a8984a32900) 00010000:00010000:1.0:1788361483.132037:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361483.132041:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615457 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.132047:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615457 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x35de2039 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.132126:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615449 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f59a expref: 19 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.132141:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622200/0xf6a94c97d661545e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f59a expref: 18 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361483.132149:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:1.0:1788361483.132152:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361483.132154:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622200, rc 0) 00000100:00100000:1.0:1788361483.132227:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+18:32317:x1875232130718976:12345-192.168.203.60@tcp:101:mmap_cat.0 Request processed in 944us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361483.132235:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:3.0:1788361483.137640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361483.138226:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130719104 00000100:00100000:2.0:1788361483.138237:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130719104 00000100:00100000:2.0:1788361483.138308:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:2.0:1788361483.138320:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130719104:12345-192.168.203.60@tcp:101:mmap_cat.0 00010000:00010000:2.0:1788361483.138342:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361483.138365:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615465 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5a1 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361483.138394:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc4:0x0] initial LVB size: 16, mtime: 0x6a983b0a, atime: 0x6a983b0a, ctime: 0x6a983b0a, blocks: 0xb 00010000:00010000:2.0:1788361483.138418:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=873s v=(0 0) 00010000:00010000:2.0:1788361483.138423:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361483.138435:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615465 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5a1 expref: 7 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.138457:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf58ba8c/0xf6a94c97d6615465 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5a1 expref: 7 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.138473:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9e00, rc 0) 00000100:00100000:2.0:1788361483.138553:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130719104:12345-192.168.203.60@tcp:101:mmap_cat.0 Request processed in 235us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361483.138563:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1788361483.147491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361483.147743:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130719360 00000100:00100000:2.0:1788361483.147754:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130719360 00000100:00100000:2.0:1788361483.147813:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:2.0:1788361483.147823:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+18:32317:x1875232130719360:12345-192.168.203.60@tcp:101:mmap_cat.0 00010000:00010000:2.0:1788361483.147848:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361483.147872:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d661546c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5a8 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.148013:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6615473 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.148042:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6615473 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.148056:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6615473 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361483.148070:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x10:0x0]: returning size 16 00010000:00010000:2.0:1788361483.148265:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d661546c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5a8 expref: 21 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.148288:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8c00/0xf6a94c97d6615473 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x10:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5a8 expref: 20 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361483.148298:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x10:0x0].0x0 (ffff9a8984a32500) 00010000:00010000:2.0:1788361483.148301:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788361483.148311:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8c00, rc 0) 00000100:00100000:2.0:1788361483.148384:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:32317:x1875232130719360:12345-192.168.203.60@tcp:101:mmap_cat.0 Request processed in 562us (902us total) trans 30064771227 rc 0/0 00000100:00100000:2.0:1788361483.148393:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:0.0:1788361483.154356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361483.157641:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130719488 00000100:00100000:2.0:1788361483.157654:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130719488 00002000:00100000:2.0:1788361483.157705:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc4:0x0] (0->4095) req@ffff9a898b120e00 x1875232130719488/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:544/0 lens 488/0 e 0 to 0 dl 1788361494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361483.157717:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b120e00 with x1875232130719488 ext(0->4095) 00002000:00010000:2.0:1788361483.157723:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b120e00 00000100:00100000:2.0:1788361483.157861:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:2.0:1788361483.157870:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130719488:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361483.158630:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130719488:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 758us (4281us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788361483.158638:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00002000:00100000:2.0:1788361483.158646:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc4:0x0] (0->4095) req@ffff9a898b120e00 x1875232130719488/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:544/0 lens 488/4536 e 0 to 0 dl 1788361494 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361483.158656:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b120e00 with x1875232130719488 ext(0->4095) 00002000:00010000:2.0:1788361483.158660:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b120e00 00010000:00010000:0.0:1788361483.680774:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361484.704408:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361485.472470:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144218496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361485.472540:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361485.472597:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144218624:0@lo:400:kworker.0 00000100:00100000:0.0:1788361485.472635:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361485.472778:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144218624 00000100:00100000:1.0:1788361485.472786:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144218624 00000100:00100000:1.0:1788361485.472835:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788361485.472844:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144218624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361485.472909:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144218624:12345-0@lo:400:kworker.0 Request processed in 66us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361485.472918:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788361485.473227:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144218496 00000100:00100000:3.0:1788361485.473232:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144218496 00000100:00100000:0.0:1788361485.473264:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987648700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144218624:0@lo:400:kworker.0 00000100:00100000:3.0:1788361485.473293:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788361485.473293:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144219136:0@lo:400:kworker.0 00000100:00100000:3.0:1788361485.473307:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144218496:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361485.473311:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144218752:0@lo:400:kworker.0 00000100:00100000:0.0:1788361485.473330:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788361485.473341:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361485.473356:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361485.473359:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361485.473367:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144219008:0@lo:400:kworker.0 00000100:00100000:2.0:1788361485.473388:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361485.473391:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144218496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361485.473398:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144218880:0@lo:400:kworker.0 00000100:00100000:0.0:1788361485.473400:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361485.473404:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361485.473435:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144219136 00000100:00100000:2.0:1788361485.473440:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361485.473441:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144219136 00000100:00080000:0.0:1788361485.473479:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361485.473485:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361485.473494:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144219008 00000100:00100000:2.0:1788361485.473499:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144219008 00000100:00100000:0.0:1788361485.473509:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144218880 00000100:00100000:0.0:1788361485.473515:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144218880 00000100:00100000:2.0:1788361485.473539:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788361485.473550:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144219136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361485.473820:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144219136:12345-0@lo:400:kworker.0 Request processed in 273us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361485.474081:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361485.474112:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144219008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361485.474310:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788361485.474321:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144218880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361485.474358:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144218880:12345-0@lo:400:kworker.0 Request processed in 40us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361485.474365:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788361485.474389:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144218752 00000100:00100000:3.0:1788361485.474393:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144218752 00000100:00100000:3.0:1788361485.474421:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361485.474427:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144218752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361485.474456:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144218752:12345-0@lo:400:kworker.0 Request processed in 30us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361485.474462:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788361485.474589:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144219008:0@lo:400:kworker.0 00000100:00100000:0.0:1788361485.474602:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144219008:12345-0@lo:400:kworker.0 Request processed in 41us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361485.474604:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144219136:0@lo:400:kworker.0 00000100:00100000:0.0:1788361485.474629:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788361485.474663:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361485.474667:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361485.474782:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144218880:0@lo:400:kworker.0 00000100:00100000:2.0:1788361485.474845:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788361485.477072:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144218496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361485.477425:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898764a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144218752:0@lo:400:kworker.0 00010000:00010000:1.0:1788361485.729579:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361485.984620:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361485.984645:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144219264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361485.984718:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361485.986706:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144219264 00000100:00100000:0.0:1788361485.986718:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144219264 00000100:00100000:0.0:1788361485.986769:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361485.986778:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144219264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361485.986823:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361485.986903:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144219264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361485.986910:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788361485.987006:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144219264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361486.171861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361486.172188:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130719616 00000100:00100000:0.0:1788361486.172197:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130719616 00000100:00100000:0.0:1788361486.172297:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00100000:0.0:1788361486.172307:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:32261:x1875232130719616:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788361486.172427:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:32261:x1875232130719616:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 121us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361486.172435:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00080000:1.0:1788361486.172491:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361486.174891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361486.174969:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130719872 00000100:00100000:0.0:1788361486.174977:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130719872 00000100:00100000:0.0:1788361486.175028:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1788361486.175037:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:32261:x1875232130719872:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361486.175537:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:32261:x1875232130719872:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 499us (651us total) trans 30064771228 rc 0/0 00000100:00100000:0.0:1788361486.175545:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:2.0:1788361486.322201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361486.322323:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130720000 00000100:00100000:0.0:1788361486.322333:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130720000 00000100:00100000:0.0:1788361486.322490:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 191 00000100:00100000:0.0:1788361486.322500:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:32757:x1875232130720000:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:0.0:1788361486.322523:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361486.322545:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6615481 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5af expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361486.322614:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361486.322629:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361486.322643:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361486.322830:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788361486.322835:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 12 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361486.322919:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361486.322947:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6615481 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5af expref: 7 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361486.322966:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5af expref: 6 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361486.322982:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:0.0:1788361486.322996:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361486.323000:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ee00, rc 0) 00000100:00100000:0.0:1788361486.323078:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:32757:x1875232130720000:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 576us (883us total) trans 0 rc 0/0 00000100:00080000:1.0:1788361486.323110:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361486.323125:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 191 00010000:00010000:0.0:1788361486.754299:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361487.495661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361487.495710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361487.495747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361487.495772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361487.495792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361487.495816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361487.495840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361487.495868:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130720384 00000100:00100000:3.0:1788361487.495877:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130720384 00000100:00100000:3.0:1788361487.495930:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130720896 00000100:00100000:3.0:1788361487.495933:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130720896 00000100:00100000:3.0:1788361487.495949:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130720512 00000100:00100000:3.0:1788361487.495952:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130720512 00000100:00100000:3.0:1788361487.495967:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130720768 00000100:00100000:3.0:1788361487.495970:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130720768 00000100:00100000:3.0:1788361487.495988:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361487.495998:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+5:2349:x1875232130720384:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361487.496081:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+5:2349:x1875232130720384:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 84us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361487.496119:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1788361487.496137:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:3.0:1788361487.496144:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130720896:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361487.496171:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130720896:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 27us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361487.496178:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:3.0:1788361487.496206:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788361487.496212:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130720512:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361487.496238:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130720512:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361487.496244:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788361487.496258:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:3.0:1788361487.496264:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130720768:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361487.496289:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130720768:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 24us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361487.496295:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:3.0:1788361487.496317:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130720640 00000100:00100000:3.0:1788361487.496320:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130720640 00000100:00100000:3.0:1788361487.496346:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130720256 00000100:00100000:3.0:1788361487.496349:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130720256 00000100:00100000:3.0:1788361487.496369:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1788361487.496375:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130720640:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361487.496403:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130720640:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361487.496409:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1788361487.496422:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:3.0:1788361487.496428:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+21:2349:x1875232130720256:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361487.496455:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+21:2349:x1875232130720256:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361487.496461:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361487.496915:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130720128 00000100:00100000:1.0:1788361487.496921:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130720128 00000100:00100000:1.0:1788361487.496957:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:1.0:1788361487.496965:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130720128:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361487.497168:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130720128:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 202us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361487.497175:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00080000:1.0:1788361487.497202:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361487.497206:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788361487.551548:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771089 is committed 00010000:00010000:2.0:1788361487.779222:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361487.977851:0:37840:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_6 skipping ALWAYS excluded test 6 00000001:00080000:1.0:1788361488.064419:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771093 is committed 00000001:00080000:1.0:1788361488.064439:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771094 is committed 00000001:00080000:3.0:1788361488.098952:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771228 is committed 00000020:00080000:3.0:1788361488.098979:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803895 batchid updated 00000020:00080000:3.0:1788361488.099009:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8aa9f30600 refcount 2 committed 0 result 0 batchid 25769803896 00000020:00080000:3.0:1788361488.099016:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a83e77200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a8352f9c0 00000020:00080000:3.0:1788361488.099019:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a83e77b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a898af5d400 00000020:00080000:0.0:1788361488.099685:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803896 committed batchid 25769803895 00000020:00080000:0.0:1788361488.100145:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803895 00010000:00010000:3.0:1788361488.800385:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788361488.830234:0:37889:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_7a skipping ALWAYS excluded test 7a 00000001:02000400:2.0:1788361489.648602:0:37938:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-pcc test_7b skipping ALWAYS excluded test 7b 00010000:00010000:0.0:1788361489.824662:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361490.592450:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144219776:0@lo:400:kworker.0 00000100:00100000:2.0:1788361490.592492:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144219520:0@lo:400:kworker.0 00000100:00100000:1.0:1788361490.592520:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361490.592547:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361490.592576:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788361490.592584:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144219392:0@lo:400:kworker.0 00000100:00100000:2.0:1788361490.592599:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144220032:0@lo:400:kworker.0 00000100:00100000:1.0:1788361490.592614:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361490.592635:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361490.592643:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144219904:0@lo:400:kworker.0 00000100:00100000:2.0:1788361490.592662:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361490.592671:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144219648:0@lo:400:kworker.0 00000100:00100000:1.0:1788361490.592672:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361490.592712:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361490.592714:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144219776 00000100:00100000:1.0:1788361490.592723:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144219776 00000100:00100000:2.0:1788361490.592753:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144219520 00000100:00100000:2.0:1788361490.592759:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144219520 00000100:00100000:1.0:1788361490.592770:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144220032 00000100:00100000:1.0:1788361490.592775:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144220032 00000100:00100000:1.0:1788361490.592801:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144219904 00000100:00100000:1.0:1788361490.592804:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144219904 00000100:00100000:2.0:1788361490.592821:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144219648 00000100:00100000:2.0:1788361490.592826:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144219648 00000100:00100000:1.0:1788361490.592832:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788361490.592844:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144219776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361490.592860:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788361490.592870:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144219520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361490.592906:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144219776:12345-0@lo:400:kworker.0 Request processed in 64us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361490.592914:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788361490.592925:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144219520:12345-0@lo:400:kworker.0 Request processed in 55us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361490.592934:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788361490.592935:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788361490.592945:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144220032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361490.592964:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788361490.592972:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144219648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361490.592994:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144220032:12345-0@lo:400:kworker.0 Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361490.593001:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788361490.593014:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144219648:12345-0@lo:400:kworker.0 Request processed in 42us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361490.593020:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788361490.593036:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788361490.593043:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144219904:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361490.593069:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361490.593074:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361490.593077:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361490.593082:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144219904:12345-0@lo:400:kworker.0 Request processed in 41us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361490.593120:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361490.593164:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144219392 00000100:00100000:1.0:1788361490.593168:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144219392 00000100:00100000:2.0:1788361490.593202:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771094 gen 2 00000004:00080000:2.0:1788361490.593208:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771094 committed transno 30064771094 00000100:00100000:2.0:1788361490.593226:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144219648:0@lo:400:kworker.0 00000100:00100000:2.0:1788361490.593236:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771089 gen 2 00000004:00080000:2.0:1788361490.593240:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a8926d180, transno 30064771089 00000100:00100000:2.0:1788361490.593251:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144219520:0@lo:400:kworker.0 00000100:00100000:2.0:1788361490.593259:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144220032:0@lo:400:kworker.0 00000100:00100000:2.0:1788361490.593273:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361490.593278:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144220160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361490.593303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361490.593329:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144220160 00000100:00100000:2.0:1788361490.593333:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144220160 00000100:00100000:2.0:1788361490.593358:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361490.593364:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144220160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361490.593390:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:1.0:1788361490.593413:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788361490.593424:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144219392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361490.593431:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144220160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361490.593439:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788361490.593464:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144219392:12345-0@lo:400:kworker.0 Request processed in 42us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361490.593477:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788361490.593489:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144220160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361490.593833:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144219392:0@lo:400:kworker.0 00000100:00100000:1.0:1788361490.593841:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144219904:0@lo:400:kworker.0 00000100:00100000:1.0:1788361490.593846:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144219776:0@lo:400:kworker.0 00000001:02000400:2.0:1788361490.633598:0:37986:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 8: Test fake -ENOSPC tolerance for RW-PCC ========================================================== 11:04:50 (1788361490) 00010000:00010000:2.0:1788361490.848315:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361491.104326:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361491.104336:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361491.104376:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 6 count 6 00000040:00080000:1.0:1788361491.104384:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361491.104649:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361491.104667:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144220288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361491.104735:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361491.104805:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144220288 00000100:00100000:2.0:1788361491.104813:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144220288 00000100:00100000:2.0:1788361491.104861:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361491.104870:0:35984:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788361491.104871:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144220288:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361491.104882:0:35984:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1788361491.104913:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788361491.104992:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144220288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361491.105000:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788361491.105104:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b122a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144220288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361491.334843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361491.335172:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130721152 00000100:00100000:2.0:1788361491.335181:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130721152 00000100:00100000:2.0:1788361491.335261:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 192 00000100:00100000:2.0:1788361491.335271:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:33433:x1875232130721152:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361491.335294:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361491.335315:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661548f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5b6 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.335396:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615496 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.335413:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615496 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.335427:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615496 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.335459:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d661549d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.335467:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d661549d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.335473:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d661549d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.335868:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66154a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.335878:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66154a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.335885:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66154a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361491.335896:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00000100:00080000:1.0:1788361491.336005:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788361491.336076:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615496 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336111:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615496 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336119:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615496 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336125:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361491.336130:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615496 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336148:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615496 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336160:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:2.0:1788361491.336163:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361491.336168:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615496 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336174:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d6615496 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336187:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d661549d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336192:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d661549d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336197:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d661549d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336202:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361491.336204:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d661549d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336209:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d661549d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336215:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a8beaea00) 00010000:00010000:2.0:1788361491.336218:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361491.336220:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d661549d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336234:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d661549d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336557:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d661548f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5b6 expref: 13 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336572:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66154a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5b6 expref: 12 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.336580:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361491.336582:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361491.336585:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9400, rc 0) 00000100:00100000:2.0:1788361491.336650:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:33433:x1875232130721152:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1380us (1815us total) trans 30064771229 rc 0/0 00000100:00100000:2.0:1788361491.336658:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 192 00000100:00100000:2.0:1788361491.340139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361491.340254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361491.340307:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130721408 00000100:00100000:1.0:1788361491.340317:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130721408 00000100:00100000:1.0:1788361491.340424:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1788361491.340434:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:2349:x1875232130721408:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361491.340450:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361491.340477:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66154a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5b6 expref: 12 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.340497:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:1.0:1788361491.340502:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361491.340575:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130721408:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 143us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361491.340583:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1788361491.340750:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130721280 00000100:00100000:0.0:1788361491.340754:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130721280 00000100:00100000:0.0:1788361491.340792:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:0.0:1788361491.340801:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+11:33433:x1875232130721280:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788361491.340878:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+11:33433:x1875232130721280:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 79us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361491.340885:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:0.0:1788361491.387221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361491.387349:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130721664 00000100:00100000:1.0:1788361491.387359:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130721664 00000100:00100000:1.0:1788361491.387473:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 194 00000100:00100000:1.0:1788361491.387496:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:33205:x1875232130721664:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788361491.387519:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361491.387523:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361491.387553:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661542d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f593 expref: 11 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.387574:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:1.0:1788361491.387579:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361491.387594:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d66154b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5bd expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.388048:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.388577:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5af expref: 5 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.388590:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.388627:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5af expref: 5 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.388643:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5af expref: 5 pid: 35345 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361491.388656:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144220416:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361491.388751:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ab76a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361491.391417:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144220416:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361491.391515:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361491.392447:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361491.392515:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130721792 00000100:00100000:3.0:1788361491.392522:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130721792 00010000:00010000:3.0:1788361491.392570:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5af expref: 6 pid: 35345 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361491.392610:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:3.0:1788361491.392619:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130721792:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361491.392637:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361491.392645:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5af expref: 6 pid: 35345 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.392657:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5af expref: 6 pid: 35345 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.392679:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615488 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5af expref: 6 pid: 35345 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.392713:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:3.0:1788361491.392718:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.392729:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.392737:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.392766:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361491.392813:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130721792:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 195us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361491.392820:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00010000:00010000:2.0:1788361491.392940:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.392950:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.392982:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.392995:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.393030:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361491.393618:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788361491.394749:0:35345:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc5:0x0], index 0: 0 00010000:00010000:2.0:1788361491.394998:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395013:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395043:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395117:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395125:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395132:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395138:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361491.395143:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395152:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395164:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361491.395167:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361491.395179:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395185:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d66154b9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361491.395198:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074b097d9 reply state 0000000037863101 transno 30064771230 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361491.395208:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361491.395246:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d66154b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5bd expref: 13 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395267:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5bd expref: 12 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.395274:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361491.395276:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361491.395279:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9c00, rc 0) 00000100:00100000:2.0:1788361491.395350:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:33205:x1875232130721664:12345-192.168.203.60@tcp:101:bash.0 Request processed in 7855us (8137us total) trans 30064771230 rc 0/0 00000100:00100000:2.0:1788361491.395359:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 194 00010000:00010000:2.0:1788361491.396808:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.396821:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.396829:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.396848:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361491.396851:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.396858:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.396874:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff9a8a8beaea00) 00010000:00010000:2.0:1788361491.396877:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361491.396880:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.396886:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154c0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361491.399010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361491.399300:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130721920 00000100:00100000:2.0:1788361491.399309:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130721920 00000100:00080000:1.0:1788361491.399441:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361491.399487:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1788361491.399498:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+5:33205:x1875232130721920:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361491.399518:0:35983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361491.399546:0:35983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5c4 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361491.399577:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361491.399611:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=881s v=(0 0) 00010000:00010000:2.0:1788361491.399616:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361491.399628:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.399666:0:35983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.399679:0:35983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361491.399787:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:33205:x1875232130721920:12345-192.168.203.60@tcp:101:bash.0 Request processed in 291us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361491.399794:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:0.0:1788361491.407568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361491.407718:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130722176 00000100:00100000:1.0:1788361491.407727:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130722176 00000100:00100000:1.0:1788361491.407784:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:1.0:1788361491.407794:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:33205:x1875232130722176:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:1.0:1788361491.408198:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:33205:x1875232130722176:12345-192.168.203.60@tcp:35:bash.0 Request processed in 404us (637us total) trans 30064771231 rc 0/0 00000100:00100000:1.0:1788361491.408206:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:0.0:1788361491.451422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361491.451620:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130722304 00000100:00100000:2.0:1788361491.451629:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130722304 00000100:00100000:2.0:1788361491.452053:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:2.0:1788361491.452064:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:33447:x1875232130722304:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361491.452123:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361491.452148:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5cb expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.452222:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66154e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.452244:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66154e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.452257:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66154e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361491.452318:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361491.452323:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361491.452349:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66154e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.452395:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5cb expref: 15 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.452414:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66154e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5cb expref: 14 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.452423:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:2.0:1788361491.452426:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361491.452429:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8200, rc 0) 00000100:00100000:2.0:1788361491.452499:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:33447:x1875232130722304:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 437us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361491.452506:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:3.0:1788361491.455231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361491.455949:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130722560 00000100:00100000:0.0:1788361491.455973:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130722560 00000100:00100000:0.0:1788361491.456041:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 196 00000100:00100000:0.0:1788361491.456051:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:33447:x1875232130722560:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361491.456073:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361491.456111:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66154ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5d2 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.456221:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66154f1 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.456238:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5bd expref: 15 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.456248:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66154f1 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.456633:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5bd expref: 15 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.456649:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5bd expref: 15 pid: 35345 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361491.456662:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b123100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144220544:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361491.456898:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361491.458634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361491.458748:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b123100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144220544:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361491.458777:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66154f1 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361491.458891:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130722688 00000100:00100000:3.0:1788361491.458898:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130722688 00010000:00010000:3.0:1788361491.458933:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5bd expref: 16 pid: 35345 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361491.459002:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:3.0:1788361491.459011:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+16:2349:x1875232130722688:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361491.459037:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361491.459054:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5bd expref: 16 pid: 35345 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.459101:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5bd expref: 16 pid: 35345 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.459125:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66154c7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5bd expref: 16 pid: 35345 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.459143:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:3.0:1788361491.459148:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66154f1 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.459158:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66154f1 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.459165:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66154f1 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.459248:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361491.459304:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130722688:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 293us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361491.459311:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00010000:00010000:0.0:1788361491.459457:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66154f1 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.459465:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66154f1 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361491.459485:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:0.0:1788361491.459630:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d66154ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5d2 expref: 16 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.459647:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66154f1 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5d2 expref: 15 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.459906:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:0.0:1788361491.459911:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361491.459914:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e600, rc 0) 00000100:00100000:0.0:1788361491.459982:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:33447:x1875232130722560:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 3933us (4762us total) trans 30064771232 rc 0/0 00000100:00100000:0.0:1788361491.459987:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 196 00000100:00100000:1.0:1788361491.462235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361491.462860:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130722944 00000100:00100000:2.0:1788361491.462869:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130722944 00000100:00100000:2.0:1788361491.462973:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:2.0:1788361491.462984:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+15:33447:x1875232130722944:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361491.463011:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361491.463027:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361491.463058:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d66154f1 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5d2 expref: 15 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.463078:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361491.463130:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361491.463148:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154ff lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5d9 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.463270:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615506 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.463285:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615506 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.463296:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615506 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361491.463309:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:2.0:1788361491.463437:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66154ff lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5d9 expref: 17 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.463453:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615506 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5d9 expref: 16 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.463460:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361491.463463:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361491.463465:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9400, rc 0) 00000100:00100000:2.0:1788361491.463526:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+16:33447:x1875232130722944:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 545us (1297us total) trans 30064771233 rc 0/0 00000100:00100000:2.0:1788361491.463534:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:3.0:1788361491.467266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361491.467542:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130723072 00000100:00100000:2.0:1788361491.467552:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130723072 00000100:00100000:2.0:1788361491.467607:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 198 00000100:00100000:2.0:1788361491.467617:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+16:33447:x1875232130723072:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361491.467643:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361491.467749:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615514 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5e0 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.467907:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615514 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e0 expref: 17 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.467923:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615514 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e0 expref: 17 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.467945:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:2.0:1788361491.467948:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361491.467952:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8600, rc 0) 00000100:00100000:2.0:1788361491.468057:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+17:33447:x1875232130723072:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 441us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361491.468065:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 198 00000100:00100000:0.0:1788361491.472688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361491.472762:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130723200 00000100:00100000:2.0:1788361491.472771:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130723200 00000100:00100000:2.0:1788361491.472833:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:2.0:1788361491.472843:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2351:x1875232130723200:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:2.0:1788361491.472890:0:35982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.472910:0:35982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.472919:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361491.472923:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361491.472928:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.472976:0:35982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 6 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.472991:0:35982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 6 pid: 35983 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361491.473006:0:35982:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:35982:1875232144220672:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361491.473137:0:35982:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361491.475121:0:35982:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:35982:1875232144220672:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361491.475147:0:35982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361491.476737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361491.476806:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130723328 00000100:00100000:1.0:1788361491.476827:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130723328 00002000:00100000:1.0:1788361491.476875:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc5:0x0] (0->5) req@ffff9a898b123480 x1875232130723328/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:552/0 lens 496/0 e 0 to 0 dl 1788361502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361491.476885:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b123480 with x1875232130723328 ext(0->5) 00010000:00010000:1.0:1788361491.476894:0:35988:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 7 pid: 35983 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.476921:0:35988:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 7 pid: 35983 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361491.476929:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a898b123480 00000100:00100000:1.0:1788361491.476975:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1788361491.476984:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130723328:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:1.0:1788361491.477452:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130723328:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 469us (721us total) trans 30064771090 rc 0/0 00000100:00100000:1.0:1788361491.477460:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00002000:00100000:1.0:1788361491.477467:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc5:0x0] (0->5) req@ffff9a898b123480 x1875232130723328/t30064771090(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:552/0 lens 496/448 e 0 to 0 dl 1788361502 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361491.477476:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b123480 with x1875232130723328 ext(0->5) 00010000:00010000:1.0:1788361491.477481:0:35988:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 9 pid: 35983 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.477493:0:35988:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 9 pid: 35983 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361491.477500:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a898b123480 00000100:00100000:1.0:1788361491.479643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361491.479703:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130723456 00000100:00100000:3.0:1788361491.479711:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130723456 00010000:00010000:3.0:1788361491.479743:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 9 pid: 35983 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361491.479781:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:3.0:1788361491.479791:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2352:x1875232130723456:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361491.479816:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788361491.479834:0:35332:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb size from disk: 0 -> 6 00002000:00010000:3.0:1788361491.479837:0:35332:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 1788361492 00002000:00010000:3.0:1788361491.479839:0:35332:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb atime from disk: 0 -> 1788361492 00002000:00010000:3.0:1788361491.479842:0:35332:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc5:0x0] updating lvb ctime from disk: 0 -> 1788361492 00010000:00010000:3.0:1788361491.479848:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 9 pid: 35983 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.479862:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 9 pid: 35983 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.479887:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088552a12/0xf6a94c97d66154d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5c4 expref: 9 pid: 35983 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.479904:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361491.479908:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361491.479914:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.479991:0:35332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.480035:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361491.480075:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2352:x1875232130723456:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 285us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361491.480127:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00010000:00010000:2.0:1788361491.480397:0:35982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.480410:0:35982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.480436:0:35982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.480444:0:35982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.480464:0:35982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.480472:0:35982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361491.480476:0:35982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.480937:0:35982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.480954:0:35982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.480962:0:35982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc25a85/0xf6a94c97d661551b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361491.481045:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+7:2351:x1875232130723200:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 8203us (8366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361491.481054:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:1.0:1788361491.483295:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361491.483361:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130723712 00000100:00100000:3.0:1788361491.483371:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130723712 00000100:00100000:3.0:1788361491.483428:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:3.0:1788361491.483438:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:33447:x1875232130723712:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:3.0:1788361491.483500:0:35348:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x13:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615506 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5d9 expref: 17 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361491.483853:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771234 00000001:00080000:3.0:1788361491.483901:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771235 00000001:00080000:3.0:1788361491.485033:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771236 00010000:00010000:3.0:1788361491.485143:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.485162:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615514 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e0 expref: 21 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.485172:0:35348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.485208:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615514 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e0 expref: 21 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.485223:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615514 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e0 expref: 21 pid: 37551 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361491.485238:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144220800:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361491.486277:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abfe23d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361491.488730:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144220800:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361491.488758:0:35348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361491.490888:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361491.491044:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130723840 00000100:00100000:0.0:1788361491.491054:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130723840 00010000:00010000:0.0:1788361491.491131:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615514 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e0 expref: 22 pid: 37551 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361491.491173:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:0.0:1788361491.491183:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+22:2350:x1875232130723840:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361491.491212:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361491.491220:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615514 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e0 expref: 22 pid: 37551 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.491234:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615514 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e0 expref: 22 pid: 37551 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.491256:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615514 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e0 expref: 22 pid: 37551 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.491273:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:0.0:1788361491.491278:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.491288:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.491296:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.491318:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361491.491373:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+21:2350:x1875232130723840:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 191us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361491.491381:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00010000:00010000:1.0:1788361491.491951:0:35348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.491960:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361491.492251:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771237 00000001:00080000:1.0:1788361491.492603:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771238 00000100:00100000:1.0:1788361491.492712:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144220928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788361491.492759:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361491.493246:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361491.493253:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144220928 00000100:00100000:3.0:1788361491.493261:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144220928 00000100:00100000:3.0:1788361491.493323:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788361491.493332:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144220928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788361491.493412:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144220928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361491.493420:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788361491.493585:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144220928:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788361491.494751:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771239 00000100:00100000:1.0:1788361491.494823:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144221056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788361491.494867:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361491.494954:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bda80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361491.494997:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144221056 00000100:00100000:2.0:1788361491.495003:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144221056 00000100:00100000:2.0:1788361491.495383:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788361491.495392:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144221056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788361491.495602:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35348:x1875232144221056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 211us (733us total) trans 30064771091 rc 0/0 00000100:00100000:2.0:1788361491.495623:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788361491.496478:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144221056:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788361491.496549:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771240 00010000:00010000:1.0:1788361491.496600:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.496610:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.496617:0:35348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.496622:0:35348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361491.496627:0:35348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.496635:0:35348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.496664:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:1.0:1788361491.496667:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788361491.496673:0:35348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.496679:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615522 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361491.496954:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x14:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788361491.497719:0:35348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].7, 64 off8688 00000004:00080000:1.0:1788361491.497732:0:35348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 881512646035ns, next at 882512643564ns, rc = 0 00000001:00080000:1.0:1788361491.497745:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771241 00010000:00010000:1.0:1788361491.497792:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a8beae500) 00010000:00010000:1.0:1788361491.497795:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788361491.497804:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615506 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5d9 expref: 25 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361491.498177:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+24:33447:x1875232130723712:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 14740us (14899us total) trans 30064771242 rc 0/0 00000100:00100000:1.0:1788361491.498187:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000020:00080000:1.0:1788361491.498193:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788361491.500680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361491.500868:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130723968 00000100:00100000:0.0:1788361491.500878:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130723968 00000100:00100000:0.0:1788361491.500927:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:0.0:1788361491.500937:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+24:33447:x1875232130723968:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361491.500978:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361491.501002:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615529 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5e7 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.501251:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615529 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e7 expref: 25 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.501268:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615529 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e7 expref: 25 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.501403:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361491.501406:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361491.501409:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:0.0:1788361491.501500:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+25:33447:x1875232130723968:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 563us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361491.501508:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:3.0:1788361491.504775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361491.504882:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130724224 00000100:00100000:0.0:1788361491.504892:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130724224 00000100:00100000:0.0:1788361491.504983:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1788361491.504997:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:33447:x1875232130724224:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361491.505287:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:33447:x1875232130724224:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 284us (512us total) trans 30064771243 rc 0/0 00000100:00100000:0.0:1788361491.505295:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:2.0:1788361491.559299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361491.559971:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130724352 00000100:00100000:1.0:1788361491.559981:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130724352 00000100:00100000:1.0:1788361491.560049:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:1.0:1788361491.560061:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:33457:x1875232130724352:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:1.0:1788361491.560188:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615530 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560221:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615530 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560234:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615530 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560248:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615537 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560254:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615537 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560261:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615537 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560362:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560371:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560378:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361491.560424:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560438:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615530 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560444:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615530 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560462:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615530 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560468:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361491.560472:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615530 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560480:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615530 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560491:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:1.0:1788361491.560495:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361491.560500:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560506:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560520:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615537 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560526:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615537 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560532:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615537 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560537:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361491.560540:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615537 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560556:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615537 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560565:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff9a8984a32f00) 00010000:00010000:1.0:1788361491.560568:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361491.560571:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615537 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560577:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615537 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560598:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560604:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560610:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560616:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361491.560618:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560625:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560632:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:1.0:1788361491.560634:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361491.560637:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.560656:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d661553e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361491.560738:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:33457:x1875232130724352:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 679us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361491.560746:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:2.0:1788361491.611819:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361491.611937:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130724608 00000100:00100000:3.0:1788361491.611947:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130724608 00000100:00100000:3.0:1788361491.612049:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:3.0:1788361491.612060:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+26:33464:x1875232130724608:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1788361491.612082:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361491.612133:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615545 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5ee expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612217:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661554c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612234:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661554c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612247:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661554c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612268:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615553 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612276:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612283:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612423:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612432:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612440:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361491.612452:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:3.0:1788361491.612665:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661554c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612673:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661554c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612680:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661554c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612685:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361491.612690:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661554c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612698:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661554c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612711:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:3.0:1788361491.612715:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361491.612720:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661554c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612736:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661554c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612749:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615553 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612754:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615553 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612761:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615553 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612766:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361491.612769:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615553 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612775:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615553 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612782:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff9a8a890fa700) 00010000:00010000:3.0:1788361491.612785:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361491.612788:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615553 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612794:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615553 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612848:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d6615545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5ee expref: 29 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612866:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5ee expref: 28 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.612872:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:3.0:1788361491.612873:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361491.612875:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca200, rc 0) 00000100:00100000:3.0:1788361491.612935:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+28:33464:x1875232130724608:12345-192.168.203.60@tcp:101:cat.0 Request processed in 877us (1125us total) trans 30064771244 rc 0/0 00000100:00100000:3.0:1788361491.612943:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:3.0:1788361491.616154:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361491.616613:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130724864 00000100:00100000:1.0:1788361491.616623:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130724864 00000100:00100000:1.0:1788361491.616684:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1788361491.616694:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+28:33464:x1875232130724864:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:1.0:1788361491.616979:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:33464:x1875232130724864:12345-192.168.203.60@tcp:35:cat.0 Request processed in 286us (832us total) trans 30064771245 rc 0/0 00000100:00100000:1.0:1788361491.616987:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:2.0:1788361491.682214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361491.682500:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130725120 00000100:00100000:0.0:1788361491.682510:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130725120 00000100:00100000:0.0:1788361491.682571:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 202 00000100:00100000:0.0:1788361491.682581:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:33476:x1875232130725120:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788361491.682644:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361491.682647:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788361491.682678:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66154e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5cb expref: 29 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.682700:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaea00) 00010000:00010000:0.0:1788361491.682713:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361491.682731:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615568 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5f5 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.682841:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.682857:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5ee expref: 29 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.682866:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.682911:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5ee expref: 29 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.682926:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5ee expref: 29 pid: 37551 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361491.682939:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144221184:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361491.683046:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361491.689036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361491.689120:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130725248 00000100:00100000:3.0:1788361491.689129:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130725248 00010000:00010000:3.0:1788361491.689169:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5ee expref: 30 pid: 37551 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361491.689211:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1788361491.689221:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8984bb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:2349:x1875232130725248:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361491.689237:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361491.689245:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5ee expref: 30 pid: 37551 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.689260:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5ee expref: 30 pid: 37551 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.689291:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:3.0:1788361491.689305:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.689316:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.689323:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361491.689344:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361491.689404:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8984bb5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:2349:x1875232130725248:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 184us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361491.689412:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00010000:00010000:0.0:1788361491.690483:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d661555a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5ee expref: 29 pid: 37551 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361491.690794:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144221184:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361491.690817:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.690828:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.690834:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361491.690855:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 6 00010000:00010000:0.0:1788361491.691026:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615568 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5f5 expref: 30 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.691050:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5f5 expref: 29 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.691058:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361491.691061:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361491.691064:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:0.0:1788361491.692575:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:33476:x1875232130725120:12345-192.168.203.60@tcp:101:bash.0 Request processed in 9986us (10360us total) trans 30064771246 rc 0/0 00000100:00100000:0.0:1788361491.692587:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 202 00000100:00100000:2.0:1788361491.694930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361491.695023:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130725504 00000100:00100000:1.0:1788361491.695034:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130725504 00000100:00100000:1.0:1788361491.695183:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:1.0:1788361491.695193:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:33476:x1875232130725504:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:1.0:1788361491.695485:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.695506:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.695520:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361491.695591:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771247 00000004:00010000:1.0:1788361491.695631:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004cfa5a2c reply state 000000005f11c28c transno 30064771248 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361491.695641:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361491.695807:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:33476:x1875232130725504:12345-192.168.203.60@tcp:36:bash.0 Request processed in 614us (884us total) trans 30064771248 rc 0/0 00000100:00100000:1.0:1788361491.695815:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 203 00000020:00080000:1.0:1788361491.695820:0:35345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788361491.698134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1788361491.698317:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.698332:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.698355:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.698361:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361491.698366:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.698375:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.698395:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361491.698398:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361491.698404:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.698410:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661557d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361491.698880:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130725632 00000100:00100000:2.0:1788361491.698960:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130725632 00000100:00100000:2.0:1788361491.699055:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:2.0:1788361491.699063:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:33476:x1875232130725632:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361491.699112:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361491.699133:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615584 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f5fc expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.699235:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.699255:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5f5 expref: 32 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.699265:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.699361:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5f5 expref: 32 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.699373:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5f5 expref: 32 pid: 35347 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361491.699395:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b062a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144221312:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361491.699474:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361491.701954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361491.702417:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b062a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144221312:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361491.702443:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361491.702519:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130725760 00000100:00100000:0.0:1788361491.702634:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130725760 00010000:00010000:0.0:1788361491.702683:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5f5 expref: 33 pid: 35347 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361491.702719:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:0.0:1788361491.702735:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+33:2350:x1875232130725760:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361491.702749:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361491.702756:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5f5 expref: 33 pid: 35347 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.702785:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5f5 expref: 33 pid: 35347 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.702806:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d661556f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x13:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5f5 expref: 33 pid: 35347 timeout: 981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.702830:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361491.702834:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.702844:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.702852:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.702872:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361491.702902:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.702912:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361491.702922:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+32:2350:x1875232130725760:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 187us (975us total) trans 0 rc 0/0 00000004:00200000:2.0:1788361491.702961:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00000004:00200000:2.0:1788361491.702966:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361491.702988:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361491.703037:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00010000:00010000:2.0:1788361491.703993:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615584 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5fc expref: 32 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.704029:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5fc expref: 31 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361491.704038:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:2.0:1788361491.704041:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361491.704044:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:2.0:1788361491.704106:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:33476:x1875232130725632:12345-192.168.203.60@tcp:101:bash.0 Request processed in 5042us (5983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361491.704125:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:3.0:1788361491.712964:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361491.713081:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130726016 00000100:00100000:0.0:1788361491.713124:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130726016 00000100:00100000:0.0:1788361491.713198:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1788361491.713209:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:33476:x1875232130726016:12345-192.168.203.60@tcp:103:bash.0 00010000:00010000:0.0:1788361491.713226:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788361491.713256:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661558b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5fc expref: 31 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.713297:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615529 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f5e7 expref: 30 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.713308:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361491.713319:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361491.713388:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:33476:x1875232130726016:12345-192.168.203.60@tcp:103:bash.0 Request processed in 181us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361491.713395:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1788361491.715186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361491.716567:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130726144 00000100:00100000:0.0:1788361491.716579:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130726144 00000100:00100000:0.0:1788361491.716647:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:0.0:1788361491.716656:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:33476:x1875232130726144:12345-192.168.203.60@tcp:58:bash.0 00010000:00010000:0.0:1788361491.716768:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.716788:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361491.716802:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361491.717163:0:35347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].6, 136 off9008 00000100:00100000:0.0:1788361491.717253:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:33476:x1875232130726144:12345-192.168.203.60@tcp:58:bash.0 Request processed in 598us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361491.717262:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:3.0:1788361491.720071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361491.720191:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130726272 00000100:00100000:1.0:1788361491.720200:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130726272 00000100:00100000:1.0:1788361491.720257:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 206 00000100:00100000:1.0:1788361491.720296:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:33476:x1875232130726272:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788361491.720318:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361491.720339:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615599 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f603 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.720402:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.720418:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615599 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f603 expref: 30 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.720437:0:35345:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.720451:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615599 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f603 expref: 30 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.720464:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:1.0:1788361491.720479:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361491.720483:0:35345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615599 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f603 expref: 30 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361491.720491:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623200, rc 0) 00000100:00100000:1.0:1788361491.720816:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+30:33476:x1875232130726272:12345-192.168.203.60@tcp:101:bash.0 Request processed in 529us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361491.720825:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 206 00010000:00010000:3.0:1788361491.873151:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361492.128340:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361492.128349:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361492.128390:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:1.0:1788361492.128397:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361492.128525:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144221440:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361492.128640:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361492.132712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361492.132820:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130726400 00000100:00100000:2.0:1788361492.132828:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130726400 00000100:00100000:2.0:1788361492.132888:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:2.0:1788361492.132898:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:33477:x1875232130726400:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361492.132937:0:37122:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788361492.133142:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144221440:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788361492.133228:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:33477:x1875232130726400:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 330us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361492.133237:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:3.0:1788361492.136165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361492.136235:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130726528 00000100:00100000:0.0:1788361492.136245:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130726528 00000100:00100000:0.0:1788361492.136324:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:0.0:1788361492.136334:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:33477:x1875232130726528:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788361492.136415:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66155a0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136435:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66155a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136451:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66155a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136466:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66155a7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136473:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66155a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136479:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66155a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136503:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136511:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136529:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361492.136574:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00000004:00200000:0.0:1788361492.136579:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361492.136592:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136612:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66155a0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136618:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66155a0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136625:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66155a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136631:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361492.136645:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66155a0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136654:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66155a0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136669:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:0.0:1788361492.136672:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361492.136676:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66155a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136683:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d66155a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136697:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66155a7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136704:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66155a7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136709:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66155a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136719:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361492.136723:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66155a7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136729:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66155a7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136738:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xb4468db5 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361492.136740:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361492.136743:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66155a7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136749:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d66155a7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xb4468db5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136764:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136770:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136776:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136782:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361492.136785:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136791:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136812:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:0.0:1788361492.136814:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361492.136817:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.136823:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d66155ae lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361492.136897:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:33477:x1875232130726528:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 564us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361492.136905:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:3.0:1788361492.140408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361492.140611:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130726784 00000100:00100000:0.0:1788361492.140621:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130726784 00000100:00100000:0.0:1788361492.140695:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:0.0:1788361492.140705:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+30:33477:x1875232130726784:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361492.140730:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361492.140751:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f60a expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.140864:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155bc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.140882:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155bc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.140894:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155bc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361492.140908:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 0 00010000:00010000:0.0:1788361492.141034:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155bc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.141043:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155bc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.141049:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155bc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.141055:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361492.141060:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155bc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.141067:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155bc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.141081:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:0.0:1788361492.141273:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361492.141280:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155bc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.141291:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155bc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.141338:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155b5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f60a expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.141349:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:0.0:1788361492.141352:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361492.141356:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f60a expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.141380:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f400, rc 0) 00000100:00100000:0.0:1788361492.142185:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:33477:x1875232130726784:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1477us (1932us total) trans 30064771249 rc 301/301 00000100:00100000:0.0:1788361492.142195:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:3.0:1788361492.147021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361492.147115:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130726912 00000100:00100000:2.0:1788361492.147127:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130726912 00000100:00100000:2.0:1788361492.147232:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 210 00000100:00100000:2.0:1788361492.147243:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:33477:x1875232130726912:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361492.147314:0:37122:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x13:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361492.147413:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:33477:x1875232130726912:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 172us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361492.147421:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 210 00000100:00100000:1.0:1788361492.149730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.149806:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130727040 00000100:00100000:3.0:1788361492.149815:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130727040 00000100:00100000:3.0:1788361492.149875:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:3.0:1788361492.149884:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:33477:x1875232130727040:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361492.149906:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361492.149929:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66155ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f611 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.150023:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66155d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.150039:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66155d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.150052:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66155d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361492.150129:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788361492.150133:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361492.150158:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66155d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.150185:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66155ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f611 expref: 33 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.150212:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66155d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f611 expref: 32 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.150221:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:3.0:1788361492.150224:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361492.150227:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcbc00, rc 0) 00000100:00100000:3.0:1788361492.150300:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:33477:x1875232130727040:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 416us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361492.150307:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:3.0:1788361492.153178:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361492.153612:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130727296 00000100:00100000:0.0:1788361492.153622:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130727296 00000100:00100000:0.0:1788361492.153682:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 212 00000100:00100000:0.0:1788361492.153692:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:33477:x1875232130727296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361492.153713:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361492.153716:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788361492.153744:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66155d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f611 expref: 32 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.153763:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:0.0:1788361492.153774:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361492.153790:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155d8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f618 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361492.154405:0:35346:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc5:0x0], index 1: 0 00010000:00010000:0.0:1788361492.154678:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155df lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.154694:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.154705:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155df lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.157754:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155d8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f618 expref: 34 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.157799:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155df lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f618 expref: 33 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.157810:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361492.157812:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361492.157816:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:0.0:1788361492.157894:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:33477:x1875232130727296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 4202us (4723us total) trans 30064771250 rc 0/0 00000100:00100000:0.0:1788361492.157903:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 212 00000100:00100000:1.0:1788361492.161341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.161458:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130727424 00000100:00100000:3.0:1788361492.161479:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130727424 00000100:00100000:3.0:1788361492.161545:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:3.0:1788361492.161555:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:33477:x1875232130727424:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361492.161580:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361492.161604:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66155ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f61f expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.161675:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66155f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.161691:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66155f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.161704:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66155f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361492.161767:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788361492.161771:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361492.161795:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66155f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.161823:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66155ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f61f expref: 35 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.161843:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66155f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f61f expref: 34 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.161853:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa400) 00010000:00010000:3.0:1788361492.161856:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361492.161859:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb400, rc 0) 00000100:00100000:3.0:1788361492.161932:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:33477:x1875232130727424:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 378us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361492.161940:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:1.0:1788361492.165742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361492.165840:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130727680 00000100:00100000:0.0:1788361492.165851:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130727680 00000100:00100000:0.0:1788361492.165952:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:0.0:1788361492.165962:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+34:33477:x1875232130727680:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361492.166032:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788361492.166061:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d66155df lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f618 expref: 34 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166081:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361492.166139:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb400/0xf6a94c97d66155f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f61f expref: 33 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166149:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa400) 00010000:00010000:0.0:1788361492.166169:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361492.166195:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166210:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166220:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166232:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615602 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x71b0db2f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166239:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615602 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71b0db2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166245:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615602 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71b0db2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166331:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155fb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166339:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155fb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166344:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166351:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361492.166355:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166363:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166379:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a90b43a00) 00010000:00010000:0.0:1788361492.166381:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361492.166385:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155fb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166390:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d66155fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166403:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615602 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x71b0db2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166409:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615602 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71b0db2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166415:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615602 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71b0db2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166420:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361492.166423:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615602 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71b0db2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166439:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615602 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x71b0db2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166447:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x71b0db2f (ffff9a8a90b43700) 00010000:00010000:0.0:1788361492.166450:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361492.166453:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615602 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71b0db2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.166459:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615602 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x71b0db2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361492.166551:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+32:33477:x1875232130727680:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 590us (832us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788361492.166560:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:0.0:1788361492.170416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.170756:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130727808 00000100:00100000:3.0:1788361492.170765:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130727808 00000100:00100000:3.0:1788361492.171633:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:3.0:1788361492.171647:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:33477:x1875232130727808:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361492.171671:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361492.171697:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615609 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f626 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.171986:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615610 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.172003:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615610 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.173662:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615610 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.174048:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615609 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f626 expref: 34 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.174069:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb800/0xf6a94c97d6615610 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f626 expref: 33 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.174079:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:3.0:1788361492.174082:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361492.174114:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb800, rc 0) 00000100:00100000:3.0:1788361492.174192:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:33477:x1875232130727808:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2550us (3784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361492.174199:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:1.0:1788361492.181659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361492.181778:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130728064 00000100:00100000:2.0:1788361492.181788:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130728064 00000100:00100000:2.0:1788361492.181899:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:2.0:1788361492.181910:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+33:33477:x1875232130728064:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361492.182006:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.182041:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.182067:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361492.182700:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].7, 88 off8736 00000004:00080000:2.0:1788361492.182711:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 882197625060ns, next at 883197623287ns, rc = 0 00000004:00010000:2.0:1788361492.182793:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d1ac327e reply state 00000000514b3cb3 transno 30064771251 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361492.182802:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361492.182985:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+35:33477:x1875232130728064:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1076us (1333us total) trans 30064771251 rc 0/0 00000100:00100000:2.0:1788361492.182994:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:1.0:1788361492.187311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:2.0:1788361492.187313:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.187325:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.187332:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.187338:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361492.187343:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361492.187524:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130728192 00000100:00100000:0.0:1788361492.187532:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130728192 00000100:00100000:0.0:1788361492.187588:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 217 00000100:00100000:0.0:1788361492.187598:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+35:33477:x1875232130728192:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361492.187624:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361492.187656:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661561e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f62d expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.187718:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661561e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f62d expref: 36 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.187733:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661561e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f62d expref: 36 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.187753:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:0.0:1788361492.187756:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361492.187760:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f400, rc 0) 00000100:00100000:0.0:1788361492.187821:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+36:33477:x1875232130728192:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 224us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361492.187828:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 217 00010000:00010000:2.0:1788361492.188657:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.188673:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:2.0:1788361492.188675:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361492.188694:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.188700:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615617 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361492.191148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.191210:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130728320 00000100:00100000:3.0:1788361492.191221:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130728320 00000100:00100000:3.0:1788361492.191296:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:3.0:1788361492.191305:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130728320:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788361492.191644:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361492.191662:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b123b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130728320:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 356us (519us total) trans 30064771095 rc 0/0 00000100:00100000:3.0:1788361492.191671:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:3.0:1788361492.194766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361492.194890:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130728576 00000100:00100000:0.0:1788361492.194915:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130728576 00000100:00100000:0.0:1788361492.195034:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:0.0:1788361492.195054:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:33477:x1875232130728576:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361492.195319:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+36:33477:x1875232130728576:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 277us (562us total) trans 30064771252 rc 0/0 00000100:00100000:0.0:1788361492.195324:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:2.0:1788361492.197692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361492.197798:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130728832 00000100:00100000:0.0:1788361492.197807:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130728832 00000100:00100000:0.0:1788361492.197904:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:0.0:1788361492.197914:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+36:33477:x1875232130728832:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788361492.198037:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+36:33477:x1875232130728832:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 124us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361492.198045:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:3.0:1788361492.200338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361492.200425:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130728960 00000100:00100000:2.0:1788361492.200432:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130728960 00000100:00100000:2.0:1788361492.200511:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:2.0:1788361492.200519:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+36:33477:x1875232130728960:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361492.200538:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361492.200556:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615625 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f634 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.200635:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661562c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.200650:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661562c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.200662:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661562c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361492.200697:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361492.200714:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661562c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.200741:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d6615625 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f634 expref: 38 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.200779:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661562c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f634 expref: 37 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.200786:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:2.0:1788361492.200789:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788361492.200793:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:2.0:1788361492.200850:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+37:33477:x1875232130728960:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 331us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361492.200857:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:3.0:1788361492.204395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361492.204609:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130729088 00000100:00100000:0.0:1788361492.204618:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130729088 00000100:00100000:0.0:1788361492.204717:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:0.0:1788361492.204727:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130729088:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361492.204744:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361492.204765:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615633 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f63b expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361492.204793:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983b14, blocks: 0x1 00010000:00010000:0.0:1788361492.204814:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=882s v=(0 0) 00010000:00010000:0.0:1788361492.204819:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361492.204829:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615633 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f63b expref: 8 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.204869:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615633 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f63b expref: 8 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.204882:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:0.0:1788361492.204955:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130729088:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 229us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361492.204963:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:1.0:1788361492.209623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.209711:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130729344 00000100:00100000:3.0:1788361492.209721:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130729344 00000100:00100000:3.0:1788361492.209776:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00100000:3.0:1788361492.209785:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:33477:x1875232130729344:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788361492.210167:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:33477:x1875232130729344:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 382us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361492.210176:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00100000:3.0:1788361492.212868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361492.212997:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130729472 00000100:00100000:2.0:1788361492.213007:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130729472 00000100:00100000:2.0:1788361492.213074:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00100000:2.0:1788361492.213210:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+37:33477:x1875232130729472:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788361492.248870:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771252 is committed 00000020:00080000:3.0:1788361492.248898:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803896 batchid updated 00000020:00080000:0.0:1788361492.248958:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803896 00000020:00080000:0.0:1788361492.248969:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803896 00000004:00080000:3.0:1788361492.249066:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:0.0:1788361492.249407:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144221568:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788361492.249483:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788361492.249643:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a843bd900 refcount 2 committed 0 result 0 batchid 25769803897 00000100:00100000:2.0:1788361492.249646:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:33477:x1875232130729472:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 36560us (36784us total) trans 0 rc 0/0 00000020:00080000:3.0:1788361492.249657:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a87852f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a843bd0c0 00000020:00080000:3.0:1788361492.249662:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ac166da00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a898672ec00 00000100:00100000:2.0:1788361492.249664:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00100000:2.0:1788361492.249703:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144221568 00000100:00100000:2.0:1788361492.249710:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144221568 00000100:00100000:2.0:1788361492.249750:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000004:00080000:3.0:1788361492.249752:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:2.0:1788361492.249761:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144221568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788361492.249789:0:35983:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:197 count 1 00002000:00010000:2.0:1788361492.249823:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc5:0x0] initial LVB size: 6, mtime: 0x6a983b14, atime: 0x6a983b14, ctime: 0x6a983b14, blocks: 0x1 00010000:00010000:2.0:1788361492.249832:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d661563a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361492.249851:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361492.249861:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144221696:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788361492.249864:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=882s v=(0 0) 00010000:00010000:2.0:1788361492.249870:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361492.249878:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d661563a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361492.249890:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788361492.249898:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d661563a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.249911:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d661563a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788361492.249913:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803897 committed batchid 25769803896 00010000:00010000:2.0:1788361492.249924:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d661563a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.249946:0:35983:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:3.0:1788361492.250151:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803896 00000100:00100000:2.0:1788361492.250440:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144221568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 681us (957us total) trans 30064771092 rc 0/0 00000100:00100000:2.0:1788361492.250448:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788361492.250461:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144221696 00000100:00100000:2.0:1788361492.250465:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144221696 00000100:00100000:2.0:1788361492.250498:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788361492.250504:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144221696:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1788361492.250771:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a898b122d80/2, rc 0, transno 30064771092 00000100:00100000:0.0:1788361492.250777:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144221568:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1788361492.250865:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361492.250870:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788361492.250993:0:35983:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788361492.250997:0:35983:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788361492.251000:0:35983:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361492.251002:0:35983:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb ctime from disk: 1788361492 -> 1788361492 00002000:00010000:2.0:1788361492.251021:0:35983:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361492.251066:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144221696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 561us (1175us total) trans 30064771096 rc 0/0 00000100:00100000:2.0:1788361492.251074:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000004:00080000:3.0:1788361492.251119:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a89858ad500/2, rc 0, transno 30064771096 00000100:00100000:3.0:1788361492.251126:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144221696:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1788361492.251127:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361492.251137:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d661563a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.251148:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361492.251153:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d661563a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.251169:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d661563a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.251190:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d661563a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.251199:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc2f92d3/0xf6a94c97d661563a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.251219:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361492.251222:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361492.251224:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361492.253588:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.253791:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130729600 00000100:00100000:3.0:1788361492.253802:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130729600 00000100:00100000:3.0:1788361492.253857:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:3.0:1788361492.253867:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130729600:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788361492.254070:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130729600:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 204us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361492.254078:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:1.0:1788361492.256794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.256900:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130729856 00000100:00100000:3.0:1788361492.256971:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130729856 00000100:00100000:3.0:1788361492.257068:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 222 00000100:00100000:3.0:1788361492.257078:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+13:33477:x1875232130729856:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788361492.257163:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361492.257194:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661562c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x15:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f634 expref: 13 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.257235:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:3.0:1788361492.257240:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361492.257271:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.257285:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.257299:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361492.257456:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000071a99555 reply state 0000000041fd94a0 transno 30064771253 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361492.257467:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361492.257574:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+14:33477:x1875232130729856:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 497us (788us total) trans 30064771253 rc 0/0 00000100:00100000:3.0:1788361492.257583:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 222 00010000:00010000:1.0:1788361492.258878:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361492.258901:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361492.258909:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361492.258915:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361492.258919:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361492.258927:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361492.258942:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:1.0:1788361492.258945:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361492.258949:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361492.258955:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615641 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361492.259251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361492.259436:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130729984 00000100:00100000:2.0:1788361492.259444:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130729984 00000100:00100000:2.0:1788361492.259494:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:2.0:1788361492.259503:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130729984:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788361492.259778:0:35982:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788361492.259782:0:35982:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb mtime from disk: 0 -> 1788361492 00002000:00010000:2.0:1788361492.259784:0:35982:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb atime from disk: 0 -> 1788361492 00002000:00010000:2.0:1788361492.259786:0:35982:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb ctime from disk: 1788361492 -> 1788361492 00002000:00010000:2.0:1788361492.259788:0:35982:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361492.259847:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130729984:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 345us (596us total) trans 30064771097 rc 0/0 00000100:00100000:2.0:1788361492.259855:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:0.0:1788361492.267469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361492.267599:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130730112 00000100:00100000:2.0:1788361492.267610:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130730112 00000100:00100000:2.0:1788361492.267666:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:2.0:1788361492.267677:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130730112:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788361492.267726:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6615648 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.267745:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361492.267749:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361492.267756:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6615648 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.267772:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6615648 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.267803:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6615648 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.267828:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6615648 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.267837:0:35983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6615648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.267844:0:35983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361492.267849:0:35983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6615648 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.267859:0:35983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6615648 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.267878:0:35983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6615648 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.267886:0:35983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc2f92d3/0xf6a94c97d6615648 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361492.267965:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130730112:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 289us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361492.267973:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:1.0:1788361492.269746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.269807:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130730368 00000100:00100000:3.0:1788361492.269815:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130730368 00000100:00100000:3.0:1788361492.269854:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:3.0:1788361492.269864:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:33477:x1875232130730368:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788361492.269948:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661564f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.269967:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661564f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.269978:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661564f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.270451:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.270466:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661561e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f62d expref: 14 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.270474:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.270523:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661561e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f62d expref: 14 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.270538:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661561e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f62d expref: 14 pid: 37551 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361492.270552:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144221824:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361492.270624:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abfe23f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788361492.272467:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144221824:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361492.272493:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361492.273718:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361492.273885:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130730496 00000100:00100000:0.0:1788361492.273893:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130730496 00010000:00010000:0.0:1788361492.273931:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661561e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f62d expref: 15 pid: 37551 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361492.273971:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:0.0:1788361492.273980:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130730496:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361492.273994:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361492.274002:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661561e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f62d expref: 15 pid: 37551 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.274041:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661561e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f62d expref: 15 pid: 37551 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.274064:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661561e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f62d expref: 15 pid: 37551 timeout: 982 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.274081:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:0.0:1788361492.274482:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.274496:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.274504:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361492.274695:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361492.274921:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130730496:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 940us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361492.274931:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00010000:00010000:3.0:1788361492.275263:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.275273:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361492.275470:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771254 00000001:00080000:3.0:1788361492.276077:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771255 00000001:00080000:3.0:1788361492.276146:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771256 00000100:00100000:3.0:1788361492.276234:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35345:1875232144221952:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788361492.276306:0:35345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361492.276390:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abfe23d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361492.276634:0:37379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144221952 00000100:00100000:2.0:1788361492.276646:0:37379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144221952 00000100:00100000:2.0:1788361492.276697:0:37379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788361492.276712:0:37379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:35345:x1875232144221952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788361492.276987:0:37379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:35345:x1875232144221952:12345-0@lo:1000:mdt00_000.0 Request processed in 276us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361492.276996:0:37379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788361492.277067:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35345:1875232144221952:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788361492.277909:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771257 00000100:00100000:3.0:1788361492.277973:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35345:1875232144222080:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788361492.278021:0:35345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361492.278052:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abfe23480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361492.279476:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144222080 00000100:00100000:0.0:1788361492.279487:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144222080 00000100:00100000:0.0:1788361492.279535:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788361492.279545:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35345:x1875232144222080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788361492.279766:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:35345:x1875232144222080:12345-0@lo:1000:mdt00_000.0 Request processed in 221us (1752us total) trans 30064771098 rc 0/0 00000100:00100000:0.0:1788361492.279775:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788361492.279839:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:35345:1875232144222080:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788361492.279881:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.279893:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.279900:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.279907:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361492.279912:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.279920:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.279937:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:3.0:1788361492.279941:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361492.279946:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.279952:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615656 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.279991:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.279998:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.280004:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.280008:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361492.280020:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.280026:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.280034:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:3.0:1788361492.280036:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361492.280043:0:35345:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615599 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f603 expref: 17 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.280055:0:35345:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615599 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f603 expref: 17 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.280064:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615599 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f603 expref: 17 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.280116:0:35345:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623200/0xf6a94c97d6615599 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f603 expref: 17 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361492.280140:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144222208:192.168.203.60@tcp:105: 00000100:00100000:3.0:1788361492.280215:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abfe23480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361492.281982:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144222208:192.168.203.60@tcp:105: 00010000:00010000:3.0:1788361492.282022:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282032:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615592 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282066:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d661565d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282080:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d661565d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282179:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d661565d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282191:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d661565d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282198:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d661565d lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282205:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d661565d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282210:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361492.282215:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d661565d lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282233:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d661565d lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282245:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:3.0:1788361492.282248:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361492.282252:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d661565d lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282258:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d661565d lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282269:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661564f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282275:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661564f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282578:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661564f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282583:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361492.282586:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661564f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282592:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661564f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282600:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:3.0:1788361492.282602:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361492.282605:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661564f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.282621:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d661564f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x13:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361492.283298:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:33477:x1875232130730368:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 13431us (13554us total) trans 30064771258 rc 0/0 00000100:00100000:3.0:1788361492.283309:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 223 00000020:00080000:3.0:1788361492.283315:0:35345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788361492.283931:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361492.283936:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361492.283967:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:1.0:1788361492.283975:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361492.285617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.285726:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130730624 00000100:00100000:3.0:1788361492.285735:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130730624 00000100:00100000:3.0:1788361492.285798:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:3.0:1788361492.285809:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:33476:x1875232130730624:12345-192.168.203.60@tcp:49:bash.0 00000100:00100000:3.0:1788361492.285975:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:33476:x1875232130730624:12345-192.168.203.60@tcp:49:bash.0 Request processed in 168us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361492.285983:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:2.0:1788361492.287292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.287393:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130730880 00000100:00100000:3.0:1788361492.287400:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130730880 00000100:00100000:3.0:1788361492.287483:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:3.0:1788361492.287493:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:33477:x1875232130730880:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788361492.288167:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x15:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788361492.288275:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771259 00010000:00010000:3.0:1788361492.288331:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.288351:0:35348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.288365:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.288383:0:35348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.288391:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.288397:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.288419:0:35348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788361492.288506:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b063480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:33477:x1875232130730880:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1013us (1226us total) trans 30064771260 rc 0/0 00000100:00100000:3.0:1788361492.288514:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000020:00080000:3.0:1788361492.288518:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788361492.288702:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361492.288709:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.288716:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361492.288721:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.288741:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.288755:0:35335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x15:0x0].0x0 (ffff9a8a890fa700) 00010000:00010000:2.0:1788361492.288758:0:35335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361492.288764:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.288770:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615664 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x15:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.288782:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361492.288790:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361492.288792:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361492.290419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.290792:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130731008 00000100:00100000:3.0:1788361492.290801:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130731008 00000100:00100000:3.0:1788361492.290856:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:3.0:1788361492.290866:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:33476:x1875232130731008:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361492.290884:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361492.290902:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661566b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f642 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.290936:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615633 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f63b expref: 10 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.290946:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361492.290951:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361492.290971:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661566b lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f642 expref: 10 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.291007:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615633 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f63b expref: 10 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.291036:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615633 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f63b expref: 10 pid: 35980 timeout: 982 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361492.291050:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36286:1875232144222336:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361492.291176:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f303c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361492.293342:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36286:1875232144222336:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361492.293375:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661566b lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f642 expref: 10 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.293396:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb400, rc 0) 00000100:00100000:3.0:1788361492.293546:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:33476:x1875232130731008:12345-192.168.203.60@tcp:101:bash.0 Request processed in 2680us (3131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361492.293554:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:1.0:1788361492.293908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361492.296184:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130731136 00000100:00100000:2.0:1788361492.296196:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130731136 00010000:00010000:2.0:1788361492.296241:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615633 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f63b expref: 10 pid: 35980 timeout: 982 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361492.296354:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:2.0:1788361492.296363:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130731136:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361492.296381:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361492.296404:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615633 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f63b expref: 10 pid: 35980 timeout: 982 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.296417:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615633 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f63b expref: 10 pid: 35980 timeout: 982 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.296454:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615633 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f63b expref: 10 pid: 35980 timeout: 982 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.296471:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361492.296475:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361492.296483:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661566b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f642 expref: 9 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.296494:0:35332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661566b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f642 expref: 9 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.296532:0:35332:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000033daa16a/0xf6a94c97d661566b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f642 expref: 9 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361492.296547:0:35332:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b062300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35332:1875232144222464:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361492.296637:0:35332:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361492.299699:0:35332:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b062300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35332:1875232144222464:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361492.299725:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361492.299777:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130731136:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3414us (5869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361492.299787:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:1.0:1788361492.299975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361492.300151:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130731392 00000100:00100000:0.0:1788361492.300158:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130731392 00000100:00100000:0.0:1788361492.300200:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:0.0:1788361492.300208:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+19:33476:x1875232130731392:12345-192.168.203.60@tcp:35:bash.0 00000001:00080000:0.0:1788361492.300519:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771261 00000100:00100000:0.0:1788361492.300596:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:33476:x1875232130731392:12345-192.168.203.60@tcp:35:bash.0 Request processed in 389us (622us total) trans 30064771262 rc 0/0 00000100:00100000:0.0:1788361492.300603:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000020:00080000:0.0:1788361492.300607:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788361492.354389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361492.355252:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130731520 00000100:00100000:2.0:1788361492.355263:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130731520 00000100:00100000:2.0:1788361492.355438:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:2.0:1788361492.355448:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+21:33487:x1875232130731520:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361492.355477:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361492.355503:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f649 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.355596:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615679 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.355612:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.355638:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361492.355834:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361492.355838:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361492.355925:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615679 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.355952:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f649 expref: 23 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.355980:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615679 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f649 expref: 22 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361492.355989:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaeb00) 00010000:00010000:2.0:1788361492.355992:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361492.355997:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361492.356077:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+22:33487:x1875232130731520:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 630us (1698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361492.356136:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:1.0:1788361492.359738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.359802:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130731648 00000100:00100000:3.0:1788361492.359813:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130731648 00000100:00100000:3.0:1788361492.359875:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:3.0:1788361492.359884:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+22:33487:x1875232130731648:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788361492.359964:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615680 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.359997:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615680 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.360022:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615680 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.360041:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615687 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.360377:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.360386:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.361873:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.361891:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.361902:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361492.361953:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.361968:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615680 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.361975:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615680 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.361996:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615680 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362002:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361492.362007:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615680 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362027:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615680 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362050:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaeb00) 00010000:00010000:3.0:1788361492.362054:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361492.362059:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362065:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362079:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615687 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362101:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615687 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362222:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615687 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362228:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361492.362232:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615687 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362249:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615687 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362259:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff9a8a890fa000) 00010000:00010000:3.0:1788361492.362262:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361492.362265:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615687 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362271:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615687 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362359:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362366:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362373:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362379:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361492.362381:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362388:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362396:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:3.0:1788361492.362398:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361492.362402:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361492.362418:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d661568e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361492.362508:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+22:33487:x1875232130731648:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 2621us (2773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361492.362518:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:1.0:1788361492.403707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.403936:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130731904 00000100:00100000:3.0:1788361492.403947:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130731904 00000100:00100000:0.0:1788361492.404416:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 226 00000100:00100000:0.0:1788361492.404431:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+22:33494:x1875232130731904:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:0.0:1788361492.404457:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361492.404480:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615695 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f650 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.404572:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661569c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.404589:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661569c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.404612:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661569c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.404630:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66156a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.404646:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66156a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.404653:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66156a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.404990:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66156aa lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405005:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66156aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405023:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66156aa lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361492.405036:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x13:0x0]: returning size 12 00010000:00010000:0.0:1788361492.405166:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661569c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405173:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661569c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405180:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661569c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405186:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361492.405190:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661569c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405198:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661569c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405210:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaeb00) 00010000:00010000:0.0:1788361492.405213:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361492.405218:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661569c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405224:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661569c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405248:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66156a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405260:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66156a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405266:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66156a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405272:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361492.405281:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66156a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405296:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66156a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405304:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x48d8896a (ffff9a8a90b43000) 00010000:00010000:0.0:1788361492.405307:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361492.405310:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66156a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405316:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d66156a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x48d8896a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405366:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f650 expref: 25 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405380:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ec00/0xf6a94c97d66156aa lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f650 expref: 24 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361492.405388:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x13:0x0].0x0 (ffff9a8a90b43f00) 00010000:00010000:0.0:1788361492.405390:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361492.405397:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573ec00, rc 0) 00000100:00100000:0.0:1788361492.406687:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+24:33494:x1875232130731904:12345-192.168.203.60@tcp:101:cat.0 Request processed in 2254us (2984us total) trans 30064771263 rc 0/0 00000100:00100000:0.0:1788361492.406697:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 226 00000100:00100000:1.0:1788361492.410881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.410975:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130732160 00000100:00100000:3.0:1788361492.410986:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130732160 00000100:00100000:3.0:1788361492.411052:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:3.0:1788361492.411063:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+24:33494:x1875232130732160:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:2.0:1788361492.412479:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+25:33494:x1875232130732160:12345-192.168.203.60@tcp:35:cat.0 Request processed in 1411us (1601us total) trans 30064771264 rc 0/0 00000100:00100000:2.0:1788361492.412491:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:1.0:1788361492.623281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361492.623324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.623416:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130732288 00000100:00100000:3.0:1788361492.623426:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130732288 00000100:00100000:3.0:1788361492.623484:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:3.0:1788361492.623494:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130732288:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361492.623572:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130732288:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361492.623578:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:1.0:1788361492.623890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.624864:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130732416 00000100:00100000:3.0:1788361492.624872:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130732416 00000100:00100000:3.0:1788361492.624927:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:3.0:1788361492.624935:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130732416:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361492.625209:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130732416:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 274us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361492.625236:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:2.0:1788361492.626547:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130732544 00000100:00100000:2.0:1788361492.626559:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130732544 00000100:00100000:2.0:1788361492.626612:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1788361492.626621:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130732544:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361492.626698:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130732544:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 78us (3373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361492.626705:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361492.633821:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361492.633866:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361492.633943:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130732672 00000100:00100000:3.0:1788361492.633954:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130732672 00000100:00080000:1.0:1788361492.634076:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361492.634195:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130732800 00000100:00100000:3.0:1788361492.634199:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130732800 00000100:00080000:1.0:1788361492.634254:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361492.634349:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788361492.634360:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130732800:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361492.634428:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130732800:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 70us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361492.634436:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:0.0:1788361492.634454:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:0.0:1788361492.634461:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2348:x1875232130732672:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1788361492.634479:0:35983:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d6614856 00000100:00080000:0.0:1788361492.634494:0:35983:0:(import.c:65:import_set_state_nolock()) ffff9a8aae467800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788361492.634536:0:35983:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 7, last_transno is 30064771092 00000100:00100000:0.0:1788361492.634736:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+2:2348:x1875232130732672:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 274us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361492.634743:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00010000:00010000:0.0:1788361492.634761:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788361492.666433:0:6617:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008 00000020:00000080:1.0:1788361492.666443:0:6617:0:(genops.c:906:class_export_put()) final put ffff9a8aae465800/f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008 00000020:00000080:0.0:1788361492.666621:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae465800/f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008 for lustre-OST0000 00000020:00000080:0.0:1788361492.666679:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8aae467800 for lustre-OST0000 00000001:00080000:1.0:1788361492.666754:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771090 is committed 00000001:00080000:1.0:1788361492.666860:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771092 is committed 00010000:00010000:2.0:1788361492.896296:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788361493.192042:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771098 is committed 00000001:00080000:1.0:1788361493.192061:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771097 is committed 00010000:00010000:2.0:1788361493.920389:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361494.946782:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361495.394196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361495.394668:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130732928 00000100:00100000:3.0:1788361495.394679:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130732928 00000100:00100000:3.0:1788361495.394797:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:3.0:1788361495.394808:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+25:33433:x1875232130732928:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788361495.394936:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+25:33433:x1875232130732928:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 130us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361495.394944:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00080000:1.0:1788361495.395181:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361495.399115:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361495.399388:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130733184 00000100:00100000:0.0:1788361495.399397:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130733184 00000100:00100000:0.0:1788361495.399463:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:0.0:1788361495.399473:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:33433:x1875232130733184:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361495.400565:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:33433:x1875232130733184:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1088us (1545us total) trans 30064771265 rc 0/0 00000100:00100000:0.0:1788361495.400583:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:0.0:1788361495.544979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361495.545104:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130733312 00000100:00100000:2.0:1788361495.545114:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130733312 00000100:00100000:2.0:1788361495.545184:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00100000:2.0:1788361495.545195:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:33935:x1875232130733312:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:2.0:1788361495.545229:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361495.545254:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66156b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f657 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361495.545340:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361495.545356:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361495.545371:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361495.545572:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361495.545577:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 13 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361495.545648:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361495.545673:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66156b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f657 expref: 7 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361495.545691:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f657 expref: 6 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361495.545700:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaeb00) 00010000:00010000:2.0:1788361495.545703:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361495.545706:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361495.545766:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:33935:x1875232130733312:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 573us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361495.545772:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00080000:1.0:1788361495.546082:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361495.713191:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144222592:0@lo:400:kworker.0 00000100:00100000:2.0:1788361495.713216:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144222720:0@lo:400:kworker.0 00000100:00100000:1.0:1788361495.713297:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144222976:0@lo:400:kworker.0 00000100:00100000:0.0:1788361495.714480:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144222848:0@lo:400:kworker.0 00000100:00100000:2.0:1788361495.714647:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361495.714697:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144223232:0@lo:400:kworker.0 00000100:00100000:2.0:1788361495.714726:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361495.714780:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144222720 00000100:00100000:2.0:1788361495.714787:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144222720 00000100:00100000:2.0:1788361495.714843:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788361495.714851:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144222720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361495.714903:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144222720:12345-0@lo:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361495.714910:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788361495.714946:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771092 gen 2 00000004:00080000:2.0:1788361495.714952:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771091 committed transno 30064771092 00000004:00080000:2.0:1788361495.714970:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a898b122d80, transno 30064771092 00000100:00100000:2.0:1788361495.714982:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b061c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144222720:0@lo:400:kworker.0 00000100:00100000:2.0:1788361495.715580:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144223232 00000100:00100000:2.0:1788361495.715586:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144223232 00000100:00100000:2.0:1788361495.715619:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788361495.715627:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144223232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361495.715671:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144223232:12345-0@lo:400:kworker.0 Request processed in 44us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361495.715677:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788361495.715703:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b063100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144223232:0@lo:400:kworker.0 00000100:00080000:2.0:1788361495.715735:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361495.715740:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361495.715830:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361495.715875:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144223104:0@lo:400:kworker.0 00000100:00100000:2.0:1788361495.715882:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144222592 00000100:00100000:2.0:1788361495.715893:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144222592 00000100:00100000:3.0:1788361495.715909:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361495.715922:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788361495.715931:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144222592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361495.715958:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144223104 00000100:00100000:3.0:1788361495.715963:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144223104 00000100:00100000:2.0:1788361495.715972:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144222592:12345-0@lo:400:kworker.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361495.715980:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:2.0:1788361495.716380:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361495.716383:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788361495.716393:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144223104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361495.716430:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144223104:12345-0@lo:400:kworker.0 Request processed in 39us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361495.716437:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788361495.716494:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b060700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144223104:0@lo:400:kworker.0 00000100:00100000:2.0:1788361495.716506:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b062300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144222592:0@lo:400:kworker.0 00000100:00100000:0.0:1788361495.717436:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361495.717475:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144223360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361495.717503:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361495.717585:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361495.717716:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144223360 00000100:00100000:3.0:1788361495.717722:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144223360 00000100:00100000:3.0:1788361495.717791:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361495.717799:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144223360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361495.717831:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 59572224 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361495.717870:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144223360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361495.717876:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788361495.717880:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144222848 00000100:00100000:2.0:1788361495.717886:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144222848 00000100:00100000:2.0:1788361495.717919:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788361495.717928:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144222848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361495.717971:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144222848:12345-0@lo:400:kworker.0 Request processed in 44us (537us total) trans 0 rc 0/0 00000100:00080000:1.0:1788361495.717972:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361495.717980:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788361495.718109:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144222976 00000100:00100000:0.0:1788361495.718113:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144222976 00000100:00100000:0.0:1788361495.718236:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788361495.718246:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144222976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361495.718298:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144222976:12345-0@lo:400:kworker.0 Request processed in 47us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361495.718305:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788361495.718381:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b063b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144222976:0@lo:400:kworker.0 00000100:00100000:1.0:1788361495.718424:0:3312:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771098 gen 2 00000004:00080000:1.0:1788361495.718429:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a89858ad500, transno 30064771096 00000004:00080000:1.0:1788361495.718449:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771098 committed transno 30064771098 00000100:00100000:1.0:1788361495.718466:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b060380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144222848:0@lo:400:kworker.0 00000100:00100000:1.0:1788361495.718483:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b120700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144223360:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788361495.968376:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361496.224582:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144223488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361496.224656:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361496.224733:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144223488 00000100:00100000:3.0:1788361496.224743:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144223488 00000100:00100000:3.0:1788361496.224808:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361496.224819:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144223488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361496.224859:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1788361496.225468:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144223488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 649us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361496.225475:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144223488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361496.225481:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:2.0:1788361496.992295:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788361497.274081:0:38000:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771265 is committed 00000020:00080000:1.0:1788361497.274141:0:38000:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8ab76a5e40 refcount 2 committed 0 result 0 batchid 25769803898 00000020:00080000:1.0:1788361497.274147:0:38000:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8aa9f1a900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ab76a5300 00000020:00080000:1.0:1788361497.274150:0:38000:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8aa9f1ae00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ac13fd400 00000020:00080000:1.0:1788361497.274177:0:38000:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803897 batchid updated 00000020:00080000:3.0:1788361497.274370:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803898 committed batchid 25769803897 00000020:00080000:3.0:1788361497.274579:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803897 00000001:02000400:1.0:1788361497.585804:0:38190:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 9: Test -ENOSPC tolerance on loop PCC device for RW-PCC ========================================================== 11:04:57 (1788361497) 00000100:00100000:1.0:1788361497.735351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361497.735393:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361497.735421:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130733440 00000100:00100000:0.0:1788361497.735432:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130733440 00000100:00100000:1.0:1788361497.735454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361497.735490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361497.735503:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:0.0:1788361497.735517:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130733440:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361497.735532:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361497.735555:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361497.735592:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130733440:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 77us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361497.735606:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130734080 00000100:00100000:2.0:1788361497.735614:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130734080 00000100:00100000:0.0:1788361497.735615:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:2.0:1788361497.735665:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130733696 00000100:00100000:2.0:1788361497.735670:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130733696 00000100:00100000:2.0:1788361497.735692:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130733824 00000100:00100000:2.0:1788361497.735696:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130733824 00000100:00100000:2.0:1788361497.735719:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788361497.735727:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+5:2350:x1875232130733696:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361497.735772:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+5:2350:x1875232130733696:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361497.735786:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1788361497.735802:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:2.0:1788361497.735809:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130733824:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361497.735991:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1788361497.736002:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2348:x1875232130734080:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:3.0:1788361497.736022:0:36286:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf6a94c97d661485d 00000100:00080000:3.0:1788361497.736037:0:36286:0:(import.c:65:import_set_state_nolock()) ffff9a8aae460000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788361497.736074:0:36286:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 7, last_transno is 30064771098 00000100:00080000:1.0:1788361497.736128:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361497.736134:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361497.736149:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130733952 00000100:00100000:1.0:1788361497.736153:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130733952 00000100:00100000:0.0:1788361497.736195:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130733568 00000100:00100000:1.0:1788361497.736200:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788361497.736202:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130733568 00000100:00100000:1.0:1788361497.736213:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130733952:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361497.736242:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:0.0:1788361497.736252:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130733568:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361497.736347:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130733952:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 138us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361497.736357:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788361497.736363:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130733568:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 110us (828us total) trans 0 rc 0/0 00000100:00080000:1.0:1788361497.736380:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361497.736380:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:3.0:1788361497.736386:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+2:2348:x1875232130734080:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 384us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361497.736396:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00010000:00010000:1.0:1788361497.736419:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361497.736472:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130733824:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 662us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361497.736548:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00010000:00010000:2.0:1788361498.016243:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788361498.290167:0:7498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008 00000020:00000080:1.0:1788361498.290175:0:7498:0:(genops.c:906:class_export_put()) final put ffff9a8aae463800/f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008 00000020:00000080:2.0:1788361498.290251:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9a8aae463800/f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008 for lustre-OST0001 00000020:00000080:2.0:1788361498.290306:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9a8aae460000 for lustre-OST0001 00000100:00100000:0.0:1788361498.333518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361498.333617:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130734336 00000100:00100000:3.0:1788361498.333628:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130734336 00000100:00100000:3.0:1788361498.333706:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:3.0:1788361498.333717:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:34192:x1875232130734336:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361498.333742:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361498.333765:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66156c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f65e expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.333852:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66156cd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.333880:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66156cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.333894:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66156cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.333909:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66156d4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.333917:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66156d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.333924:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66156d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.334535:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66156db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.334547:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66156db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.334556:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66156db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361498.334574:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788361498.334828:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66156cd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.334837:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66156cd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.334844:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66156cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.334850:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.335012:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66156cd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335021:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66156cd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335035:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:2.0:1788361498.335038:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.335044:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66156cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335051:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d66156cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335064:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66156d4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335070:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66156d4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335076:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66156d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335081:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.335246:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66156d4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335255:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66156d4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335264:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a890fa300) 00010000:00010000:2.0:1788361498.335267:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.335277:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66156d4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335282:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d66156d4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335934:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66156c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f65e expref: 16 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335951:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66156db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f65e expref: 15 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.335959:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361498.335962:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.335965:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8200, rc 0) 00000100:00100000:2.0:1788361498.336044:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:34192:x1875232130734336:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2327us (2534us total) trans 30064771266 rc 0/0 00000100:00100000:2.0:1788361498.336053:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:0.0:1788361498.340359:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361498.340408:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361498.340492:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130734592 00000100:00100000:1.0:1788361498.340502:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130734592 00000100:00100000:1.0:1788361498.340563:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 230 00000100:00100000:1.0:1788361498.340572:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:34192:x1875232130734592:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788361498.340679:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:34192:x1875232130734592:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 107us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361498.340686:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 230 00000100:00100000:3.0:1788361498.341442:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130734464 00000100:00100000:3.0:1788361498.341447:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130734464 00000100:00100000:3.0:1788361498.341545:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1788361498.341554:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2351:x1875232130734464:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361498.341567:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361498.341664:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d66156db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f65e expref: 15 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.341698:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:3.0:1788361498.341704:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361498.341743:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2351:x1875232130734464:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 191us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361498.341751:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1788361498.440067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361498.440223:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130734848 00000100:00100000:1.0:1788361498.440233:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130734848 00000100:00100000:1.0:1788361498.440293:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:1.0:1788361498.440302:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+14:34207:x1875232130734848:12345-192.168.203.60@tcp:101:touch.0 00010000:00010000:1.0:1788361498.440324:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361498.440341:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361498.440369:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615679 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f649 expref: 14 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.440388:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaeb00) 00010000:00010000:1.0:1788361498.440393:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361498.440408:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66156e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f665 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.440721:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.440736:0:37551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f657 expref: 5 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.440744:0:37551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.440774:0:37551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f657 expref: 5 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.440787:0:37551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f657 expref: 5 pid: 35347 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361498.440805:0:37551:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:37551:1875232144223616:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361498.440904:0:37551:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361498.443346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361498.443349:0:37551:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:37551:1875232144223616:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361498.443376:0:37551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361498.444405:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130734976 00000100:00100000:3.0:1788361498.444414:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130734976 00010000:00010000:3.0:1788361498.444452:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f657 expref: 6 pid: 35347 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361498.444494:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:3.0:1788361498.444504:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130734976:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361498.444518:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361498.444526:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f657 expref: 6 pid: 35347 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.444540:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f657 expref: 6 pid: 35347 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.444562:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d66156bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f657 expref: 6 pid: 35347 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.444580:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaeb00) 00010000:00010000:3.0:1788361498.444584:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.444606:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.444621:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.444653:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361498.444708:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130734976:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 204us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361498.444716:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00010000:00010000:1.0:1788361498.444918:0:37551:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.444927:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.444952:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.444962:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.444980:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361498.445814:0:37551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc6:0x0], index 0: 0 00010000:00010000:1.0:1788361498.446375:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66156fe lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446387:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66156fe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446396:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66156fe lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446436:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446443:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446449:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446462:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361498.446466:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446473:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446484:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaeb00) 00010000:00010000:1.0:1788361498.446487:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361498.446493:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446499:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d66156f0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361498.446510:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000617e86dc reply state 00000000eb5f9200 transno 30064771267 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361498.446518:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361498.446553:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d66156e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f665 expref: 16 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446573:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66156fe lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f665 expref: 15 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.446580:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:1.0:1788361498.446633:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361498.446636:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623400, rc 0) 00000100:00100000:1.0:1788361498.446735:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+16:34207:x1875232130734848:12345-192.168.203.60@tcp:101:touch.0 Request processed in 6433us (6676us total) trans 30064771267 rc 0/0 00000100:00100000:1.0:1788361498.446750:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 231 00010000:00010000:2.0:1788361498.448321:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.448330:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.448334:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.448337:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.448340:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.448354:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.448367:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff9a8984a32f00) 00010000:00010000:2.0:1788361498.448370:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.448373:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.448378:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66156f7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361498.449247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.449314:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130735232 00000100:00100000:2.0:1788361498.449322:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130735232 00000100:00100000:2.0:1788361498.449370:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 232 00000100:00100000:2.0:1788361498.449379:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:34207:x1875232130735232:12345-192.168.203.60@tcp:36:touch.0 00010000:00010000:2.0:1788361498.449437:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361498.449457:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d66156fe lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f665 expref: 15 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.449470:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:2.0:1788361498.449479:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361498.449524:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.449538:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.449547:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361498.449676:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000045662800 reply state 00000000e65ef671 transno 30064771268 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361498.449686:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361498.449794:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+16:34207:x1875232130735232:12345-192.168.203.60@tcp:36:touch.0 Request processed in 416us (551us total) trans 30064771268 rc 0/0 00000100:00100000:2.0:1788361498.449802:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 232 00010000:00010000:1.0:1788361498.451499:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.451514:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.451522:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.451528:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361498.451533:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.451542:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.451559:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:1.0:1788361498.451563:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361498.451568:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361498.451569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:1.0:1788361498.451579:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661570c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361498.451640:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130735360 00000100:00100000:2.0:1788361498.451647:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130735360 00000100:00100000:2.0:1788361498.451699:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:2.0:1788361498.451707:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+15:34207:x1875232130735360:12345-192.168.203.60@tcp:101:touch.0 00010000:00010000:2.0:1788361498.451728:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361498.451744:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615713 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f66c expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.451791:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615713 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f66c expref: 16 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.451815:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615713 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f66c expref: 16 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.451833:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361498.451836:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361498.451839:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9800, rc 0) 00000100:00100000:2.0:1788361498.451899:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+16:34207:x1875232130735360:12345-192.168.203.60@tcp:101:touch.0 Request processed in 180us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361498.451920:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:0.0:1788361498.453794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.453906:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130735488 00000100:00100000:2.0:1788361498.453914:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130735488 00000100:00100000:2.0:1788361498.454003:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:2.0:1788361498.454012:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+5:2350:x1875232130735488:12345-192.168.203.60@tcp:2:touch.0 00000100:00100000:2.0:1788361498.454387:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130735488:12345-192.168.203.60@tcp:2:touch.0 Request processed in 375us (599us total) trans 30064771093 rc 0/0 00000100:00100000:2.0:1788361498.454394:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:0.0:1788361498.456397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.456491:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130735744 00000100:00100000:2.0:1788361498.456500:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130735744 00000100:00100000:2.0:1788361498.456585:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:2.0:1788361498.456594:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+16:34207:x1875232130735744:12345-192.168.203.60@tcp:35:touch.0 00000100:00100000:2.0:1788361498.456920:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:34207:x1875232130735744:12345-192.168.203.60@tcp:35:touch.0 Request processed in 327us (527us total) trans 30064771269 rc 0/0 00000100:00100000:2.0:1788361498.456928:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000040:00080000:1.0:1788361498.464294:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361498.464303:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361498.464355:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 7 count 7 00000040:00080000:1.0:1788361498.464363:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361498.500223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361498.500328:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130735872 00000100:00100000:1.0:1788361498.500338:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130735872 00000100:00100000:1.0:1788361498.500413:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 234 00000100:00100000:1.0:1788361498.500422:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+17:34213:x1875232130735872:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361498.500451:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361498.500473:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d661571a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f673 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.500549:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615721 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.500565:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.500578:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361498.500638:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788361498.500643:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361498.500667:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.500695:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d661571a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f673 expref: 19 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.500712:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f673 expref: 18 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.500722:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32d00) 00010000:00010000:1.0:1788361498.500726:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361498.500730:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623800, rc 0) 00000100:00100000:1.0:1788361498.500793:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+18:34213:x1875232130735872:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 372us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361498.500808:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 234 00000100:00100000:1.0:1788361498.503206:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.503288:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130736000 00000100:00100000:2.0:1788361498.503296:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130736000 00000100:00100000:2.0:1788361498.503348:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:2.0:1788361498.503357:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+18:34213:x1875232130736000:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361498.503384:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361498.503403:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615728 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f67a expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503466:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661572f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503494:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661572f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503505:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661572f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503521:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615736 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503528:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615736 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503535:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615736 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503622:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503630:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503637:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361498.503667:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000004:00200000:2.0:1788361498.503672:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361498.503687:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503699:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503719:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661572f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503725:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661572f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503732:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661572f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503738:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.503743:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661572f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503751:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661572f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503763:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32d00) 00010000:00010000:2.0:1788361498.503766:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.503770:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661572f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503782:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d661572f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503797:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615736 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503803:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615736 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503809:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615736 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503821:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.503824:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615736 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503830:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615736 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503838:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff9a8a8beaee00) 00010000:00010000:2.0:1788361498.503841:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.503844:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615736 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503849:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615736 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503879:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615728 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f67a expref: 20 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503891:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f67a expref: 19 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.503898:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361498.503900:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361498.503903:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8200, rc 0) 00000100:00100000:2.0:1788361498.503959:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+19:34213:x1875232130736000:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 603us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361498.503975:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:0.0:1788361498.508913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361498.509026:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130736128 00000100:00100000:1.0:1788361498.509037:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130736128 00000100:00100000:1.0:1788361498.509252:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:1.0:1788361498.509264:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130736128:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361498.509293:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361498.509314:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000905aaae5/0xf6a94c97d6615744 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f681 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361498.509343:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc6:0x0] initial LVB size: 0, mtime: 0x6a983b1b, atime: 0x6a983b1b, ctime: 0x6a983b1b, blocks: 0x1 00010000:00010000:1.0:1788361498.509364:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=888s v=(0 0) 00010000:00010000:1.0:1788361498.509370:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361498.509381:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000905aaae5/0xf6a94c97d6615744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f681 expref: 7 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.509403:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000905aaae5/0xf6a94c97d6615744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f681 expref: 7 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.509418:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622800, rc 0) 00000100:00100000:1.0:1788361498.509609:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130736128:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 346us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361498.509626:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:0.0:1788361498.512133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361498.512226:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130736384 00000100:00100000:1.0:1788361498.512234:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130736384 00000100:00100000:1.0:1788361498.512405:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 236 00000100:00100000:1.0:1788361498.512416:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+19:34213:x1875232130736384:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361498.512438:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361498.512456:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d661574b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f688 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.512574:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615752 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.512591:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f67a expref: 20 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.512598:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615752 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.512629:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f67a expref: 20 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.512642:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f67a expref: 20 pid: 37122 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361498.512656:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144223744:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361498.512740:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361498.514708:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144223744:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361498.514734:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615752 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361498.515716:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361498.515795:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130736512 00000100:00100000:1.0:1788361498.515817:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130736512 00010000:00010000:1.0:1788361498.515852:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f67a expref: 21 pid: 37122 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361498.516147:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:1.0:1788361498.516165:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8984bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+21:2350:x1875232130736512:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361498.516182:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361498.516190:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f67a expref: 21 pid: 37122 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.516204:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f67a expref: 21 pid: 37122 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.516230:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d661573d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f67a expref: 21 pid: 37122 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.516260:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:1.0:1788361498.516293:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615752 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.516305:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615752 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.516313:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615752 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.516406:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361498.516457:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8984bb4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+20:2350:x1875232130736512:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 302us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361498.516470:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00010000:00010000:2.0:1788361498.516536:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615752 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.516547:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615752 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361498.516565:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:2.0:1788361498.517063:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d661574b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f688 expref: 21 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.517081:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615752 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f688 expref: 20 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.517123:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361498.517126:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788361498.517129:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623a00, rc 0) 00000100:00100000:2.0:1788361498.517165:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:34213:x1875232130736384:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 4752us (5037us total) trans 30064771270 rc 0/0 00000100:00100000:2.0:1788361498.517172:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 236 00000100:00100000:0.0:1788361498.519341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.519402:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130736768 00000100:00100000:2.0:1788361498.519411:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130736768 00000100:00100000:2.0:1788361498.519469:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:2.0:1788361498.519479:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:34213:x1875232130736768:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361498.519506:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361498.519510:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361498.519539:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615752 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x16:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f688 expref: 20 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.519556:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361498.519574:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361498.519591:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615760 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f68f expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.520495:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615767 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.520512:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615767 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.520523:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615767 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361498.520537:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:2.0:1788361498.520664:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615760 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f68f expref: 22 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.520682:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615767 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f68f expref: 21 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.520691:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361498.520693:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361498.520696:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361498.520942:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:34213:x1875232130736768:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1463us (1607us total) trans 30064771271 rc 0/0 00000100:00100000:2.0:1788361498.520950:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:3.0:1788361498.524647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.524738:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130736896 00000100:00100000:2.0:1788361498.524748:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130736896 00002000:00100000:2.0:1788361498.524801:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (0->4095) req@ffff9a8a835e3480 x1875232130736896/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:559/0 lens 488/0 e 0 to 0 dl 1788361509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361498.524834:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a835e3480 with x1875232130736896 ext(0->4095) 00002000:00010000:2.0:1788361498.524840:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a835e3480 00000100:00100000:2.0:1788361498.524877:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:2.0:1788361498.524886:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130736896:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361498.525127:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130736896:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 241us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361498.525135:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00002000:00100000:2.0:1788361498.525142:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc6:0x0] (0->4095) req@ffff9a8a835e3480 x1875232130736896/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:559/0 lens 488/440 e 0 to 0 dl 1788361509 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361498.525151:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a835e3480 with x1875232130736896 ext(0->4095) 00002000:00010000:2.0:1788361498.525155:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a835e3480 00000100:00100000:0.0:1788361498.528223:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361498.528292:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130737024 00000100:00100000:3.0:1788361498.528303:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130737024 00000100:00100000:3.0:1788361498.528370:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:3.0:1788361498.528380:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130737024:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:3.0:1788361498.528431:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.528453:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000905aaae5/0xf6a94c97d6615744 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f681 expref: 7 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.528462:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361498.528467:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361498.528472:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.528510:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000905aaae5/0xf6a94c97d6615744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f681 expref: 7 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.528546:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000905aaae5/0xf6a94c97d6615744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f681 expref: 7 pid: 35980 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361498.528563:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144223872:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361498.528643:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361498.530042:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144223872:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361498.530066:0:36286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361498.530600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.530807:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130737152 00000100:00100000:2.0:1788361498.530814:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130737152 00010000:00010000:2.0:1788361498.530847:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000905aaae5/0xf6a94c97d6615744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f681 expref: 8 pid: 35980 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361498.530887:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:2.0:1788361498.530905:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130737152:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361498.530921:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361498.530948:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000905aaae5/0xf6a94c97d6615744 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f681 expref: 8 pid: 35980 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.530963:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000905aaae5/0xf6a94c97d6615744 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f681 expref: 8 pid: 35980 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.531015:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000905aaae5/0xf6a94c97d6615744 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f681 expref: 8 pid: 35980 timeout: 988 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.531033:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361498.531037:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361498.531042:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.531052:0:35332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.531125:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361498.531184:0:36286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.531193:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.531217:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.531236:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.531244:0:36286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.531279:0:36286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361498.531284:0:36286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.531294:0:36286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.531307:0:36286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.531314:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069df56f9/0xf6a94c97d6615775 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361498.531862:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130737152:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 964us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361498.531871:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:3.0:1788361498.531905:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130737024:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 3525us (3702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361498.531914:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1788361498.533818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361498.533890:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130737408 00000100:00100000:3.0:1788361498.533900:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130737408 00000100:00100000:3.0:1788361498.534001:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:3.0:1788361498.534011:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:34213:x1875232130737408:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:3.0:1788361498.534077:0:35349:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x16:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615767 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f68f expref: 21 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361498.534340:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771272 00000001:00080000:3.0:1788361498.534384:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771273 00000001:00080000:3.0:1788361498.534899:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771274 00010000:00010000:3.0:1788361498.534953:0:35349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.534985:0:35349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615713 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f66c expref: 25 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.534993:0:35349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.535027:0:35349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615713 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f66c expref: 25 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.535041:0:35349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615713 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f66c expref: 25 pid: 35345 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361498.535056:0:35349:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35349:1875232144224000:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361498.535150:0:35349:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361498.538849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361498.538946:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130737536 00000100:00100000:0.0:1788361498.538954:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130737536 00010000:00010000:0.0:1788361498.538998:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615713 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f66c expref: 26 pid: 35345 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361498.539105:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:0.0:1788361498.539116:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+26:2349:x1875232130737536:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361498.539131:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361498.539153:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615713 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f66c expref: 26 pid: 35345 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361498.539179:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615713 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f66c expref: 26 pid: 35345 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361498.539202:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:0.0:1788361498.539207:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361498.539217:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361498.539224:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361498.539243:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361498.539301:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+26:2349:x1875232130737536:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 186us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361498.539309:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00010000:00010000:3.0:1788361498.540047:0:35349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615713 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f66c expref: 25 pid: 35345 timeout: 988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361498.540066:0:35349:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35349:1875232144224000:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361498.540112:0:35349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.540123:0:35349:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.540129:0:35349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361498.540253:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771275 00000001:00080000:3.0:1788361498.540437:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771276 00000100:00100000:3.0:1788361498.540540:0:35349:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35349:1875232144224128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788361498.540589:0:35349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361498.540624:0:35349:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361498.541162:0:37379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144224128 00000100:00100000:2.0:1788361498.541170:0:37379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144224128 00000100:00100000:2.0:1788361498.541237:0:37379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788361498.541247:0:37379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:35349:x1875232144224128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788361498.541348:0:37379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:35349:x1875232144224128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361498.541356:0:37379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788361498.541430:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361498.542587:0:35349:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35349:1875232144224128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788361498.546841:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771277 00000100:00100000:3.0:1788361498.546948:0:35349:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35349:1875232144224256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788361498.547029:0:35349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361498.547072:0:35349:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361498.547283:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144224256 00000100:00100000:1.0:1788361498.547292:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144224256 00000100:00100000:1.0:1788361498.547344:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788361498.547354:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35349:x1875232144224256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788361498.547541:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35349:x1875232144224256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 188us (511us total) trans 30064771094 rc 0/0 00000100:00100000:1.0:1788361498.547562:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788361498.547582:0:35349:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858adc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35349:1875232144224256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788361498.547634:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771278 00010000:00010000:3.0:1788361498.547673:0:35349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.547683:0:35349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.547690:0:35349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.547695:0:35349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361498.547699:0:35349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.547707:0:35349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.547739:0:35349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:3.0:1788361498.547741:0:35349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788361498.547757:0:35349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361498.547764:0:35349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661577c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361498.548009:0:35349:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x17:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788361498.548192:0:35349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].8, 64 off8752 00000004:00080000:3.0:1788361498.548214:0:35349:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 888563127731ns, next at 889563125371ns, rc = 0 00000001:00080000:3.0:1788361498.548221:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771279 00010000:00010000:3.0:1788361498.548251:0:35349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:3.0:1788361498.548254:0:35349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788361498.548261:0:35349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615767 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f68f expref: 29 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361498.548399:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:34213:x1875232130737408:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 14389us (14587us total) trans 30064771280 rc 0/0 00000100:00100000:3.0:1788361498.548407:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000020:00080000:3.0:1788361498.548411:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788361498.550453:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.551032:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130737664 00000100:00100000:2.0:1788361498.551040:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130737664 00000100:00100000:2.0:1788361498.551168:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 238 00000100:00100000:2.0:1788361498.551192:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+28:34213:x1875232130737664:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361498.551216:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361498.551432:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615783 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f696 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.551495:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615783 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f696 expref: 29 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.551509:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615783 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f696 expref: 29 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.551527:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaee00) 00010000:00010000:2.0:1788361498.551530:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361498.551533:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361498.551596:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:34213:x1875232130737664:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 405us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361498.551602:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 238 00000100:00100000:0.0:1788361498.554081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.554211:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130737920 00000100:00100000:2.0:1788361498.554219:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130737920 00000100:00100000:2.0:1788361498.554272:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:2.0:1788361498.554280:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:34213:x1875232130737920:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361498.554519:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+30:34213:x1875232130737920:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 239us (444us total) trans 30064771281 rc 0/0 00000100:00100000:2.0:1788361498.554527:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:0.0:1788361498.607834:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.608071:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130738048 00000100:00100000:2.0:1788361498.608115:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130738048 00000100:00100000:2.0:1788361498.608167:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:2.0:1788361498.608193:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:34223:x1875232130738048:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361498.608283:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661578a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608303:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661578a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608315:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661578a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608329:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615791 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608335:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608341:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608437:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608445:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608451:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361498.608494:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608508:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661578a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608520:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661578a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608527:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661578a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608534:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.608538:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661578a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608546:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661578a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608558:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32d00) 00010000:00010000:2.0:1788361498.608561:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.608566:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661578a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608572:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d661578a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608584:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615791 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608589:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615791 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608595:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615791 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608599:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.608607:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615791 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608614:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615791 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608620:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff9a8a8beae200) 00010000:00010000:2.0:1788361498.608623:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.608625:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615791 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608630:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615791 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608645:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608650:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608655:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608660:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.608663:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608668:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608674:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaee00) 00010000:00010000:2.0:1788361498.608677:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.608684:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.608690:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615798 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361498.608769:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:34223:x1875232130738048:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 576us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361498.608778:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:1.0:1788361498.658255:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.658487:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130738304 00000100:00100000:2.0:1788361498.658497:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130738304 00000100:00100000:2.0:1788361498.658610:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 240 00000100:00100000:2.0:1788361498.658630:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+30:34229:x1875232130738304:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361498.658655:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361498.658659:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361498.658690:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615721 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f673 expref: 30 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.658709:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32d00) 00010000:00010000:2.0:1788361498.658728:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361498.658745:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661579f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f69d expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.658922:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.658938:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.658949:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.658986:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659001:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659009:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659280:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d66157b4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659289:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d66157b4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659297:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d66157b4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361498.659309:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:2.0:1788361498.659425:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659433:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659439:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659444:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.659448:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659466:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659477:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:2.0:1788361498.659480:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.659483:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659488:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659500:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659506:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659512:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659517:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.659520:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659527:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659533:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361498.659535:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.659537:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659554:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659617:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d661579f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f69d expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659634:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d66157b4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f69d expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.659642:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaee00) 00010000:00010000:2.0:1788361498.659644:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361498.659646:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8000, rc 0) 00000100:00100000:2.0:1788361498.659750:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:34229:x1875232130738304:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1121us (1505us total) trans 30064771282 rc 0/0 00000100:00100000:2.0:1788361498.659758:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 240 00000100:00100000:1.0:1788361498.665400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361498.665875:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130738560 00000100:00100000:2.0:1788361498.665885:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130738560 00000100:00100000:1.0:1788361498.668964:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 241 00000100:00100000:1.0:1788361498.668993:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+31:34229:x1875232130738560:12345-192.168.203.60@tcp:36:dd.0 00010000:00010000:1.0:1788361498.669060:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361498.669120:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d66157b4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f69d expref: 31 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.669141:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaee00) 00010000:00010000:1.0:1788361498.669146:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361498.669377:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.669392:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361498.669422:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361498.669481:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771283 00000004:00010000:1.0:1788361498.669632:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031853c3f reply state 000000009e5f4dec transno 30064771284 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361498.669642:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361498.669803:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+33:34229:x1875232130738560:12345-192.168.203.60@tcp:36:dd.0 Request processed in 817us (4412us total) trans 30064771284 rc 0/0 00000100:00100000:1.0:1788361498.669819:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 241 00000020:00080000:1.0:1788361498.669823:0:35347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788361498.673202:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.673219:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.673227:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.673289:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361498.673294:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.673314:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.673329:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaee00) 00010000:00010000:2.0:1788361498.673331:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361498.673336:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361498.673340:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66157c2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.040445:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361499.119386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361499.119507:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130738816 00000100:00100000:3.0:1788361499.119517:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130738816 00000100:00100000:3.0:1788361499.119632:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1788361499.119658:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+32:34229:x1875232130738816:12345-192.168.203.60@tcp:103:dd.0 00010000:00010000:3.0:1788361499.119675:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361499.119705:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615783 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f696 expref: 32 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361499.119750:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beaee00) 00010000:00010000:3.0:1788361499.119779:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361499.119889:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:34229:x1875232130738816:12345-192.168.203.60@tcp:103:dd.0 Request processed in 249us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361499.119898:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00080000:1.0:1788361499.120364:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361499.121250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.121336:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130738944 00000100:00100000:2.0:1788361499.121343:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130738944 00000100:00100000:2.0:1788361499.121420:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 242 00000100:00100000:2.0:1788361499.121428:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:34229:x1875232130738944:12345-192.168.203.60@tcp:58:dd.0 00010000:00010000:2.0:1788361499.121531:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.121548:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.121561:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361499.122157:0:35345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].7, 136 off9144 00000100:00100000:2.0:1788361499.122242:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:34229:x1875232130738944:12345-192.168.203.60@tcp:58:dd.0 Request processed in 814us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361499.122250:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 242 00000100:00100000:0.0:1788361499.125010:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.125152:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130739072 00000100:00100000:2.0:1788361499.125161:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130739072 00000100:00100000:2.0:1788361499.125216:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 243 00000100:00100000:2.0:1788361499.125225:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:34229:x1875232130739072:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361499.125247:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361499.125267:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157d0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6a4 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.125326:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.125337:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157d0 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6a4 expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.125356:0:35346:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.125378:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157d0 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6a4 expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.125392:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:2.0:1788361499.125395:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361499.125398:0:35346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157d0 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6a4 expref: 32 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.125407:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8e00, rc 0) 00000100:00100000:2.0:1788361499.125501:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:34229:x1875232130739072:12345-192.168.203.60@tcp:101:dd.0 Request processed in 278us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361499.125509:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 243 00000040:00080000:1.0:1788361499.488325:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361499.488335:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361499.488374:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:1.0:1788361499.488381:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361499.488508:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144224384:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361499.488609:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361499.495295:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144224384:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361499.496673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.496756:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130739200 00000100:00100000:2.0:1788361499.496764:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130739200 00000100:00100000:2.0:1788361499.496818:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 244 00000100:00100000:2.0:1788361499.496828:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+32:34231:x1875232130739200:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361499.496863:0:35347:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x16:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361499.496973:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+32:34231:x1875232130739200:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 146us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361499.496982:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 244 00000100:00100000:0.0:1788361499.500338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.500472:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130739328 00000100:00100000:2.0:1788361499.500482:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130739328 00000100:00100000:2.0:1788361499.500573:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 245 00000100:00100000:2.0:1788361499.500583:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:34231:x1875232130739328:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788361499.500660:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500679:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500692:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500708:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500716:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500722:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500766:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500775:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500783:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361499.500822:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00000004:00200000:2.0:1788361499.500826:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361499.500839:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500851:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500859:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500866:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500873:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361499.500877:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500886:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500898:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361499.500908:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361499.500914:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500921:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66157d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500936:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500942:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500948:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500953:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361499.500956:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500977:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500985:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x1989a751 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361499.500988:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361499.500991:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.500998:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x1989a751 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.501014:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.501027:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.501033:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.501038:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361499.501041:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.501048:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.501056:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:2.0:1788361499.501059:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361499.501062:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.501068:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157e5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361499.501211:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:34231:x1875232130739328:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 629us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361499.501220:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 245 00000100:00100000:0.0:1788361499.505973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.506157:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130739584 00000100:00100000:2.0:1788361499.506166:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130739584 00000100:00100000:2.0:1788361499.506293:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 246 00000100:00100000:2.0:1788361499.506304:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+32:34231:x1875232130739584:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361499.506328:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361499.506379:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6ab expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506591:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157f3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506609:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506622:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361499.506635:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 0 00010000:00010000:2.0:1788361499.506780:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157f3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506789:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157f3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506806:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157f3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506813:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361499.506818:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157f3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506839:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157f3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506852:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:2.0:1788361499.506855:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361499.506860:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157f3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506874:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66157f3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506942:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ab expref: 34 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.506981:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361499.506984:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361499.506988:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66157ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ab expref: 34 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.507009:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:2.0:1788361499.507126:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+33:34231:x1875232130739584:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 823us (1186us total) trans 30064771285 rc 301/301 00000100:00100000:2.0:1788361499.507135:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 246 00000100:00100000:0.0:1788361499.510715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361499.510828:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130739712 00000100:00100000:3.0:1788361499.510838:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130739712 00000100:00100000:3.0:1788361499.510925:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 247 00000100:00100000:3.0:1788361499.510936:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+33:34231:x1875232130739712:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788361499.511009:0:37551:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x16:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788361499.511224:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+33:34231:x1875232130739712:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 289us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361499.511243:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 247 00000100:00100000:0.0:1788361499.514395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.514484:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130739840 00000100:00100000:1.0:1788361499.514494:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130739840 00000100:00100000:1.0:1788361499.514559:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 248 00000100:00100000:1.0:1788361499.514570:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:34231:x1875232130739840:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361499.514591:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361499.514627:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615801 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6b2 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.514697:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615808 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.514713:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615808 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.514725:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615808 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361499.514785:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788361499.514790:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361499.514815:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615808 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.514842:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d6615801 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6b2 expref: 35 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.514860:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615808 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6b2 expref: 34 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.514868:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32800) 00010000:00010000:1.0:1788361499.514871:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361499.514875:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623e00, rc 0) 00000100:00100000:1.0:1788361499.514932:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+34:34231:x1875232130739840:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 365us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361499.514940:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 248 00000100:00100000:0.0:1788361499.518517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.518618:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130740096 00000100:00100000:1.0:1788361499.518639:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130740096 00000100:00100000:1.0:1788361499.518690:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 249 00000100:00100000:1.0:1788361499.518698:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:34231:x1875232130740096:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361499.518716:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361499.518719:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361499.518742:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615808 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6b2 expref: 34 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.518756:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32800) 00010000:00010000:1.0:1788361499.518771:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361499.518784:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d661580f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6b9 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361499.519205:0:35347:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc6:0x0], index 1: 0 00010000:00010000:1.0:1788361499.519743:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615816 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.519760:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615816 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.519771:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615816 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.519835:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d661580f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6b9 expref: 36 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.519858:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615816 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6b9 expref: 35 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.519882:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:1.0:1788361499.519885:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361499.519888:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622600, rc 0) 00000100:00100000:1.0:1788361499.519970:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+35:34231:x1875232130740096:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1261us (1469us total) trans 30064771286 rc 0/0 00000100:00100000:1.0:1788361499.519978:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 249 00000100:00100000:0.0:1788361499.524068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.524405:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130740224 00000100:00100000:2.0:1788361499.524415:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130740224 00000100:00100000:2.0:1788361499.524475:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 250 00000100:00100000:2.0:1788361499.524494:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:34231:x1875232130740224:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361499.524533:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361499.524565:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615824 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6c0 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.524650:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d661582b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.524666:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d661582b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.524686:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d661582b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361499.524747:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788361499.524752:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361499.524775:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d661582b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.524836:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615824 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c0 expref: 37 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.524871:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d661582b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c0 expref: 36 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.524893:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:2.0:1788361499.524896:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361499.524899:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9400, rc 0) 00000100:00100000:2.0:1788361499.524959:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:34231:x1875232130740224:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 466us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361499.524977:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 250 00000100:00100000:3.0:1788361499.536222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.537015:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130740480 00000100:00100000:1.0:1788361499.537026:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130740480 00000100:00100000:1.0:1788361499.537250:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 251 00000100:00100000:1.0:1788361499.537262:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+36:34231:x1875232130740480:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361499.537336:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788361499.537368:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615816 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6b9 expref: 36 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537388:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:1.0:1788361499.537414:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d661582b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c0 expref: 35 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537426:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a8beaef00) 00010000:00010000:1.0:1788361499.537433:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361499.537462:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615832 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537476:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615832 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537508:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615832 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537522:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615839 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a531f0e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537528:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615839 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a531f0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537534:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615839 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a531f0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537627:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615832 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537636:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615832 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537642:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615832 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537648:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361499.537652:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615832 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537660:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615832 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537668:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32d00) 00010000:00010000:1.0:1788361499.537671:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361499.537674:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615832 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537686:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615832 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537700:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615839 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a531f0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537706:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615839 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a531f0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537712:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615839 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a531f0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537717:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361499.537720:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615839 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a531f0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537726:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615839 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a531f0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537733:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a531f0e (ffff9a8984a32800) 00010000:00010000:1.0:1788361499.537735:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361499.537738:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615839 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a531f0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.537744:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615839 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a531f0e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361499.538429:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+34:34231:x1875232130740480:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1167us (2215us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361499.538442:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 251 00000100:00100000:1.0:1788361499.541356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.541760:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130740608 00000100:00100000:2.0:1788361499.541779:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130740608 00000100:00100000:2.0:1788361499.541839:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 252 00000100:00100000:2.0:1788361499.541848:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:34231:x1875232130740608:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361499.541868:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361499.541889:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615840 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6c7 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.541971:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.541986:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.541999:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.542432:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615840 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c7 expref: 36 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.542451:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c7 expref: 35 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.542460:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:2.0:1788361499.542462:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361499.542466:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8600, rc 0) 00000100:00100000:2.0:1788361499.542568:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+35:34231:x1875232130740608:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 721us (1218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361499.542575:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 252 00000100:00100000:2.0:1788361499.547745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361499.548314:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130740864 00000100:00100000:0.0:1788361499.548324:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130740864 00000100:00100000:0.0:1788361499.548392:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 253 00000100:00100000:0.0:1788361499.548401:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+35:34231:x1875232130740864:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361499.548504:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361499.548538:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361499.548551:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361499.551264:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].8, 88 off8824 00000004:00080000:0.0:1788361499.551284:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 889566197956ns, next at 890566194509ns, rc = 0 00000004:00010000:0.0:1788361499.551423:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000010691302 reply state 00000000e6ae67a5 transno 30064771287 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361499.551436:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361499.551848:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+37:34231:x1875232130740864:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 3443us (4320us total) trans 30064771287 rc 0/0 00000100:00100000:0.0:1788361499.551858:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 253 00010000:00010000:1.0:1788361499.555736:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.555755:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.555762:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.555769:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361499.555774:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.555782:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.555801:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:1.0:1788361499.555805:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788361499.555811:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.555817:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661584e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361499.555913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.556340:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130740992 00000100:00100000:1.0:1788361499.556349:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130740992 00000100:00100000:1.0:1788361499.556411:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 254 00000100:00100000:1.0:1788361499.556421:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+36:34231:x1875232130740992:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361499.556446:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361499.556464:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615855 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6ce expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.556606:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615855 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ce expref: 37 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.556621:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615855 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ce expref: 37 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.556640:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:1.0:1788361499.556642:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361499.556645:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623000, rc 0) 00000100:00100000:1.0:1788361499.556710:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+37:34231:x1875232130740992:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 291us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361499.556717:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 254 00000100:00100000:1.0:1788361499.558902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.559197:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130741120 00000100:00100000:2.0:1788361499.559206:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130741120 00000100:00100000:2.0:1788361499.559325:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1788361499.559335:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130741120:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788361499.559663:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130741120:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 328us (766us total) trans 30064771099 rc 0/0 00000100:00100000:2.0:1788361499.559686:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00080000:1.0:1788361499.560269:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361499.561841:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.561919:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130741376 00000100:00100000:1.0:1788361499.561936:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130741376 00000100:00100000:1.0:1788361499.561997:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:1.0:1788361499.562006:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:34231:x1875232130741376:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.562577:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:34231:x1875232130741376:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 571us (740us total) trans 30064771288 rc 0/0 00000100:00100000:1.0:1788361499.562586:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:0.0:1788361499.564531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.564805:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130741632 00000100:00100000:2.0:1788361499.564814:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130741632 00000100:00100000:2.0:1788361499.564867:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 255 00000100:00100000:2.0:1788361499.564887:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+38:34231:x1875232130741632:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788361499.564997:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+38:34231:x1875232130741632:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 112us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361499.565006:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 255 00000100:00100000:0.0:1788361499.566925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.567048:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130741760 00000100:00100000:2.0:1788361499.567057:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130741760 00000100:00100000:2.0:1788361499.567170:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 256 00000100:00100000:2.0:1788361499.567180:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+38:34231:x1875232130741760:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361499.567204:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361499.567236:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d661585c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6d5 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.567413:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615863 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.567430:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615863 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.567442:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615863 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361499.567538:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361499.567563:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615863 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.567608:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d661585c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6d5 expref: 40 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.567628:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615863 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6d5 expref: 39 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.567636:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:2.0:1788361499.567639:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788361499.567643:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361499.567700:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+39:34231:x1875232130741760:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 522us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361499.567708:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 256 00000100:00100000:0.0:1788361499.571000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.571165:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130741888 00000100:00100000:2.0:1788361499.571173:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130741888 00000100:00100000:2.0:1788361499.571271:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788361499.571280:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130741888:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361499.571300:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361499.571321:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661586a lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6dc expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361499.571347:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983b1c, blocks: 0x1 00010000:00010000:2.0:1788361499.571370:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=889s v=(0 0) 00010000:00010000:2.0:1788361499.571374:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361499.571385:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661586a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6dc expref: 9 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.571424:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661586a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6dc expref: 9 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361499.571437:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8400, rc 0) 00000100:00100000:2.0:1788361499.571495:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130741888:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 216us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361499.571502:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:0.0:1788361499.573538:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.573638:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130742144 00000100:00100000:1.0:1788361499.573646:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130742144 00000100:00100000:1.0:1788361499.573696:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 257 00000100:00100000:1.0:1788361499.573705:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:34231:x1875232130742144:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.573870:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:34231:x1875232130742144:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 165us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361499.573878:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 257 00000100:00100000:0.0:1788361499.579805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361499.579906:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130742272 00000100:00100000:3.0:1788361499.579915:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130742272 00000100:00100000:3.0:1788361499.580025:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788361499.580036:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+9:34231:x1875232130742272:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361499.580055:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361499.580074:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6e3 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361499.580138:0:35980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661586a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6dc expref: 10 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361499.580167:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361499.580172:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361499.580178:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 10 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361499.580212:0:35980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661586a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6dc expref: 10 pid: 35982 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361499.580225:0:35980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661586a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6dc expref: 10 pid: 35982 timeout: 989 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361499.580251:0:35980:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:35980:1875232144224512:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361499.580874:0:35980:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361499.582999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.583125:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130742400 00000100:00100000:1.0:1788361499.583134:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130742400 00010000:00010000:1.0:1788361499.583172:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661586a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6dc expref: 11 pid: 35982 timeout: 989 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361499.583211:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:1.0:1788361499.583220:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130742400:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361499.583247:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788361499.583274:0:35980:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:35980:1875232144224512:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361499.583280:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661586a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6dc expref: 11 pid: 35982 timeout: 989 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.583291:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661586a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6dc expref: 11 pid: 35982 timeout: 989 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361499.583370:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 11 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.583370:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d661586a lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6dc expref: 11 pid: 35982 timeout: 989 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.583387:0:35331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361499.583392:0:35331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361499.583400:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 10 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361499.583422:0:35331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 10 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361499.583433:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb200, rc 0) 00010000:00010000:1.0:1788361499.583453:0:35331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 10 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361499.583466:0:35331:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:35331:1875232144224640:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361499.583589:0:35331:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ed0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788361499.583765:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:34231:x1875232130742272:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 3728us (3964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361499.583773:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:1.0:1788361499.587438:0:35331:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:35331:1875232144224640:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361499.587469:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361499.587528:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+9:2349:x1875232130742400:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 4308us (4535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361499.587540:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:2.0:1788361499.603272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.603491:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130742528 00000100:00100000:1.0:1788361499.603500:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130742528 00002000:00100000:1.0:1788361499.603562:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (0->1048575) req@ffff9a8ab710dc00 x1875232130742528/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.603573:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710dc00 with x1875232130742528 ext(0->1048575) 00002000:00010000:1.0:1788361499.603580:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710dc00 00000100:00100000:1.0:1788361499.603676:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:1.0:1788361499.603687:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130742528:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361499.626779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.626854:0:35988:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788361499.626865:0:35988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788361499.627609:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+11:2350:x1875232130742528:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 23921us (24343us total) trans 30064771100 rc 0/0 00000100:00100000:1.0:1788361499.627637:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00002000:00100000:1.0:1788361499.627650:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (0->1048575) req@ffff9a8ab710dc00 x1875232130742528/t30064771100(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.627661:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710dc00 with x1875232130742528 ext(0->1048575) 00002000:00010000:1.0:1788361499.627735:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710dc00 00000100:00100000:1.0:1788361499.627760:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130742656 00000100:00100000:1.0:1788361499.627766:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130742656 00002000:00100000:1.0:1788361499.627802:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (1048576->2097151) req@ffff9a898af34000 x1875232130742656/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.627811:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af34000 with x1875232130742656 ext(1048576->2097151) 00002000:00010000:1.0:1788361499.627814:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af34000 00000100:00100000:1.0:1788361499.627846:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:1.0:1788361499.627855:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130742656:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.641890:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130742656:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 14025us (15111us total) trans 30064771101 rc 0/0 00000100:00100000:1.0:1788361499.641905:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00002000:00100000:1.0:1788361499.641918:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (1048576->2097151) req@ffff9a898af34000 x1875232130742656/t30064771101(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.641928:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af34000 with x1875232130742656 ext(1048576->2097151) 00002000:00010000:1.0:1788361499.641935:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af34000 00000100:00100000:0.0:1788361499.648747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361499.648837:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130742784 00000100:00100000:3.0:1788361499.648846:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130742784 00002000:00100000:3.0:1788361499.648909:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (2097152->3145727) req@ffff9a898af37800 x1875232130742784/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361499.648921:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af37800 with x1875232130742784 ext(2097152->3145727) 00002000:00010000:3.0:1788361499.648927:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af37800 00000100:00100000:3.0:1788361499.649018:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:3.0:1788361499.649029:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130742784:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361499.664506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.664600:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130742912 00000100:00100000:2.0:1788361499.664610:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130742912 00002000:00100000:2.0:1788361499.664660:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (3145728->4194303) req@ffff9a898af35180 x1875232130742912/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361499.664673:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af35180 with x1875232130742912 ext(3145728->4194303) 00002000:00010000:2.0:1788361499.664680:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af35180 00000100:00100000:2.0:1788361499.664711:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:2.0:1788361499.664721:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130742912:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.665583:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:2349:x1875232130742784:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 16550us (16840us total) trans 30064771102 rc 0/0 00000100:00100000:1.0:1788361499.666786:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00002000:00100000:1.0:1788361499.666802:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (2097152->3145727) req@ffff9a898af37800 x1875232130742784/t30064771102(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.666818:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af37800 with x1875232130742784 ext(2097152->3145727) 00002000:00010000:1.0:1788361499.666825:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af37800 00000100:00100000:3.0:1788361499.671233:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:2349:x1875232130742912:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6502us (6728us total) trans 30064771103 rc 0/0 00000100:00100000:3.0:1788361499.671260:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00002000:00100000:3.0:1788361499.671279:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (3145728->4194303) req@ffff9a898af35180 x1875232130742912/t30064771103(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361499.671290:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af35180 with x1875232130742912 ext(3145728->4194303) 00002000:00010000:3.0:1788361499.671297:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af35180 00000100:00100000:0.0:1788361499.675466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.675570:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130743040 00000100:00100000:1.0:1788361499.675580:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130743040 00002000:00100000:1.0:1788361499.675641:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (4194304->5242879) req@ffff9a898af35c00 x1875232130743040/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.675658:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af35c00 with x1875232130743040 ext(4194304->5242879) 00002000:00010000:1.0:1788361499.675665:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af35c00 00000100:00100000:1.0:1788361499.675706:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1788361499.675716:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+17:2350:x1875232130743040:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.682422:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+19:2350:x1875232130743040:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6697us (6954us total) trans 30064771104 rc 0/0 00000100:00100000:1.0:1788361499.682435:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00002000:00100000:1.0:1788361499.682448:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (4194304->5242879) req@ffff9a898af35c00 x1875232130743040/t30064771104(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.682460:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af35c00 with x1875232130743040 ext(4194304->5242879) 00002000:00010000:1.0:1788361499.682467:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af35c00 00000100:00100000:3.0:1788361499.686033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.686588:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130743168 00000100:00100000:1.0:1788361499.686599:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130743168 00002000:00100000:1.0:1788361499.686652:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (5242880->6291455) req@ffff9a89858af100 x1875232130743168/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.686679:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858af100 with x1875232130743168 ext(5242880->6291455) 00002000:00010000:1.0:1788361499.686685:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89858af100 00000100:00100000:1.0:1788361499.686759:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:1.0:1788361499.686769:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:2349:x1875232130743168:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.693906:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+21:2349:x1875232130743168:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7128us (7872us total) trans 30064771105 rc 0/0 00000100:00100000:1.0:1788361499.693922:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00002000:00100000:1.0:1788361499.693934:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (5242880->6291455) req@ffff9a89858af100 x1875232130743168/t30064771105(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.693945:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858af100 with x1875232130743168 ext(5242880->6291455) 00002000:00010000:1.0:1788361499.693952:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89858af100 00000100:00100000:2.0:1788361499.698648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361499.698904:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130743296 00000100:00100000:0.0:1788361499.698917:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130743296 00002000:00100000:0.0:1788361499.698981:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (6291456->7340031) req@ffff9a8ab710ed80 x1875232130743296/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.698993:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710ed80 with x1875232130743296 ext(6291456->7340031) 00002000:00010000:0.0:1788361499.699000:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710ed80 00000100:00100000:0.0:1788361499.699035:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:0.0:1788361499.699045:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:2350:x1875232130743296:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361499.707562:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+23:2350:x1875232130743296:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8507us (8912us total) trans 30064771106 rc 0/0 00000100:00100000:0.0:1788361499.707577:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00002000:00100000:0.0:1788361499.707590:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (6291456->7340031) req@ffff9a8ab710ed80 x1875232130743296/t30064771106(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.707602:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710ed80 with x1875232130743296 ext(6291456->7340031) 00002000:00010000:0.0:1788361499.707609:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710ed80 00000100:00100000:3.0:1788361499.712454:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.712564:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130743424 00000100:00100000:2.0:1788361499.712574:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130743424 00002000:00100000:2.0:1788361499.712624:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (7340032->8388607) req@ffff9a898705d880 x1875232130743424/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361499.712637:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705d880 with x1875232130743424 ext(7340032->8388607) 00002000:00010000:2.0:1788361499.712657:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705d880 00000100:00100000:2.0:1788361499.712694:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1788361499.712703:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+23:2349:x1875232130743424:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361499.720400:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:2349:x1875232130743424:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7688us (7946us total) trans 30064771107 rc 0/0 00000100:00100000:0.0:1788361499.720415:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00002000:00100000:0.0:1788361499.720427:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (7340032->8388607) req@ffff9a898705d880 x1875232130743424/t30064771107(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.720465:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705d880 with x1875232130743424 ext(7340032->8388607) 00002000:00010000:0.0:1788361499.720473:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898705d880 00000100:00100000:3.0:1788361499.720996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.721817:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130743552 00000100:00100000:1.0:1788361499.721828:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130743552 00002000:00100000:1.0:1788361499.721882:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (8388608->9437183) req@ffff9a8ac0876680 x1875232130743552/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.721893:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0876680 with x1875232130743552 ext(8388608->9437183) 00002000:00010000:1.0:1788361499.721898:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0876680 00000100:00100000:1.0:1788361499.722057:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:1.0:1788361499.722067:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+25:2350:x1875232130743552:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.734614:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+27:2350:x1875232130743552:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 12539us (13610us total) trans 30064771108 rc 0/0 00000100:00100000:1.0:1788361499.734629:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00002000:00100000:1.0:1788361499.734650:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (8388608->9437183) req@ffff9a8ac0876680 x1875232130743552/t30064771108(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.734661:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0876680 with x1875232130743552 ext(8388608->9437183) 00002000:00010000:1.0:1788361499.734668:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0876680 00000100:00100000:2.0:1788361499.735801:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.736370:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130743680 00000100:00100000:1.0:1788361499.736445:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130743680 00002000:00100000:1.0:1788361499.736548:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (9437184->10485759) req@ffff9a898b063480 x1875232130743680/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.736559:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b063480 with x1875232130743680 ext(9437184->10485759) 00002000:00010000:1.0:1788361499.736565:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b063480 00000100:00100000:1.0:1788361499.736631:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:1.0:1788361499.736642:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:2349:x1875232130743680:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.743175:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b063480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130743680:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6525us (7370us total) trans 30064771109 rc 0/0 00000100:00100000:1.0:1788361499.743189:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00002000:00100000:1.0:1788361499.743201:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (9437184->10485759) req@ffff9a898b063480 x1875232130743680/t30064771109(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.743212:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b063480 with x1875232130743680 ext(9437184->10485759) 00002000:00010000:1.0:1788361499.743218:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b063480 00000100:00100000:0.0:1788361499.751324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.751479:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130743808 00000100:00100000:2.0:1788361499.751491:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130743808 00002000:00100000:2.0:1788361499.751671:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (10485760->11534335) req@ffff9a898af35880 x1875232130743808/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361499.751682:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af35880 with x1875232130743808 ext(10485760->11534335) 00002000:00010000:2.0:1788361499.751689:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af35880 00000100:00100000:2.0:1788361499.751720:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:2.0:1788361499.751731:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130743808:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361499.760624:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:2350:x1875232130743808:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8884us (9299us total) trans 30064771110 rc 0/0 00000100:00100000:2.0:1788361499.760638:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00002000:00100000:2.0:1788361499.760651:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (10485760->11534335) req@ffff9a898af35880 x1875232130743808/t30064771110(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361499.760662:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af35880 with x1875232130743808 ext(10485760->11534335) 00002000:00010000:2.0:1788361499.760670:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af35880 00000100:00100000:3.0:1788361499.765749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361499.765863:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130743936 00000100:00100000:0.0:1788361499.765873:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130743936 00002000:00100000:0.0:1788361499.765931:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (11534336->12582911) req@ffff9a8ac0874700 x1875232130743936/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.765942:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0874700 with x1875232130743936 ext(11534336->12582911) 00002000:00010000:0.0:1788361499.765949:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0874700 00000100:00100000:0.0:1788361499.765993:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:0.0:1788361499.766002:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130743936:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361499.771951:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+33:2349:x1875232130743936:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 5938us (6201us total) trans 30064771111 rc 0/0 00000100:00100000:0.0:1788361499.771974:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00002000:00100000:0.0:1788361499.771986:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (11534336->12582911) req@ffff9a8ac0874700 x1875232130743936/t30064771111(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.771997:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0874700 with x1875232130743936 ext(11534336->12582911) 00002000:00010000:0.0:1788361499.772005:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0874700 00000100:00100000:3.0:1788361499.779058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.779131:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130744064 00000100:00100000:1.0:1788361499.779142:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130744064 00002000:00100000:1.0:1788361499.779195:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (12582912->13631487) req@ffff9a8ac0875500 x1875232130744064/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.779207:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0875500 with x1875232130744064 ext(12582912->13631487) 00002000:00010000:1.0:1788361499.779228:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0875500 00000100:00100000:1.0:1788361499.779267:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:1.0:1788361499.779277:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+33:2350:x1875232130744064:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.787802:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+35:2350:x1875232130744064:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8516us (8744us total) trans 30064771112 rc 0/0 00000100:00100000:1.0:1788361499.787816:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00002000:00100000:1.0:1788361499.787829:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (12582912->13631487) req@ffff9a8ac0875500 x1875232130744064/t30064771112(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.787840:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0875500 with x1875232130744064 ext(12582912->13631487) 00002000:00010000:1.0:1788361499.787848:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0875500 00000100:00100000:3.0:1788361499.792436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.792773:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130744192 00000100:00100000:1.0:1788361499.792784:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130744192 00002000:00100000:1.0:1788361499.793191:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (13631488->14680063) req@ffff9a8ac0877480 x1875232130744192/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.793200:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0877480 with x1875232130744192 ext(13631488->14680063) 00002000:00010000:1.0:1788361499.793206:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0877480 00000100:00100000:1.0:1788361499.793229:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:1.0:1788361499.793238:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:2352:x1875232130744192:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361499.812196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361499.812452:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130744320 00000100:00100000:0.0:1788361499.812462:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130744320 00002000:00100000:0.0:1788361499.812514:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (14680064->15728639) req@ffff9a8ac0874380 x1875232130744320/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.812525:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0874380 with x1875232130744320 ext(14680064->15728639) 00002000:00010000:0.0:1788361499.812540:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0874380 00000100:00100000:0.0:1788361499.812580:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:0.0:1788361499.812594:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+37:2351:x1875232130744320:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.816506:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+39:2352:x1875232130744192:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 23259us (24070us total) trans 30064771113 rc 0/0 00000100:00100000:1.0:1788361499.816520:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00002000:00100000:1.0:1788361499.816532:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (13631488->14680063) req@ffff9a8ac0877480 x1875232130744192/t30064771113(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.816562:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0877480 with x1875232130744192 ext(13631488->14680063) 00002000:00010000:1.0:1788361499.816569:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0877480 00000100:00100000:0.0:1788361499.821239:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:2351:x1875232130744320:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8630us (9034us total) trans 30064771114 rc 0/0 00000100:00100000:0.0:1788361499.821254:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00002000:00100000:0.0:1788361499.821267:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (14680064->15728639) req@ffff9a8ac0874380 x1875232130744320/t30064771114(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.821277:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0874380 with x1875232130744320 ext(14680064->15728639) 00002000:00010000:0.0:1788361499.821285:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0874380 00000100:00100000:2.0:1788361499.828212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361499.828602:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130744448 00000100:00100000:0.0:1788361499.828612:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130744448 00002000:00100000:0.0:1788361499.828661:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (15728640->16777215) req@ffff9a898b060380 x1875232130744448/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.828671:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b060380 with x1875232130744448 ext(15728640->16777215) 00002000:00010000:0.0:1788361499.828677:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b060380 00000100:00100000:0.0:1788361499.828756:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:0.0:1788361499.828765:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130744448:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361499.841755:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+41:2349:x1875232130744448:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 12980us (13543us total) trans 30064771115 rc 0/0 00000100:00100000:0.0:1788361499.841771:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00002000:00100000:0.0:1788361499.841784:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (15728640->16777215) req@ffff9a898b060380 x1875232130744448/t30064771115(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.841817:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b060380 with x1875232130744448 ext(15728640->16777215) 00002000:00010000:0.0:1788361499.841825:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b060380 00000100:00100000:2.0:1788361499.846996:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.850062:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130744576 00000100:00100000:1.0:1788361499.850077:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130744576 00002000:00100000:1.0:1788361499.850155:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (16777216->17825791) req@ffff9a898b063b80 x1875232130744576/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.850168:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b063b80 with x1875232130744576 ext(16777216->17825791) 00002000:00010000:1.0:1788361499.850176:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b063b80 00000100:00100000:1.0:1788361499.850206:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:1.0:1788361499.850216:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+41:2350:x1875232130744576:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.857079:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b063b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+43:2350:x1875232130744576:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6854us (10082us total) trans 30064771116 rc 0/0 00000100:00100000:1.0:1788361499.857125:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00002000:00100000:1.0:1788361499.857139:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (16777216->17825791) req@ffff9a898b063b80 x1875232130744576/t30064771116(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.857150:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b063b80 with x1875232130744576 ext(16777216->17825791) 00002000:00010000:1.0:1788361499.857157:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b063b80 00000100:00100000:2.0:1788361499.864051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.864166:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130744704 00000100:00100000:1.0:1788361499.864176:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130744704 00002000:00100000:1.0:1788361499.864226:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (17825792->18874367) req@ffff9a898b062300 x1875232130744704/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.864239:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b062300 with x1875232130744704 ext(17825792->18874367) 00002000:00010000:1.0:1788361499.864258:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b062300 00000100:00100000:1.0:1788361499.864295:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:1.0:1788361499.864305:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130744704:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.871177:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+45:2349:x1875232130744704:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6864us (7125us total) trans 30064771117 rc 0/0 00000100:00100000:1.0:1788361499.871192:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00002000:00100000:1.0:1788361499.871210:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (17825792->18874367) req@ffff9a898b062300 x1875232130744704/t30064771117(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.871222:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b062300 with x1875232130744704 ext(17825792->18874367) 00002000:00010000:1.0:1788361499.871228:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b062300 00000100:00100000:2.0:1788361499.875477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361499.875588:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130744832 00000100:00100000:0.0:1788361499.875599:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130744832 00002000:00100000:0.0:1788361499.875647:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (18874368->19922943) req@ffff9a898b060700 x1875232130744832/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.875660:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b060700 with x1875232130744832 ext(18874368->19922943) 00002000:00010000:0.0:1788361499.875677:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b060700 00000100:00100000:0.0:1788361499.875709:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1788361499.875720:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+45:2350:x1875232130744832:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.881671:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:2350:x1875232130744832:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 5942us (6193us total) trans 30064771118 rc 0/0 00000100:00100000:1.0:1788361499.881686:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00002000:00100000:1.0:1788361499.881698:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (18874368->19922943) req@ffff9a898b060700 x1875232130744832/t30064771118(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.881709:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b060700 with x1875232130744832 ext(18874368->19922943) 00002000:00010000:1.0:1788361499.881716:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b060700 00000100:00100000:2.0:1788361499.887407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361499.888011:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130744960 00000100:00100000:0.0:1788361499.888020:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130744960 00002000:00100000:0.0:1788361499.888072:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (19922944->20971519) req@ffff9a898b063100 x1875232130744960/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.888122:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b063100 with x1875232130744960 ext(19922944->20971519) 00002000:00010000:0.0:1788361499.888129:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b063100 00000100:00100000:0.0:1788361499.888157:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:0.0:1788361499.888167:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+47:2349:x1875232130744960:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361499.897143:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b063100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+49:2349:x1875232130744960:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8966us (9734us total) trans 30064771119 rc 0/0 00000100:00100000:2.0:1788361499.897157:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00002000:00100000:2.0:1788361499.897172:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (19922944->20971519) req@ffff9a898b063100 x1875232130744960/t30064771119(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361499.897183:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b063100 with x1875232130744960 ext(19922944->20971519) 00002000:00010000:2.0:1788361499.897192:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b063100 00000100:00100000:3.0:1788361499.897659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.897737:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130745088 00000100:00100000:1.0:1788361499.897746:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130745088 00002000:00100000:1.0:1788361499.897786:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (20971520->22020095) req@ffff9a8ac0877b80 x1875232130745088/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.897796:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0877b80 with x1875232130745088 ext(20971520->22020095) 00002000:00010000:1.0:1788361499.897800:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0877b80 00000100:00100000:1.0:1788361499.897846:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1788361499.897855:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+49:2350:x1875232130745088:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.905454:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+51:2350:x1875232130745088:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7590us (7787us total) trans 30064771120 rc 0/0 00000100:00100000:1.0:1788361499.905469:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00002000:00100000:1.0:1788361499.905482:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (20971520->22020095) req@ffff9a8ac0877b80 x1875232130745088/t30064771120(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.905493:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0877b80 with x1875232130745088 ext(20971520->22020095) 00002000:00010000:1.0:1788361499.905501:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0877b80 00000100:00100000:0.0:1788361499.913662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.913777:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130745216 00000100:00100000:1.0:1788361499.913787:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130745216 00002000:00100000:1.0:1788361499.913841:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (22020096->23068671) req@ffff9a898af34380 x1875232130745216/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.913853:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af34380 with x1875232130745216 ext(22020096->23068671) 00002000:00010000:1.0:1788361499.913858:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af34380 00000100:00100000:1.0:1788361499.913930:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:1.0:1788361499.913940:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+51:2349:x1875232130745216:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361499.930518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.930632:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130745344 00000100:00100000:1.0:1788361499.930644:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130745344 00002000:00100000:1.0:1788361499.930695:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (23068672->24117247) req@ffff9a898af34e00 x1875232130745344/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.930705:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af34e00 with x1875232130745344 ext(23068672->24117247) 00002000:00010000:1.0:1788361499.930713:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af34e00 00000100:00100000:1.0:1788361499.930754:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:1.0:1788361499.930765:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+53:2350:x1875232130745344:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.931867:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130745216:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 17926us (18211us total) trans 30064771121 rc 0/0 00000100:00100000:1.0:1788361499.931876:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00002000:00100000:1.0:1788361499.931883:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (22020096->23068671) req@ffff9a898af34380 x1875232130745216/t30064771121(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.931898:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af34380 with x1875232130745216 ext(22020096->23068671) 00002000:00010000:1.0:1788361499.931902:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af34380 00000100:00100000:0.0:1788361499.940284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361499.940411:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130745472 00000100:00100000:3.0:1788361499.940421:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130745472 00000100:00100000:1.0:1788361499.941511:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+56:2350:x1875232130745344:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 10742us (10997us total) trans 30064771122 rc 0/0 00000100:00100000:1.0:1788361499.941523:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00002000:00100000:1.0:1788361499.941538:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (23068672->24117247) req@ffff9a898af34e00 x1875232130745344/t30064771122(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.941549:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af34e00 with x1875232130745344 ext(23068672->24117247) 00002000:00010000:1.0:1788361499.941556:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af34e00 00002000:00100000:2.0:1788361499.942039:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (24117248->25165823) req@ffff9a898af36680 x1875232130745472/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361499.942049:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af36680 with x1875232130745472 ext(24117248->25165823) 00002000:00010000:2.0:1788361499.942053:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af36680 00000100:00100000:2.0:1788361499.942117:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:2.0:1788361499.942127:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130745472:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361499.948997:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+57:2350:x1875232130745472:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6861us (8725us total) trans 30064771123 rc 0/0 00000100:00100000:0.0:1788361499.949029:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00002000:00100000:0.0:1788361499.949044:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (24117248->25165823) req@ffff9a898af36680 x1875232130745472/t30064771123(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361499.949055:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af36680 with x1875232130745472 ext(24117248->25165823) 00002000:00010000:0.0:1788361499.949063:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af36680 00000100:00100000:1.0:1788361499.954375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.954430:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130745600 00000100:00100000:2.0:1788361499.954440:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130745600 00002000:00100000:2.0:1788361499.954490:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (25165824->26214399) req@ffff9a89859b0a80 x1875232130745600/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361499.954501:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b0a80 with x1875232130745600 ext(25165824->26214399) 00002000:00010000:2.0:1788361499.954506:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859b0a80 00000100:00100000:2.0:1788361499.954537:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:2.0:1788361499.954547:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+57:2352:x1875232130745600:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361499.965886:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+59:2352:x1875232130745600:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 11331us (11508us total) trans 30064771124 rc 0/0 00000100:00100000:2.0:1788361499.965915:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00002000:00100000:2.0:1788361499.965927:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (25165824->26214399) req@ffff9a89859b0a80 x1875232130745600/t30064771124(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361499.965937:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b0a80 with x1875232130745600 ext(25165824->26214399) 00002000:00010000:2.0:1788361499.965945:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859b0a80 00000100:00100000:1.0:1788361499.972223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361499.972322:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130745728 00000100:00100000:2.0:1788361499.972332:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130745728 00002000:00100000:2.0:1788361499.972382:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (26214400->27262975) req@ffff9a89859b0000 x1875232130745728/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361499.972394:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b0000 with x1875232130745728 ext(26214400->27262975) 00002000:00010000:2.0:1788361499.972401:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859b0000 00000100:00100000:2.0:1788361499.972432:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1788361499.972441:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+59:2350:x1875232130745728:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361499.981023:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+61:2350:x1875232130745728:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8571us (8799us total) trans 30064771125 rc 0/0 00000100:00100000:2.0:1788361499.981038:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00002000:00100000:2.0:1788361499.981050:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (26214400->27262975) req@ffff9a89859b0000 x1875232130745728/t30064771125(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361499.981060:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b0000 with x1875232130745728 ext(26214400->27262975) 00002000:00010000:2.0:1788361499.981067:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859b0000 00000100:00100000:0.0:1788361499.988497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361499.989894:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130745856 00000100:00100000:1.0:1788361499.989907:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130745856 00002000:00100000:1.0:1788361499.989969:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (27262976->28311551) req@ffff9a898af35500 x1875232130745856/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/0 e 0 to 0 dl 1788361510 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.989980:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af35500 with x1875232130745856 ext(27262976->28311551) 00002000:00010000:1.0:1788361499.989987:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af35500 00000100:00100000:1.0:1788361499.990043:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:1.0:1788361499.990053:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+61:2349:x1875232130745856:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361499.999606:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+63:2349:x1875232130745856:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 9543us (11107us total) trans 30064771126 rc 0/0 00000100:00100000:1.0:1788361499.999622:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00002000:00100000:1.0:1788361499.999636:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (27262976->28311551) req@ffff9a898af35500 x1875232130745856/t30064771126(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:560/0 lens 488/448 e 0 to 0 dl 1788361510 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361499.999646:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af35500 with x1875232130745856 ext(27262976->28311551) 00002000:00010000:1.0:1788361499.999653:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af35500 00000100:00100000:2.0:1788361500.001412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361500.001569:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130745984 00000100:00100000:0.0:1788361500.001579:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130745984 00002000:00100000:0.0:1788361500.001625:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (28311552->29360127) req@ffff9a898b061c00 x1875232130745984/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361500.001635:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b061c00 with x1875232130745984 ext(28311552->29360127) 00002000:00010000:0.0:1788361500.001640:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b061c00 00000100:00100000:0.0:1788361500.001671:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:0.0:1788361500.001680:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+63:2351:x1875232130745984:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361500.012320:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+65:2351:x1875232130745984:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 10629us (10905us total) trans 30064771127 rc 0/0 00000100:00100000:0.0:1788361500.012334:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00002000:00100000:0.0:1788361500.012345:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (28311552->29360127) req@ffff9a898b061c00 x1875232130745984/t30064771127(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361500.012356:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b061c00 with x1875232130745984 ext(28311552->29360127) 00002000:00010000:0.0:1788361500.012363:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b061c00 00000100:00100000:2.0:1788361500.019023:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.019133:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130746112 00000100:00100000:1.0:1788361500.019143:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130746112 00002000:00100000:1.0:1788361500.019193:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (29360128->30408703) req@ffff9a8ab71b1180 x1875232130746112/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.019203:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b1180 with x1875232130746112 ext(29360128->30408703) 00002000:00010000:1.0:1788361500.019208:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab71b1180 00000100:00100000:1.0:1788361500.019250:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:1.0:1788361500.019260:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+65:2351:x1875232130746112:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361500.029405:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+67:2351:x1875232130746112:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 10137us (10389us total) trans 30064771128 rc 0/0 00000100:00100000:3.0:1788361500.029436:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00002000:00100000:3.0:1788361500.029448:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (29360128->30408703) req@ffff9a8ab71b1180 x1875232130746112/t30064771128(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.029458:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b1180 with x1875232130746112 ext(29360128->30408703) 00002000:00010000:3.0:1788361500.029464:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab71b1180 00000100:00100000:1.0:1788361500.036165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361500.036491:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130746240 00000100:00100000:2.0:1788361500.036514:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130746240 00002000:00100000:2.0:1788361500.036565:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (30408704->31457279) req@ffff9a89859b3100 x1875232130746240/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.036576:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b3100 with x1875232130746240 ext(30408704->31457279) 00002000:00010000:2.0:1788361500.036582:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859b3100 00000100:00100000:2.0:1788361500.036617:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:2.0:1788361500.036626:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+67:2351:x1875232130746240:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361500.043409:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+69:2351:x1875232130746240:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6776us (7240us total) trans 30064771129 rc 0/0 00000100:00100000:3.0:1788361500.043422:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00002000:00100000:3.0:1788361500.043433:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (30408704->31457279) req@ffff9a89859b3100 x1875232130746240/t30064771129(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.043443:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b3100 with x1875232130746240 ext(30408704->31457279) 00002000:00010000:3.0:1788361500.043450:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859b3100 00000100:00100000:1.0:1788361500.050047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361500.051517:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130746368 00000100:00100000:0.0:1788361500.051556:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130746368 00002000:00100000:0.0:1788361500.051614:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (31457280->32505855) req@ffff9a8987648700 x1875232130746368/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361500.051626:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987648700 with x1875232130746368 ext(31457280->32505855) 00002000:00010000:0.0:1788361500.051632:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8987648700 00000100:00100000:0.0:1788361500.051673:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:0.0:1788361500.051684:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+69:2349:x1875232130746368:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00010000:00010000:3.0:1788361500.066602:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361500.075893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361500.076135:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+71:2349:x1875232130746368:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 24451us (26094us total) trans 30064771130 rc 0/0 00000100:00100000:2.0:1788361500.076148:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:0.0:1788361500.076155:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130746496 00002000:00100000:2.0:1788361500.076161:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (31457280->32505855) req@ffff9a8987648700 x1875232130746368/t30064771130(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361500.076165:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130746496 00002000:00100000:2.0:1788361500.076174:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987648700 with x1875232130746368 ext(31457280->32505855) 00002000:00010000:2.0:1788361500.076181:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8987648700 00002000:00100000:0.0:1788361500.076214:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (32505856->33554431) req@ffff9a8ac0874000 x1875232130746496/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361500.076224:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0874000 with x1875232130746496 ext(32505856->33554431) 00002000:00010000:0.0:1788361500.076237:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0874000 00000100:00100000:0.0:1788361500.076270:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:0.0:1788361500.076279:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+71:2350:x1875232130746496:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361500.082906:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+73:2350:x1875232130746496:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6618us (7010us total) trans 30064771131 rc 0/0 00000100:00100000:2.0:1788361500.082919:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00002000:00100000:2.0:1788361500.082931:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (32505856->33554431) req@ffff9a8ac0874000 x1875232130746496/t30064771131(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.082941:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0874000 with x1875232130746496 ext(32505856->33554431) 00002000:00010000:2.0:1788361500.082948:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0874000 00000100:00100000:0.0:1788361500.095201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.095271:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130746624 00000100:00100000:3.0:1788361500.095281:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130746624 00002000:00100000:3.0:1788361500.095327:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (33554432->34603007) req@ffff9a898af36d80 x1875232130746624/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.095334:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af36d80 with x1875232130746624 ext(33554432->34603007) 00002000:00010000:3.0:1788361500.095340:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af36d80 00000100:00100000:3.0:1788361500.095368:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1788361500.095381:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+73:2352:x1875232130746624:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361500.109169:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+75:2352:x1875232130746624:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 13783us (13968us total) trans 30064771132 rc 0/0 00000100:00100000:3.0:1788361500.109196:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00002000:00100000:3.0:1788361500.109209:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (33554432->34603007) req@ffff9a898af36d80 x1875232130746624/t30064771132(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.109218:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af36d80 with x1875232130746624 ext(33554432->34603007) 00002000:00010000:3.0:1788361500.109226:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af36d80 00000100:00100000:0.0:1788361500.112003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361500.112191:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130746752 00000100:00100000:2.0:1788361500.112200:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130746752 00002000:00100000:2.0:1788361500.112314:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (34603008->35651583) req@ffff9a898bca3100 x1875232130746752/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.112332:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca3100 with x1875232130746752 ext(34603008->35651583) 00002000:00010000:2.0:1788361500.112338:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca3100 00000100:00100000:2.0:1788361500.112405:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:2.0:1788361500.112414:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+75:2349:x1875232130746752:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361500.121120:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+77:2349:x1875232130746752:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8672us (9089us total) trans 30064771133 rc 0/0 00000100:00100000:2.0:1788361500.121135:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00002000:00100000:2.0:1788361500.121145:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (34603008->35651583) req@ffff9a898bca3100 x1875232130746752/t30064771133(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.121152:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca3100 with x1875232130746752 ext(34603008->35651583) 00002000:00010000:2.0:1788361500.121160:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca3100 00000100:00100000:1.0:1788361500.128866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361500.129179:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130746880 00000100:00100000:2.0:1788361500.129188:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130746880 00002000:00100000:2.0:1788361500.129239:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (35651584->36700159) req@ffff9a898b120700 x1875232130746880/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.129251:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b120700 with x1875232130746880 ext(35651584->36700159) 00002000:00010000:2.0:1788361500.129257:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b120700 00000100:00100000:2.0:1788361500.129294:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:2.0:1788361500.129304:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+77:2351:x1875232130746880:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361500.140900:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+79:2351:x1875232130746880:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 11588us (12034us total) trans 30064771134 rc 0/0 00000100:00100000:2.0:1788361500.140915:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00002000:00100000:2.0:1788361500.140939:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (35651584->36700159) req@ffff9a898b120700 x1875232130746880/t30064771134(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.140950:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b120700 with x1875232130746880 ext(35651584->36700159) 00002000:00010000:2.0:1788361500.140971:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b120700 00000100:00100000:1.0:1788361500.156749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361500.156984:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130747008 00000100:00100000:0.0:1788361500.156992:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130747008 00002000:00100000:0.0:1788361500.157038:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (36700160->37748735) req@ffff9a8a834cbb80 x1875232130747008/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361500.157045:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cbb80 with x1875232130747008 ext(36700160->37748735) 00002000:00010000:0.0:1788361500.157050:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834cbb80 00000100:00100000:0.0:1788361500.157079:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1788361500.157361:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+79:2349:x1875232130747008:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361500.174169:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+81:2349:x1875232130747008:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 16795us (17415us total) trans 30064771135 rc 0/0 00000100:00100000:0.0:1788361500.174187:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00002000:00100000:0.0:1788361500.174201:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (36700160->37748735) req@ffff9a8a834cbb80 x1875232130747008/t30064771135(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361500.174211:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cbb80 with x1875232130747008 ext(36700160->37748735) 00002000:00010000:0.0:1788361500.174219:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834cbb80 00000100:00100000:1.0:1788361500.174557:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.175019:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130747136 00000100:00100000:3.0:1788361500.175029:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130747136 00002000:00100000:3.0:1788361500.175076:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (37748736->38797311) req@ffff9a8a834cb100 x1875232130747136/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.175171:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cb100 with x1875232130747136 ext(37748736->38797311) 00002000:00010000:3.0:1788361500.175177:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834cb100 00000100:00100000:3.0:1788361500.175265:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:3.0:1788361500.175275:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+81:2350:x1875232130747136:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361500.183352:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+83:2350:x1875232130747136:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8068us (8786us total) trans 30064771136 rc 0/0 00000100:00100000:0.0:1788361500.183367:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00002000:00100000:0.0:1788361500.183379:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (37748736->38797311) req@ffff9a8a834cb100 x1875232130747136/t30064771136(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361500.183390:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cb100 with x1875232130747136 ext(37748736->38797311) 00002000:00010000:0.0:1788361500.183398:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834cb100 00000100:00100000:1.0:1788361500.199074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361500.199192:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130747264 00000100:00100000:2.0:1788361500.199202:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130747264 00002000:00100000:2.0:1788361500.199253:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (38797312->39845887) req@ffff9a8a834cad80 x1875232130747264/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.199265:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cad80 with x1875232130747264 ext(38797312->39845887) 00002000:00010000:2.0:1788361500.199272:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834cad80 00000100:00100000:2.0:1788361500.199307:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788361500.199318:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+83:2349:x1875232130747264:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361500.205485:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+85:2349:x1875232130747264:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6157us (6408us total) trans 30064771137 rc 0/0 00000100:00100000:3.0:1788361500.205501:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00002000:00100000:3.0:1788361500.205514:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (38797312->39845887) req@ffff9a8a834cad80 x1875232130747264/t30064771137(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.205525:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cad80 with x1875232130747264 ext(38797312->39845887) 00002000:00010000:3.0:1788361500.205533:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834cad80 00000100:00100000:2.0:1788361500.206673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.206767:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130747392 00000100:00100000:1.0:1788361500.206787:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130747392 00002000:00100000:1.0:1788361500.206833:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (39845888->40894463) req@ffff9a8abc894380 x1875232130747392/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.206844:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc894380 with x1875232130747392 ext(39845888->40894463) 00002000:00010000:1.0:1788361500.206849:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abc894380 00000100:00100000:1.0:1788361500.206921:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:1.0:1788361500.206929:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+85:2350:x1875232130747392:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361500.212782:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+87:2350:x1875232130747392:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 5843us (6104us total) trans 30064771138 rc 0/0 00000100:00100000:2.0:1788361500.212797:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00002000:00100000:2.0:1788361500.212810:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (39845888->40894463) req@ffff9a8abc894380 x1875232130747392/t30064771138(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.212821:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc894380 with x1875232130747392 ext(39845888->40894463) 00002000:00010000:2.0:1788361500.212828:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abc894380 00000100:00100000:0.0:1788361500.226252:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361500.226683:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130747520 00000100:00100000:2.0:1788361500.226693:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130747520 00002000:00100000:2.0:1788361500.226754:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (40894464->41943039) req@ffff9a898bca3480 x1875232130747520/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.226783:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca3480 with x1875232130747520 ext(40894464->41943039) 00002000:00010000:2.0:1788361500.226789:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca3480 00000100:00100000:2.0:1788361500.226822:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:2.0:1788361500.226832:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+87:2349:x1875232130747520:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361500.236531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.236703:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130747648 00000100:00100000:3.0:1788361500.236713:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130747648 00002000:00100000:3.0:1788361500.236787:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (41943040->42811391) req@ffff9a8a834c8e00 x1875232130747648/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.236807:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834c8e00 with x1875232130747648 ext(41943040->42811391) 00002000:00010000:3.0:1788361500.236825:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834c8e00 00000100:00100000:3.0:1788361500.236862:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1788361500.236872:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+88:2352:x1875232130747648:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361500.250570:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+91:2352:x1875232130747648:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 13688us (14035us total) trans 30064771139 rc 0/0 00000100:00100000:1.0:1788361500.250652:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00002000:00100000:1.0:1788361500.250665:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (41943040->42811391) req@ffff9a8a834c8e00 x1875232130747648/t30064771139(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.250675:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834c8e00 with x1875232130747648 ext(41943040->42811391) 00002000:00010000:1.0:1788361500.250682:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834c8e00 00000100:00100000:3.0:1788361500.251601:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+91:2349:x1875232130747520:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 24766us (25356us total) trans 30064771140 rc 0/0 00000100:00100000:3.0:1788361500.252243:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00002000:00100000:3.0:1788361500.252254:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (40894464->41943039) req@ffff9a898bca3480 x1875232130747520/t30064771140(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.252264:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca3480 with x1875232130747520 ext(40894464->41943039) 00002000:00010000:3.0:1788361500.252269:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca3480 00000100:00100000:2.0:1788361500.254494:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.254635:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130747776 00000100:00100000:1.0:1788361500.254643:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130747776 00000100:00100000:1.0:1788361500.254834:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 258 00000100:00100000:1.0:1788361500.254846:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:34231:x1875232130747776:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788361500.280255:0:38000:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771287 is committed 00000004:00080000:0.0:1788361500.280268:0:38000:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1788361500.280291:0:38000:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771288 is committed 00000100:00100000:1.0:1788361500.280522:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144224768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788361500.280583:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361500.280658:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144224768 00000100:00100000:1.0:1788361500.280665:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144224768 00000100:00100000:1.0:1788361500.280714:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788361500.280724:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144224768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788361500.280899:0:36286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb size from disk: 0 -> 42811392 00002000:00010000:1.0:1788361500.280903:0:36286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb mtime from disk: 0 -> 1788361500 00002000:00010000:1.0:1788361500.280905:0:36286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361500.280907:0:36286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb ctime from disk: 1788361500 -> 1788361500 00002000:00010000:1.0:1788361500.280909:0:36286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788361500.280949:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144224768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 226us (364us total) trans 30064771141 rc 0/0 00000100:00100000:1.0:1788361500.280971:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788361500.280993:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788361500.281025:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a834c8380/2, rc 0, transno 30064771141 00000100:00100000:1.0:1788361500.281030:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144224768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1788361500.281125:0:38000:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788361500.281144:0:38000:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a811ca180 refcount 2 committed 0 result 0 batchid 25769803899 00000020:00080000:0.0:1788361500.281148:0:38000:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ac166d300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a811cae40 00000020:00080000:0.0:1788361500.281152:0:38000:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ac166d000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8abc8b1800 00000020:00080000:0.0:1788361500.281178:0:38000:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803898 batchid updated 00000100:00100000:3.0:1788361500.281181:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+16:34231:x1875232130747776:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 26333us (26691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361500.281195:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 258 00000020:00080000:3.0:1788361500.281226:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803899 committed batchid 25769803898 00000100:00100000:1.0:1788361500.281332:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361500.281342:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144224896:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788361500.281378:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361500.281430:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144224896 00000100:00100000:1.0:1788361500.281434:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144224896 00000020:00080000:3.0:1788361500.281438:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803898 00000100:00100000:1.0:1788361500.281470:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788361500.281479:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144224896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788361500.281494:0:35983:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:198 count 1 00002000:00010000:1.0:1788361500.281521:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc6:0x0] initial LVB size: 0, mtime: 0x6a983b1b, atime: 0x6a983b1b, ctime: 0x6a983b1b, blocks: 0x1 00010000:00010000:1.0:1788361500.281530:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006daa39b9/0xf6a94c97d6615878 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.281546:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=890s v=(0 0) 00010000:00010000:1.0:1788361500.281551:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361500.281557:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006daa39b9/0xf6a94c97d6615878 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.281581:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006daa39b9/0xf6a94c97d6615878 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.281592:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006daa39b9/0xf6a94c97d6615878 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.281600:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006daa39b9/0xf6a94c97d6615878 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.281624:0:35983:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788361500.282032:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144224896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 553us (651us total) trans 30064771095 rc 0/0 00000100:00100000:1.0:1788361500.282040:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788361500.282060:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788361500.282121:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361500.282133:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006daa39b9/0xf6a94c97d6615878 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.282143:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361500.282148:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006daa39b9/0xf6a94c97d6615878 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.282157:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006daa39b9/0xf6a94c97d6615878 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.282177:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006daa39b9/0xf6a94c97d6615878 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.282184:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006daa39b9/0xf6a94c97d6615878 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.282207:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361500.282208:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361500.282216:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788361500.282273:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a834c9500/2, rc 0, transno 30064771095 00000100:00100000:3.0:1788361500.282279:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144224896:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788361500.287504:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.287600:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130747904 00000100:00100000:1.0:1788361500.287609:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130747904 00000100:00100000:1.0:1788361500.287674:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1788361500.287684:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+91:2349:x1875232130747904:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788361500.390882:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771136 is committed 00000001:00080000:2.0:1788361500.390931:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771141 is committed 00000001:00080000:2.0:1788361500.390937:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771139 is committed 00000001:00080000:2.0:1788361500.391038:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771140 is committed 00000100:00100000:1.0:1788361500.391540:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130747904:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 103852us (104039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361500.391551:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:2.0:1788361500.395707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361500.397547:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130748160 00000100:00100000:0.0:1788361500.397561:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130748160 00000100:00100000:0.0:1788361500.397631:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 259 00000100:00100000:0.0:1788361500.397640:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+16:34231:x1875232130748160:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361500.397705:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361500.397733:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615863 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6d5 expref: 16 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.397752:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:0.0:1788361500.397757:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361500.397787:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.397801:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.397812:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361500.397993:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003728949c reply state 00000000f7497dca transno 30064771289 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361500.398002:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361500.398272:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:34231:x1875232130748160:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 632us (2573us total) trans 30064771289 rc 0/0 00000100:00100000:0.0:1788361500.398279:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 259 00010000:00010000:0.0:1788361500.400126:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.400163:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.400231:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.400239:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361500.400243:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.400252:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.400270:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:0.0:1788361500.400273:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361500.400278:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361500.400286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1788361500.400289:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661587f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361500.400381:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130748288 00000100:00100000:3.0:1788361500.400389:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130748288 00000100:00100000:3.0:1788361500.400440:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1788361500.400450:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130748288:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788361500.400649:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb size from disk: 42811392 -> 42811392 00002000:00010000:3.0:1788361500.400652:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb mtime from disk: 1788361500 -> 1788361499 00002000:00010000:3.0:1788361500.400653:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb atime from disk: 0 -> 1788361499 00002000:00010000:3.0:1788361500.400655:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb ctime from disk: 1788361500 -> 1788361499 00002000:00010000:3.0:1788361500.400656:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc6:0x0] updating lvb blocks from disk: 1 -> 83975 00000100:00100000:3.0:1788361500.400708:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130748288:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 255us (421us total) trans 30064771142 rc 0/0 00000100:00100000:3.0:1788361500.400713:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:2.0:1788361500.401971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.402024:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130748544 00000100:00100000:1.0:1788361500.402034:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130748544 00000100:00100000:1.0:1788361500.402115:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 260 00000100:00100000:1.0:1788361500.402126:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+16:34231:x1875232130748544:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788361500.402211:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.402231:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c7 expref: 16 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.402239:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.402275:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c7 expref: 16 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.402288:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c7 expref: 16 pid: 35347 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361500.402302:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144225024:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361500.402387:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361500.404270:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144225024:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361500.404299:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361500.405201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.405326:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130748672 00000100:00100000:3.0:1788361500.405333:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130748672 00010000:00010000:3.0:1788361500.405374:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c7 expref: 17 pid: 35347 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361500.405410:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:3.0:1788361500.405420:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+17:2349:x1875232130748672:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361500.405435:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361500.405442:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c7 expref: 17 pid: 35347 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.405454:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c7 expref: 17 pid: 35347 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.405478:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615847 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6c7 expref: 17 pid: 35347 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.405494:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:3.0:1788361500.405508:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.405519:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.405527:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.405557:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361500.405615:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+16:2349:x1875232130748672:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 196us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361500.405622:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00010000:00010000:1.0:1788361500.405921:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.405930:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.405970:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.405985:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.405991:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.405996:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361500.406001:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.406008:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.406019:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:1.0:1788361500.406021:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788361500.406025:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.406031:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615886 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361500.406115:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:34231:x1875232130748544:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 3991us (4159us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788361500.406123:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 260 00000100:00100000:2.0:1788361500.408362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.408479:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130748800 00000100:00100000:1.0:1788361500.408488:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130748800 00000100:00100000:1.0:1788361500.408544:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:1.0:1788361500.408553:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130748800:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788361500.408597:0:35982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.408632:0:35982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 9 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.408642:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788361500.408647:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361500.408652:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.408689:0:35982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 9 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.408704:0:35982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 9 pid: 35980 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361500.408720:0:35982:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:35982:1875232144225152:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361500.408866:0:35982:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361500.415828:0:35982:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:35982:1875232144225152:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361500.415860:0:35982:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361500.466484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361500.466585:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130748928 00000100:00100000:0.0:1788361500.466595:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130748928 00010000:00010000:0.0:1788361500.466634:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 10 pid: 35980 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361500.466678:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:0.0:1788361500.466688:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130748928:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361500.466703:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361500.466742:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 10 pid: 35980 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.466757:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 10 pid: 35980 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.466782:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0c003a5/0xf6a94c97d6615871 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6e3 expref: 10 pid: 35980 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.466799:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361500.466804:0:35333:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361500.466810:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.466822:0:35333:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.466895:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361500.466950:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130748928:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 263us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361500.466965:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00010000:00010000:2.0:1788361500.467316:0:35982:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.467326:0:35982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.467425:0:35982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.467434:0:35982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.467454:0:35982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.467461:0:35982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361500.467466:0:35982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.467476:0:35982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.467489:0:35982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361500.467497:0:35982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f3f31f5/0xf6a94c97d661588d lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361500.467598:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:2350:x1875232130748800:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 59045us (59241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361500.467606:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:2.0:1788361500.469401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.469480:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130749184 00000100:00100000:3.0:1788361500.469489:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130749184 00000100:00100000:3.0:1788361500.469552:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 261 00000100:00100000:3.0:1788361500.469561:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:34231:x1875232130749184:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788361500.469639:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615894 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.469657:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615894 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.469669:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615894 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.470650:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.470666:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615855 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ce expref: 16 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.470691:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.470726:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615855 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ce expref: 16 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.470741:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615855 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ce expref: 16 pid: 35346 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361500.470757:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144225280:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361500.470888:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bada3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361500.473856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.473914:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144225280:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361500.473943:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361500.473963:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130749312 00000100:00100000:2.0:1788361500.473971:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130749312 00010000:00010000:2.0:1788361500.474007:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615855 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ce expref: 17 pid: 35346 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361500.474645:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:2.0:1788361500.474657:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8984bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+17:2350:x1875232130749312:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361500.474675:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361500.474683:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615855 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ce expref: 17 pid: 35346 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.474712:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615855 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ce expref: 17 pid: 35346 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.474736:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615855 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ce expref: 17 pid: 35346 timeout: 990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.474752:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:2.0:1788361500.474758:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.474767:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.474775:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.474808:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361500.474859:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8984bb5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+16:2350:x1875232130749312:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 204us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361500.474868:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00010000:00010000:3.0:1788361500.474873:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.474882:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361500.475563:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771290 00000001:00080000:3.0:1788361500.475715:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771291 00000001:00080000:3.0:1788361500.475757:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771292 00000100:00100000:3.0:1788361500.475842:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144225408:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361500.475889:0:35347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361500.475917:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857c5780 going to sleep for 11 seconds 00000100:00100000:0.0:1788361500.475928:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144225408 00000100:00100000:0.0:1788361500.475936:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144225408 00000100:00100000:0.0:1788361500.475989:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788361500.475999:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144225408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788361500.476076:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144225408:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361500.476118:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788361500.476216:0:35347:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771141 gen 2 00000004:00080000:3.0:1788361500.476221:0:35347:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a834c8380, transno 30064771141 00000100:00100000:3.0:1788361500.476286:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144225408:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788361500.476915:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771293 00000100:00100000:3.0:1788361500.476985:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144225536:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788361500.477018:0:35347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361500.477048:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361500.478557:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144225536 00000100:00100000:2.0:1788361500.478567:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144225536 00000100:00100000:2.0:1788361500.478630:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788361500.478640:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144225536:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361500.478846:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35347:x1875232144225536:12345-0@lo:1000:mdt00_002.0 Request processed in 208us (1827us total) trans 30064771143 rc 0/0 00000100:00100000:2.0:1788361500.478852:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788361500.478899:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144225536:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788361500.478937:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.478948:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.478967:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.478974:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361500.478978:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.478986:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479002:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8a8beae000) 00010000:00010000:3.0:1788361500.479005:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361500.479010:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479016:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb000/0xf6a94c97d661589b lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x19:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479054:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479061:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479066:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479071:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361500.479074:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479080:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479105:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:3.0:1788361500.479108:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361500.479115:0:35347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157d0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6a4 expref: 19 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479127:0:35347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157d0 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6a4 expref: 19 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479137:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157d0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6a4 expref: 19 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.479166:0:35347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8e00/0xf6a94c97d66157d0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6a4 expref: 19 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361500.479200:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0874a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144225664:192.168.203.60@tcp:105: 00000100:00100000:3.0:1788361500.479260:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361500.481722:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.481786:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0874a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144225664:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361500.481811:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130749440 00010000:00010000:3.0:1788361500.481813:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361500.481819:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130749440 00010000:00010000:3.0:1788361500.481828:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d66157c9 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.481865:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158a2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.481880:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158a2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.481893:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158a2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.481904:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158a2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.481910:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158a2 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361500.481928:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00010000:00010000:3.0:1788361500.481933:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158a2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.481942:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcaa00 already unused, calling callback (ffffffffc1fc84f0) 00000100:00100000:0.0:1788361500.481943:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:34229:x1875232130749440:12345-192.168.203.60@tcp:49:dd.0 00010000:00010000:3.0:1788361500.481949:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158a2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.481979:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158a2 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.481993:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:3.0:1788361500.481996:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361500.482000:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158a2 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.482007:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158a2 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.482018:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615894 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.482024:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615894 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.482030:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615894 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.482036:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361500.482039:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615894 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.482047:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615894 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.482055:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:3.0:1788361500.482058:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361500.482061:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615894 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.482078:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615894 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x16:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361500.482139:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:34229:x1875232130749440:12345-192.168.203.60@tcp:49:dd.0 Request processed in 200us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361500.482148:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:3.0:1788361500.482406:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+19:34231:x1875232130749184:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 12845us (13008us total) trans 30064771294 rc 0/0 00000100:00100000:3.0:1788361500.482415:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 261 00000020:00080000:3.0:1788361500.482419:0:35347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788361500.482806:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361500.482811:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361500.482842:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:0.0:1788361500.482847:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361500.490657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361500.490699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.490757:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130749568 00000100:00100000:3.0:1788361500.490768:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130749568 00000100:00100000:1.0:1788361500.490853:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130749824 00000100:00100000:1.0:1788361500.490858:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130749824 00000100:00100000:3.0:1788361500.490895:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:3.0:1788361500.490906:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:34229:x1875232130749568:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1788361500.490926:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361500.490947:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d66158a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6ea expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361500.490987:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc6:0x0] initial LVB size: 42811392, mtime: 0x6a983b1b, atime: 0x6a983b1b, ctime: 0x6a983b1b, blocks: 0x14807 00010000:00010000:3.0:1788361500.491010:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=890s v=(0 0) 00010000:00010000:3.0:1788361500.491014:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361500.491025:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d66158a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ea expref: 9 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.491042:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008b432c92/0xf6a94c97d66158a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 42811392->42991615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ea expref: 9 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.491056:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb000, rc 0) 00000100:00100000:3.0:1788361500.491148:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+9:34229:x1875232130749568:12345-192.168.203.60@tcp:101:dd.0 Request processed in 242us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361500.491164:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:1.0:1788361500.491173:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:34231:x1875232130749824:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361500.491421:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000004:00080000:1.0:1788361500.493245:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x19:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788361500.493393:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771295 00010000:00010000:1.0:1788361500.493457:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.493480:0:35348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.493494:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.493503:0:35348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.493511:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.493517:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.493543:0:35348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788361500.493645:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+21:34231:x1875232130749824:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 2470us (2942us total) trans 30064771296 rc 0/0 00000100:00100000:1.0:1788361500.493654:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000020:00080000:1.0:1788361500.493659:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788361500.493837:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361500.493846:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.493855:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361500.493859:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.493869:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.493898:0:35335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x19:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:2.0:1788361500.493902:0:35335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361500.493907:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.493912:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d66158b0 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x19:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.493935:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361500.493937:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361500.493938:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361500.517043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.517151:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130749952 00000100:00100000:3.0:1788361500.517162:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130749952 00002000:00100000:3.0:1788361500.517213:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (42991616->44040191) req@ffff9a898afdca80 x1875232130749952/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.517225:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdca80 with x1875232130749952 ext(42991616->44040191) 00002000:00010000:3.0:1788361500.517232:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdca80 00000100:00100000:3.0:1788361500.517264:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:3.0:1788361500.517274:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130749952:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361500.533868:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2350:x1875232130749952:12345-192.168.203.60@tcp:4:dd.0 Request processed in 16586us (16826us total) trans 30064771144 rc 0/0 00000100:00100000:2.0:1788361500.533882:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00002000:00100000:2.0:1788361500.533895:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (42991616->44040191) req@ffff9a898afdca80 x1875232130749952/t30064771144(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.533915:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdca80 with x1875232130749952 ext(42991616->44040191) 00002000:00010000:2.0:1788361500.533922:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdca80 00000100:00100000:0.0:1788361500.534457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.534530:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130750080 00000100:00100000:1.0:1788361500.534539:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130750080 00002000:00100000:1.0:1788361500.534580:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (44040192->45088767) req@ffff9a898bca0000 x1875232130750080/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.534602:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca0000 with x1875232130750080 ext(44040192->45088767) 00002000:00010000:1.0:1788361500.534606:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca0000 00000100:00100000:1.0:1788361500.534633:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:1.0:1788361500.534642:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+11:2350:x1875232130750080:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361500.541129:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130750080:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6477us (6662us total) trans 30064771145 rc 0/0 00000100:00100000:1.0:1788361500.541143:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00002000:00100000:1.0:1788361500.541156:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (44040192->45088767) req@ffff9a898bca0000 x1875232130750080/t30064771145(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.541166:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca0000 with x1875232130750080 ext(44040192->45088767) 00002000:00010000:1.0:1788361500.541173:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca0000 00000100:00100000:0.0:1788361500.553466:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361500.553574:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130750208 00000100:00100000:2.0:1788361500.553584:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130750208 00002000:00100000:2.0:1788361500.553637:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (45088768->46137343) req@ffff9a898bca3800 x1875232130750208/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.553645:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca3800 with x1875232130750208 ext(45088768->46137343) 00002000:00010000:2.0:1788361500.553651:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca3800 00000100:00100000:2.0:1788361500.553708:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:2.0:1788361500.553716:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130750208:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361500.560734:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130750208:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7008us (7267us total) trans 30064771146 rc 0/0 00000100:00100000:1.0:1788361500.560747:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00002000:00100000:1.0:1788361500.560759:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (45088768->46137343) req@ffff9a898bca3800 x1875232130750208/t30064771146(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.560769:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca3800 with x1875232130750208 ext(45088768->46137343) 00002000:00010000:1.0:1788361500.560776:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca3800 00000100:00100000:0.0:1788361500.567018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.567111:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130750336 00000100:00100000:3.0:1788361500.567122:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130750336 00002000:00100000:3.0:1788361500.567174:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (46137344->47185919) req@ffff9a898bca1180 x1875232130750336/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.567185:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca1180 with x1875232130750336 ext(46137344->47185919) 00002000:00010000:3.0:1788361500.567192:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca1180 00000100:00100000:3.0:1788361500.567237:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:3.0:1788361500.567248:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2351:x1875232130750336:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361500.577712:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130750336:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10456us (10692us total) trans 30064771147 rc 0/0 00000100:00100000:3.0:1788361500.577726:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00002000:00100000:3.0:1788361500.577738:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc6:0x0] (46137344->47185919) req@ffff9a898bca1180 x1875232130750336/t30064771147(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.577748:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca1180 with x1875232130750336 ext(46137344->47185919) 00002000:00010000:3.0:1788361500.577766:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca1180 00000100:00100000:2.0:1788361500.582501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.582609:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130750464 00000100:00100000:3.0:1788361500.582619:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130750464 00002000:00100000:3.0:1788361500.582660:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (47185920->48234495) req@ffff9a8ac1567b80 x1875232130750464/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.582668:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac1567b80 with x1875232130750464 ext(47185920->48234495) 00002000:00010000:3.0:1788361500.582673:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac1567b80 00000100:00100000:2.0:1788361500.582769:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:2.0:1788361500.582779:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+17:2352:x1875232130750464:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361500.591182:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+19:2352:x1875232130750464:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8394us (8680us total) trans 30064771148 rc 0/0 00000100:00100000:1.0:1788361500.591197:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00002000:00100000:1.0:1788361500.591210:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (47185920->48234495) req@ffff9a8ac1567b80 x1875232130750464/t30064771148(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.591241:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac1567b80 with x1875232130750464 ext(47185920->48234495) 00002000:00010000:1.0:1788361500.591251:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac1567b80 00000100:00100000:2.0:1788361500.594670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.594816:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130750592 00000100:00100000:1.0:1788361500.594826:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130750592 00002000:00100000:1.0:1788361500.594878:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (48234496->49283071) req@ffff9a8ac1566300 x1875232130750592/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.594899:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac1566300 with x1875232130750592 ext(48234496->49283071) 00002000:00010000:1.0:1788361500.594905:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac1566300 00000100:00100000:1.0:1788361500.594939:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788361500.594948:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+19:2352:x1875232130750592:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361500.605596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361500.609255:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130750720 00000100:00100000:2.0:1788361500.609272:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130750720 00002000:00100000:2.0:1788361500.609323:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (49283072->50331647) req@ffff9a898bca1c00 x1875232130750720/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.609334:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca1c00 with x1875232130750720 ext(49283072->50331647) 00002000:00010000:2.0:1788361500.609340:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca1c00 00000100:00100000:2.0:1788361500.609373:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788361500.609382:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+21:2352:x1875232130750720:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361500.612673:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+23:2352:x1875232130750592:12345-192.168.203.60@tcp:4:dd.0 Request processed in 17716us (18003us total) trans 30064771149 rc 0/0 00000100:00100000:1.0:1788361500.612687:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00002000:00100000:1.0:1788361500.612700:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (48234496->49283071) req@ffff9a8ac1566300 x1875232130750592/t30064771149(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.612711:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac1566300 with x1875232130750592 ext(48234496->49283071) 00002000:00010000:1.0:1788361500.612720:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac1566300 00000100:00100000:3.0:1788361500.629991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.630040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.631115:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130750848 00000100:00100000:1.0:1788361500.631126:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130750848 00002000:00100000:1.0:1788361500.631177:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (50331648->51380223) req@ffff9a8ac0874a80 x1875232130750848/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.631189:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0874a80 with x1875232130750848 ext(50331648->51380223) 00002000:00010000:1.0:1788361500.631195:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0874a80 00000100:00100000:1.0:1788361500.631237:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130750976 00000100:00100000:1.0:1788361500.631241:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130750976 00002000:00100000:1.0:1788361500.631257:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (51380224->52428799) req@ffff9a8ac0875880 x1875232130750976/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.631266:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0875880 with x1875232130750976 ext(51380224->52428799) 00002000:00010000:1.0:1788361500.631269:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0875880 00000100:00100000:1.0:1788361500.631282:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:1.0:1788361500.631291:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+24:2351:x1875232130750848:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361500.641237:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:2352:x1875232130750720:12345-192.168.203.60@tcp:4:dd.0 Request processed in 31844us (35651us total) trans 30064771150 rc 0/0 00000100:00100000:2.0:1788361500.641262:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00002000:00100000:2.0:1788361500.641773:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (49283072->50331647) req@ffff9a898bca1c00 x1875232130750720/t30064771150(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.641785:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca1c00 with x1875232130750720 ext(49283072->50331647) 00002000:00010000:2.0:1788361500.641792:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca1c00 00000100:00100000:2.0:1788361500.641826:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:2.0:1788361500.641839:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+25:2349:x1875232130750976:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361500.642486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361500.642515:0:35988:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788361500.642523:0:35988:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1788361500.643019:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130751104 00000100:00100000:0.0:1788361500.643027:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130751104 00002000:00100000:0.0:1788361500.643064:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (52428800->53477375) req@ffff9a898bca1880 x1875232130751104/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361500.643073:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca1880 with x1875232130751104 ext(52428800->53477375) 00002000:00010000:0.0:1788361500.643078:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca1880 00000100:00100000:1.0:1788361500.644605:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:2351:x1875232130750848:12345-192.168.203.60@tcp:4:dd.0 Request processed in 13307us (14616us total) trans 30064771151 rc 0/0 00000100:00100000:1.0:1788361500.644616:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00002000:00100000:1.0:1788361500.644626:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (50331648->51380223) req@ffff9a8ac0874a80 x1875232130750848/t30064771151(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.644636:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0874a80 with x1875232130750848 ext(50331648->51380223) 00002000:00010000:1.0:1788361500.644642:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0874a80 00000100:00100000:1.0:1788361500.644662:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:1.0:1788361500.644671:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:2350:x1875232130751104:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361500.653693:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130750976:12345-192.168.203.60@tcp:4:dd.0 Request processed in 11847us (23641us total) trans 30064771152 rc 0/0 00000100:00100000:2.0:1788361500.653707:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00002000:00100000:2.0:1788361500.653720:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (51380224->52428799) req@ffff9a8ac0875880 x1875232130750976/t30064771152(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.653730:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0875880 with x1875232130750976 ext(51380224->52428799) 00002000:00010000:2.0:1788361500.653736:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0875880 00000100:00100000:1.0:1788361500.656708:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130751104:12345-192.168.203.60@tcp:4:dd.0 Request processed in 12028us (14213us total) trans 30064771153 rc 0/0 00000100:00100000:1.0:1788361500.656735:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00002000:00100000:1.0:1788361500.656749:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (52428800->53477375) req@ffff9a898bca1880 x1875232130751104/t30064771153(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.656759:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca1880 with x1875232130751104 ext(52428800->53477375) 00002000:00010000:1.0:1788361500.656776:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca1880 00000100:00100000:3.0:1788361500.662740:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361500.663768:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130751232 00000100:00100000:0.0:1788361500.663778:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130751232 00002000:00100000:1.0:1788361500.664149:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (53477376->54525951) req@ffff9a8ac0876d80 x1875232130751232/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.664161:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0876d80 with x1875232130751232 ext(53477376->54525951) 00002000:00010000:1.0:1788361500.664168:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0876d80 00000100:00100000:1.0:1788361500.664203:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361500.664211:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130751232:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361500.671319:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130751232:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7097us (8577us total) trans 30064771154 rc 0/0 00000100:00100000:1.0:1788361500.671334:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00002000:00100000:1.0:1788361500.671347:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (53477376->54525951) req@ffff9a8ac0876d80 x1875232130751232/t30064771154(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.671358:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0876d80 with x1875232130751232 ext(53477376->54525951) 00002000:00010000:1.0:1788361500.671365:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0876d80 00000100:00100000:0.0:1788361500.677640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.677747:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130751360 00000100:00100000:1.0:1788361500.677765:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130751360 00002000:00100000:1.0:1788361500.677826:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc6:0x0] (54525952->55574527) req@ffff9a898bca0380 x1875232130751360/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.677846:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca0380 with x1875232130751360 ext(54525952->55574527) 00002000:00010000:1.0:1788361500.677854:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca0380 00000100:00100000:2.0:1788361500.678001:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:2.0:1788361500.678013:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130751360:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361500.683724:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:2349:x1875232130751360:12345-192.168.203.60@tcp:4:dd.0 Request processed in 5704us (6089us total) trans 30064771155 rc 0/0 00000100:00100000:3.0:1788361500.683743:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00002000:00100000:3.0:1788361500.683756:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (54525952->55574527) req@ffff9a898bca0380 x1875232130751360/t30064771155(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.683766:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca0380 with x1875232130751360 ext(54525952->55574527) 00002000:00010000:3.0:1788361500.683774:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca0380 00000100:00100000:2.0:1788361500.691510:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.691597:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130751488 00000100:00100000:1.0:1788361500.691608:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130751488 00002000:00100000:1.0:1788361500.691720:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (55574528->56623103) req@ffff9a898af36300 x1875232130751488/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.691845:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af36300 with x1875232130751488 ext(55574528->56623103) 00002000:00010000:1.0:1788361500.691851:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af36300 00000100:00100000:1.0:1788361500.691947:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:1.0:1788361500.691969:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:2352:x1875232130751488:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361500.699195:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:2352:x1875232130751488:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7229us (7684us total) trans 30064771156 rc 0/0 00000100:00100000:1.0:1788361500.699210:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00002000:00100000:1.0:1788361500.699232:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (55574528->56623103) req@ffff9a898af36300 x1875232130751488/t30064771156(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.699243:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af36300 with x1875232130751488 ext(55574528->56623103) 00002000:00010000:1.0:1788361500.699250:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af36300 00000100:00100000:0.0:1788361500.716764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.717116:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130751616 00000100:00100000:1.0:1788361500.717126:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130751616 00002000:00100000:1.0:1788361500.717186:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (56623104->57671679) req@ffff9a898bca0e00 x1875232130751616/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.717198:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca0e00 with x1875232130751616 ext(56623104->57671679) 00002000:00010000:1.0:1788361500.717205:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca0e00 00000100:00100000:1.0:1788361500.717245:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:1.0:1788361500.717255:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+35:2349:x1875232130751616:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361500.722065:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+37:2349:x1875232130751616:12345-192.168.203.60@tcp:4:dd.0 Request processed in 4803us (5300us total) trans 30064771157 rc 0/0 00000100:00100000:1.0:1788361500.722078:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00002000:00100000:1.0:1788361500.722116:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (56623104->57671679) req@ffff9a898bca0e00 x1875232130751616/t30064771157(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.722126:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca0e00 with x1875232130751616 ext(56623104->57671679) 00002000:00010000:1.0:1788361500.722132:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca0e00 00000100:00100000:3.0:1788361500.725219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361500.725349:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130751744 00000100:00100000:2.0:1788361500.725359:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130751744 00002000:00100000:2.0:1788361500.725408:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (57671680->58720255) req@ffff9a8ac0876300 x1875232130751744/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.725419:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0876300 with x1875232130751744 ext(57671680->58720255) 00002000:00010000:2.0:1788361500.725436:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0876300 00000100:00100000:2.0:1788361500.725476:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:2.0:1788361500.725485:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:2352:x1875232130751744:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361500.733414:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+39:2352:x1875232130751744:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7919us (8193us total) trans 30064771158 rc 0/0 00000100:00100000:3.0:1788361500.733429:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00002000:00100000:3.0:1788361500.733441:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (57671680->58720255) req@ffff9a8ac0876300 x1875232130751744/t30064771158(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.733451:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0876300 with x1875232130751744 ext(57671680->58720255) 00002000:00010000:3.0:1788361500.733459:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0876300 00000100:00100000:2.0:1788361500.740476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.743224:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130751872 00000100:00100000:1.0:1788361500.743238:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130751872 00002000:00100000:1.0:1788361500.743297:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (58720256->59768831) req@ffff9a8ac0a50000 x1875232130751872/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.743308:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a50000 with x1875232130751872 ext(58720256->59768831) 00002000:00010000:1.0:1788361500.743314:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0a50000 00000100:00100000:1.0:1788361500.743753:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:1.0:1788361500.743765:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:2350:x1875232130751872:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361500.748503:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+41:2350:x1875232130751872:12345-192.168.203.60@tcp:4:dd.0 Request processed in 4733us (8029us total) trans 30064771159 rc 0/0 00000100:00100000:1.0:1788361500.748519:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00002000:00100000:1.0:1788361500.748530:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (58720256->59768831) req@ffff9a8ac0a50000 x1875232130751872/t30064771159(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.748537:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a50000 with x1875232130751872 ext(58720256->59768831) 00002000:00010000:1.0:1788361500.748542:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0a50000 00000100:00100000:2.0:1788361500.753694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.753787:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130752000 00000100:00100000:1.0:1788361500.753796:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130752000 00002000:00100000:1.0:1788361500.753848:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (59768832->60817407) req@ffff9a8ac0a52d80 x1875232130752000/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.753870:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a52d80 with x1875232130752000 ext(59768832->60817407) 00002000:00010000:1.0:1788361500.753890:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0a52d80 00000100:00100000:1.0:1788361500.753924:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:1.0:1788361500.753934:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+41:2349:x1875232130752000:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361500.760304:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130752000:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6362us (6610us total) trans 30064771160 rc 0/0 00000100:00100000:1.0:1788361500.760329:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00002000:00100000:1.0:1788361500.760343:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc6:0x0] (59768832->60817407) req@ffff9a8ac0a52d80 x1875232130752000/t30064771160(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361500.760355:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a52d80 with x1875232130752000 ext(59768832->60817407) 00002000:00010000:1.0:1788361500.760362:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ac0a52d80 00000100:00100000:0.0:1788361500.764318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.764424:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130752128 00000100:00100000:3.0:1788361500.764433:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130752128 00002000:00100000:3.0:1788361500.764516:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (60817408->61865983) req@ffff9a898bca2680 x1875232130752128/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.764525:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca2680 with x1875232130752128 ext(60817408->61865983) 00002000:00010000:3.0:1788361500.764530:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca2680 00000100:00100000:3.0:1788361500.765288:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:3.0:1788361500.765298:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+43:2352:x1875232130752128:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361500.773007:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+45:2352:x1875232130752128:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7699us (8686us total) trans 30064771161 rc 0/0 00000100:00100000:3.0:1788361500.773022:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00002000:00100000:3.0:1788361500.773037:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (60817408->61865983) req@ffff9a898bca2680 x1875232130752128/t30064771161(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.773049:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca2680 with x1875232130752128 ext(60817408->61865983) 00002000:00010000:3.0:1788361500.773057:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca2680 00000100:00100000:2.0:1788361500.776758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361500.776819:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130752512 00000100:00100000:0.0:1788361500.776830:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130752512 00000100:00100000:0.0:1788361500.776934:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:0.0:1788361500.776945:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:34229:x1875232130752512:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:2.0:1788361500.776946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.777024:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130752256 00000100:00100000:3.0:1788361500.777028:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130752256 00002000:00100000:3.0:1788361500.777055:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (61865984->62914559) req@ffff9a8a9086f100 x1875232130752256/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/0 e 0 to 0 dl 1788361511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361500.777062:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086f100 with x1875232130752256 ext(61865984->62914559) 00002000:00010000:3.0:1788361500.777068:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086f100 00000100:00100000:3.0:1788361500.777121:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:3.0:1788361500.777130:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+45:2351:x1875232130752256:12345-192.168.203.60@tcp:4:dd.0 00000001:00080000:0.0:1788361500.777260:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771297 00000001:00080000:0.0:1788361500.777315:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771298 00000100:00100000:0.0:1788361500.777391:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+24:34229:x1875232130752512:12345-192.168.203.60@tcp:35:dd.0 Request processed in 446us (640us total) trans 30064771299 rc 0/0 00000100:00100000:0.0:1788361500.777400:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000020:00080000:0.0:1788361500.777405:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788361500.785027:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:2351:x1875232130752256:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7888us (8156us total) trans 30064771162 rc 0/0 00000100:00100000:2.0:1788361500.785041:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00002000:00100000:2.0:1788361500.785054:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc6:0x0] (61865984->62914559) req@ffff9a8a9086f100 x1875232130752256/t30064771162(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:561/0 lens 488/448 e 0 to 0 dl 1788361511 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361500.785065:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086f100 with x1875232130752256 ext(61865984->62914559) 00002000:00010000:2.0:1788361500.785072:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086f100 00000100:00100000:2.0:1788361500.832346:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144225920:0@lo:400:kworker.0 00000100:00100000:2.0:1788361500.832423:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361500.832449:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144225792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361500.832494:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144225920 00000100:00100000:2.0:1788361500.832501:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144225920 00000100:00100000:3.0:1788361500.832514:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361500.832549:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788361500.832558:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144225792 00000100:00100000:2.0:1788361500.832559:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144225920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361500.832565:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144225792 00000100:00100000:3.0:1788361500.832601:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361500.832609:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144225792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361500.832626:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 185663488 pending 32374784 free 3851419648 avail 3806330880 00000100:00100000:1.0:1788361500.832721:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144226048:0@lo:400:kworker.0 00000100:00100000:0.0:1788361500.832749:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144226304:0@lo:400:kworker.0 00000100:00100000:1.0:1788361500.832762:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361500.832799:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361500.832817:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144226048 00000100:00100000:3.0:1788361500.832823:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144226048 00000100:00100000:0.0:1788361500.832833:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144226304 00000100:00100000:0.0:1788361500.832839:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144226304 00000100:00100000:0.0:1788361500.832873:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788361500.832880:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144226048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361500.832915:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144226048:12345-0@lo:400:kworker.0 Request processed in 36us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361500.832923:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144226176:0@lo:400:kworker.0 00000100:00100000:0.0:1788361500.832923:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788361500.832940:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788361500.832949:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144226304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361500.832970:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361500.833009:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361500.833012:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144226304:12345-0@lo:400:kworker.0 Request processed in 63us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361500.833022:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788361500.833023:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144226176 00000100:00100000:1.0:1788361500.833028:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144226176 00000100:00100000:0.0:1788361500.833064:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144226304:0@lo:400:kworker.0 00000100:00100000:1.0:1788361500.833066:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788361500.833076:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144226176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361500.833154:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144226176:12345-0@lo:400:kworker.0 Request processed in 81us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361500.833157:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144226048:0@lo:400:kworker.0 00000100:00100000:1.0:1788361500.833169:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788361500.833170:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144225792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 557us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361500.833182:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788361500.833189:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361500.833198:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144225792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361500.833213:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144226176:0@lo:400:kworker.0 00000100:00100000:2.0:1788361500.834139:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144225920:12345-0@lo:400:kworker.0 Request processed in 1579us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361500.834149:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788361500.834249:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144225920:0@lo:400:kworker.0 00000100:00100000:2.0:1788361500.835070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.835176:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130752640 00000100:00100000:3.0:1788361500.835182:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130752640 00000100:00100000:3.0:1788361500.835229:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 262 00000100:00100000:3.0:1788361500.835236:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+24:34241:x1875232130752640:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361500.835258:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361500.835620:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6f1 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.835705:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66158be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.835721:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66158be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.835735:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66158be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361500.836413:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1788361500.836423:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361500.836507:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66158be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.836537:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6f1 expref: 26 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.836555:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66158be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6f1 expref: 25 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361500.836564:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:2.0:1788361500.836566:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361500.836570:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca200, rc 0) 00000100:00100000:2.0:1788361500.836734:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:34241:x1875232130752640:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1496us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361500.836742:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 262 00000100:00100000:0.0:1788361500.839877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361500.839942:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130752768 00000100:00100000:1.0:1788361500.839977:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130752768 00000100:00100000:1.0:1788361500.840043:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 263 00000100:00100000:1.0:1788361500.840054:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+25:34241:x1875232130752768:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:1.0:1788361500.840213:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66158c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840232:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66158c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840245:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66158c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840262:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66158cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840281:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66158cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840289:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66158cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840639:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840649:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840657:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361500.840696:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840723:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66158c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840730:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66158c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840743:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66158c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840749:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361500.840754:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66158c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840971:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66158c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840985:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:1.0:1788361500.840988:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361500.840993:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66158c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.840999:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d66158c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841012:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66158cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841018:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66158cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841023:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66158cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841034:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361500.841037:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66158cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841044:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66158cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841052:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff9a8984a32300) 00010000:00010000:1.0:1788361500.841054:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361500.841057:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66158cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841063:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66158cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841082:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841164:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841170:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841175:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361500.841178:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841184:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841201:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:1.0:1788361500.841204:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361500.841207:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361500.841213:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66158d3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361500.841390:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+25:34241:x1875232130752768:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1335us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361500.841400:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 263 00000100:00100000:0.0:1788361500.884702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361500.885007:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130752896 00000100:00100000:3.0:1788361500.885017:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130752896 00000100:00100000:3.0:1788361500.885140:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 264 00000100:00100000:3.0:1788361500.885152:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+25:34248:x1875232130752896:12345-192.168.203.60@tcp:101:stat.0 00010000:00010000:3.0:1788361500.885174:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361500.885196:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66158da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6f8 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885277:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158e1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885295:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885307:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885321:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885328:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885335:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885627:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66158ef lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885637:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66158ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885651:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66158ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361500.885687:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x16:0x0]: returning size 62914560 00000004:00200000:3.0:1788361500.885692:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361500.885728:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66158ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885742:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66158ef lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885751:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158e1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885759:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158e1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885767:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885774:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcaa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361500.885779:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158e1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885801:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158e1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885815:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:3.0:1788361500.885819:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361500.885824:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885842:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66158e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885856:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885872:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158e8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885879:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885884:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361500.885887:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885893:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158e8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885901:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf28fd24c (ffff9a8a890fae00) 00010000:00010000:3.0:1788361500.885903:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361500.885906:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158e8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885912:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf28fd24c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885944:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66158da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6f8 expref: 27 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885985:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbc00/0xf6a94c97d66158ef lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6f8 expref: 26 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361500.885993:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x16:0x0].0x0 (ffff9a8a8beae200) 00010000:00010000:3.0:1788361500.885996:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361500.885999:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcbc00, rc 0) 00000100:00100000:3.0:1788361500.886074:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:34248:x1875232130752896:12345-192.168.203.60@tcp:101:stat.0 Request processed in 924us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361500.886083:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 264 00010000:00010000:3.0:1788361501.088802:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361501.344637:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9086e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144226432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361501.344705:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361501.344756:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144226432 00000100:00100000:0.0:1788361501.344765:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144226432 00000100:00100000:0.0:1788361501.344821:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361501.344830:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144226432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361501.344867:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361501.345045:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144226432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 216us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361501.345054:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788361501.345142:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9086e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144226432:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788361501.537021:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361501.537031:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361501.537069:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:0.0:1788361501.537075:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361502.112346:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361502.855960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361502.856003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361502.856039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361502.856078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361502.856127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361502.856154:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130753536 00000100:00100000:3.0:1788361502.856163:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130753536 00000100:00100000:0.0:1788361502.856172:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130753024 00000100:00100000:0.0:1788361502.856179:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130753024 00000100:00100000:0.0:1788361502.856233:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:1.0:1788361502.856236:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130753280 00000100:00100000:1.0:1788361502.856242:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130753280 00000100:00100000:0.0:1788361502.856245:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130753024:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361502.856280:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130753408 00000100:00100000:1.0:1788361502.856284:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130753408 00000100:00100000:1.0:1788361502.856311:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:1.0:1788361502.856323:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2352:x1875232130753280:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361502.856323:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130753024:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 77us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361502.856340:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130753152 00000100:00100000:0.0:1788361502.856340:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:3.0:1788361502.856346:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130753152 00000100:00100000:1.0:1788361502.856370:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:2352:x1875232130753280:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 50us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361502.856378:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1788361502.856389:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:3.0:1788361502.856390:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:0.0:1788361502.856408:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:2352:x1875232130753408:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361502.856409:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130753536:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361502.856448:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130753536:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 45us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361502.856458:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:2352:x1875232130753408:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 55us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361502.856471:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:3.0:1788361502.856473:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1788361502.856493:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:3.0:1788361502.856501:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+26:2352:x1875232130753152:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361502.856538:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+26:2352:x1875232130753152:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361502.856544:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00080000:3.0:1788361502.856567:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361502.856571:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361502.856574:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788361502.907870:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771095 is committed 00000001:00080000:3.0:1788361502.907885:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771093 is committed 00010000:00010000:2.0:1788361503.136251:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361503.274931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361503.275176:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130753664 00000100:00100000:3.0:1788361503.275197:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130753664 00000100:00100000:3.0:1788361503.275293:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 265 00000100:00100000:3.0:1788361503.275305:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:34192:x1875232130753664:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788361503.275425:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:34192:x1875232130753664:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 122us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361503.275433:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 265 00000100:00100000:1.0:1788361503.279710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361503.279852:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130753920 00000100:00100000:2.0:1788361503.279862:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130753920 00000100:00100000:2.0:1788361503.279919:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:2.0:1788361503.279928:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:34192:x1875232130753920:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361503.281527:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:34192:x1875232130753920:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1594us (1820us total) trans 30064771300 rc 0/0 00000100:00100000:2.0:1788361503.281539:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1788361503.414247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361503.414340:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130754048 00000100:00100000:3.0:1788361503.414349:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130754048 00000100:00100000:3.0:1788361503.414457:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 266 00000100:00100000:3.0:1788361503.414468:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:34689:x1875232130754048:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:3.0:1788361503.414491:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361503.414512:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66158f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f6ff expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361503.414600:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361503.414616:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361503.414628:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361503.414811:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1788361503.414816:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 14 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361503.414891:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361503.414917:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcba00/0xf6a94c97d66158f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ff expref: 7 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361503.414945:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ff expref: 6 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361503.414955:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:3.0:1788361503.414958:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361503.414962:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb200, rc 0) 00000100:00100000:3.0:1788361503.415023:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:34689:x1875232130754048:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 557us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361503.415031:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 266 00010000:00010000:3.0:1788361504.161305:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361505.185553:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361505.314285:0:38392:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10a: Test RW-PCC with user quota on loop PCC device ========================================================== 11:05:05 (1788361505) 00000001:00080000:3.0:1788361505.492914:0:38000:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771299 is committed 00000001:00080000:3.0:1788361505.492976:0:38000:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771300 is committed 00000020:00080000:3.0:1788361505.493027:0:38000:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a857c5780 refcount 2 committed 0 result 0 batchid 25769803900 00000020:00080000:3.0:1788361505.493034:0:38000:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a867e4600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a857c59c0 00000020:00080000:3.0:1788361505.493038:0:38000:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8a867e4c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a898b0fcc00 00000020:00080000:3.0:1788361505.493060:0:38000:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803899 batchid updated 00000020:00080000:3.0:1788361505.493189:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803900 committed batchid 25769803899 00000020:00080000:3.0:1788361505.493404:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803899 00000001:00080000:2.0:1788361505.527543:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771160 is committed 00000001:00080000:2.0:1788361505.527634:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771162 is committed 00000001:00080000:2.0:1788361505.527661:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771143 is committed 00000100:00100000:1.0:1788361505.952664:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144227072:0@lo:400:kworker.0 00000100:00100000:3.0:1788361505.952669:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144226944:0@lo:400:kworker.0 00000100:00100000:2.0:1788361505.952687:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144226816:0@lo:400:kworker.0 00000100:00100000:0.0:1788361505.952740:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144226688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361505.952840:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361505.952840:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361505.957937:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144226816 00000100:00100000:1.0:1788361505.957957:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144226816 00000100:00100000:1.0:1788361505.958058:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788361505.958070:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144226816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361505.958175:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144226816:12345-0@lo:400:kworker.0 Request processed in 109us (5343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361505.958183:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788361505.958207:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361505.958237:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144227072 00000100:00100000:1.0:1788361505.958241:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144227072 00000100:00100000:1.0:1788361505.958277:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361505.958284:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144227072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361505.958355:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771095 gen 2 00000100:00100000:3.0:1788361505.958636:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361505.958697:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144226944 00000100:00100000:3.0:1788361505.958702:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144226944 00000004:00080000:2.0:1788361505.958799:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771094 committed transno 30064771095 00000004:00080000:2.0:1788361505.958825:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a834c9500, transno 30064771095 00000100:00100000:2.0:1788361505.958843:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144226816:0@lo:400:kworker.0 00000100:00100000:0.0:1788361505.958959:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361505.958993:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144226560:0@lo:400:kworker.0 00000100:00100000:0.0:1788361505.959038:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361505.959062:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144227200:0@lo:400:kworker.0 00000100:00100000:0.0:1788361505.959105:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361505.959140:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144226688 00000100:00100000:0.0:1788361505.959144:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144226688 00000100:00100000:1.0:1788361505.959595:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144227072:12345-0@lo:400:kworker.0 Request processed in 1309us (6761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361505.959605:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361505.959627:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144227200 00000100:00100000:1.0:1788361505.959631:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144227200 00000100:00100000:3.0:1788361505.959667:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788361505.959671:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788361505.959681:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144226944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361505.959683:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144227200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361505.960713:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144226560 00000100:00100000:2.0:1788361505.960733:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144226560 00000100:00100000:0.0:1788361505.960733:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788361505.960748:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144226688:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361505.960775:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788361505.960785:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144226560:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788361505.960800:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 153288704 pending 0 free 3788505088 avail 3786407936 00000100:00100000:1.0:1788361505.961591:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144227200:12345-0@lo:400:kworker.0 Request processed in 1906us (2478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361505.961603:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788361505.961646:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144226944:12345-0@lo:400:kworker.0 Request processed in 1967us (3008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361505.961657:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788361505.961687:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144227072:0@lo:400:kworker.0 00000100:00080000:3.0:1788361505.961750:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361505.961758:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361505.961773:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144227200:0@lo:400:kworker.0 00000100:00100000:0.0:1788361505.961878:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144226688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1133us (2918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361505.961887:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788361505.961934:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144227328:0@lo:400:kworker.0 00000100:00100000:0.0:1788361505.961982:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361505.961995:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771143 gen 2 00000004:00080000:1.0:1788361505.962003:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771143 committed transno 30064771143 00000100:00100000:1.0:1788361505.962041:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144226688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361505.962052:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144227328 00000100:00100000:0.0:1788361505.962059:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144227328 00000100:00080000:1.0:1788361505.962102:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361505.962124:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144226944:0@lo:400:kworker.0 00000100:00100000:0.0:1788361505.962156:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788361505.962166:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144227328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361505.962207:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144227328:12345-0@lo:400:kworker.0 Request processed in 44us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361505.962219:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788361505.962246:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144227328:0@lo:400:kworker.0 00000100:00100000:2.0:1788361505.962396:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144226560:12345-0@lo:400:kworker.0 Request processed in 1612us (3356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361505.962402:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788361505.962454:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144226560:0@lo:400:kworker.0 00010000:00010000:2.0:1788361506.208259:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361506.424182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.424318:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130754304 00000100:00100000:1.0:1788361506.424332:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130754304 00000100:00100000:1.0:1788361506.424496:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 267 00000100:00100000:1.0:1788361506.424522:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:34971:x1875232130754304:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361506.424561:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361506.424586:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615904 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f706 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.424673:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661590b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.424688:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661590b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.424700:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661590b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.424716:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615912 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.424724:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615912 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.424730:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615912 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361506.424829:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361506.425451:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615919 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425464:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615919 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425479:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615919 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361506.425490:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788361506.425687:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661590b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425695:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661590b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425702:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661590b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425709:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361506.425713:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661590b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425721:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661590b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425735:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:1.0:1788361506.425738:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361506.425742:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661590b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425747:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661590b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425761:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615912 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425768:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615912 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425780:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615912 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425785:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361506.425788:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615912 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425794:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615912 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425803:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8984a32f00) 00010000:00010000:1.0:1788361506.425805:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361506.425807:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615912 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.425814:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615912 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.426264:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615904 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f706 expref: 18 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.426281:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615919 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f706 expref: 17 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.426289:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:1.0:1788361506.426290:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361506.426293:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623000, rc 0) 00000100:00100000:1.0:1788361506.426423:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+17:34971:x1875232130754304:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1917us (2255us total) trans 30064771301 rc 0/0 00000100:00100000:1.0:1788361506.426437:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 267 00000100:00100000:0.0:1788361506.429377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.429433:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130754432 00000100:00100000:1.0:1788361506.429450:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130754432 00000100:00100000:1.0:1788361506.429522:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 268 00000100:00100000:1.0:1788361506.429534:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:34971:x1875232130754432:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788361506.429642:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:34971:x1875232130754432:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 110us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361506.429650:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 268 00000100:00100000:0.0:1788361506.431669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361506.431873:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130754560 00000100:00100000:3.0:1788361506.431883:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130754560 00000100:00100000:3.0:1788361506.431969:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1788361506.431980:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130754560:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361506.432018:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361506.432046:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615919 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f706 expref: 17 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361506.432067:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:3.0:1788361506.432072:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361506.432321:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+16:2351:x1875232130754560:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 342us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361506.432329:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1788361506.466889:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9086d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144227456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361506.466972:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361506.467117:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144227456 00000100:00100000:0.0:1788361506.467126:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144227456 00000100:00100000:0.0:1788361506.467194:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361506.467209:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144227456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361506.467247:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788361506.467608:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144227456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 401us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361506.467615:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788361506.467684:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9086d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144227456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361506.537168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.539911:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130754816 00000100:00100000:1.0:1788361506.539935:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130754816 00000100:00100000:1.0:1788361506.540011:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 269 00000100:00100000:1.0:1788361506.540022:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+16:34986:x1875232130754816:12345-192.168.203.60@tcp:36:mkdir.0 00010000:00010000:1.0:1788361506.540118:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361506.540149:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66158be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6f1 expref: 16 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.540169:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:1.0:1788361506.540174:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361506.540554:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.540570:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ff expref: 5 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.540580:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.540627:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ff expref: 5 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.540642:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ff expref: 5 pid: 35346 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361506.540657:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144227584:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361506.540754:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361506.544694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.544858:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144227584:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361506.544883:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361506.545372:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130754944 00000100:00100000:3.0:1788361506.545379:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130754944 00010000:00010000:3.0:1788361506.545426:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ff expref: 6 pid: 35346 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361506.545506:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:3.0:1788361506.545515:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130754944:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361506.545529:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361506.545535:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ff expref: 6 pid: 35346 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361506.545547:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ff expref: 6 pid: 35346 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361506.545586:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66158fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f6ff expref: 6 pid: 35346 timeout: 996 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361506.545599:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:3.0:1788361506.545605:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361506.545614:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361506.545622:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361506.545648:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361506.545691:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130754944:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 177us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361506.545698:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00010000:00010000:0.0:1788361506.545744:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.545751:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.545775:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.545784:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.545791:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361506.547160:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 512 00010000:00010000:0.0:1788361506.547176:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.547186:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.547192:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.547199:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361506.547204:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.547212:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.547226:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:0.0:1788361506.547229:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361506.547234:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.547239:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615927 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361506.547258:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000037197c76 reply state 0000000015edea77 transno 30064771302 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361506.547267:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361506.547340:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:34986:x1875232130754816:12345-192.168.203.60@tcp:36:mkdir.0 Request processed in 7317us (10180us total) trans 30064771302 rc 0/0 00000100:00100000:0.0:1788361506.547358:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 269 00000100:00080000:1.0:1788361506.547582:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788361506.555160:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.555188:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.555197:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.555205:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573ea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361506.555210:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.555236:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.555255:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff9a8a90b43400) 00010000:00010000:2.0:1788361506.555258:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361506.555263:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.555269:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ea00/0xf6a94c97d661592e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361506.560901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.561201:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130755072 00000100:00100000:1.0:1788361506.561211:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130755072 00000100:00100000:1.0:1788361506.561258:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 270 00000100:00100000:1.0:1788361506.561268:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+16:34987:x1875232130755072:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361506.561295:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361506.561317:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615935 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f70d expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.561384:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661593c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.561400:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661593c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.561430:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661593c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361506.561489:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1788361506.561493:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361506.561515:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661593c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.561539:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615935 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f70d expref: 18 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.561555:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661593c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f70d expref: 17 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.561564:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:1.0:1788361506.561567:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361506.561571:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623600, rc 0) 00000100:00100000:1.0:1788361506.561633:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+17:34987:x1875232130755072:12345-192.168.203.60@tcp:101:dd.0 Request processed in 367us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361506.561640:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 270 00000100:00100000:0.0:1788361506.567305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.567410:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130755200 00000100:00100000:1.0:1788361506.567420:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130755200 00000100:00100000:1.0:1788361506.567482:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 271 00000100:00100000:1.0:1788361506.567492:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:34987:x1875232130755200:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361506.567514:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361506.567535:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f714 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567621:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661594a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567638:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661594a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567650:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661594a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567664:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615951 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567671:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567678:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567785:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615958 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567794:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615958 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567801:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615958 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361506.567833:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 512 00000004:00200000:1.0:1788361506.567837:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361506.567860:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615958 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567884:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661594a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567890:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661594a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567897:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661594a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567903:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361506.567907:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661594a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567928:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661594a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567941:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:1.0:1788361506.567944:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361506.567948:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661594a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567954:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622a00/0xf6a94c97d661594a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567967:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615951 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567974:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615951 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567980:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.567991:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361506.567994:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615951 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.568000:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615951 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.568007:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd958ad21 (ffff9a8984a32900) 00010000:00010000:1.0:1788361506.568009:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361506.568012:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615951 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.568017:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615951 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd958ad21 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.568053:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f714 expref: 19 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.568064:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623400/0xf6a94c97d6615958 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f714 expref: 18 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.568070:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:1.0:1788361506.568072:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788361506.568074:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623400, rc 0) 00000100:00100000:1.0:1788361506.568168:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+18:34987:x1875232130755200:12345-192.168.203.60@tcp:101:dd.0 Request processed in 678us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361506.568174:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 271 00000100:00100000:2.0:1788361506.573890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361506.573975:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130755456 00000100:00100000:0.0:1788361506.573984:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130755456 00000100:00100000:0.0:1788361506.574051:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 272 00000100:00100000:0.0:1788361506.574061:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+18:34987:x1875232130755456:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361506.574082:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361506.574139:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661595f lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f71b expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.574283:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615966 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.574301:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615966 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.574314:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615966 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.574330:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.574338:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.574345:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361506.574962:0:37122:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc7:0x0], index 0: 0 00010000:00010000:0.0:1788361506.575123:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615974 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575138:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615974 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575147:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615974 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575188:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615966 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575196:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615966 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575202:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615966 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575208:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361506.575212:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615966 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575220:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615966 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575234:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:0.0:1788361506.575237:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361506.575242:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615966 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575248:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615966 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361506.575271:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dd43a842 reply state 00000000893a41b3 transno 30064771303 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361506.575280:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361506.575313:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d661595f lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f71b expref: 21 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575328:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615974 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f71b expref: 20 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.575336:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:0.0:1788361506.575338:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361506.575341:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:0.0:1788361506.575410:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+21:34987:x1875232130755456:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1350us (1529us total) trans 30064771303 rc 0/0 00000100:00100000:0.0:1788361506.575418:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 272 00010000:00010000:2.0:1788361506.577162:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.577177:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.577184:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.577190:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361506.577194:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.577201:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.577217:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff9a8a90b43d00) 00010000:00010000:2.0:1788361506.577220:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361506.577234:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.577241:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d661596d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361506.581499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.581661:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130755584 00000100:00100000:1.0:1788361506.581682:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130755584 00000100:00100000:1.0:1788361506.581778:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:1.0:1788361506.581788:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+5:34987:x1875232130755584:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361506.581808:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361506.581831:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000259755f4/0xf6a94c97d6615982 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f722 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361506.581859:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361506.581884:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=896s v=(0 0) 00010000:00010000:1.0:1788361506.581889:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361506.581901:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000259755f4/0xf6a94c97d6615982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f722 expref: 6 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.581934:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000259755f4/0xf6a94c97d6615982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f722 expref: 6 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361506.581949:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622600, rc 0) 00000100:00100000:1.0:1788361506.582006:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:34987:x1875232130755584:12345-192.168.203.60@tcp:101:dd.0 Request processed in 220us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361506.582022:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00080000:3.0:1788361506.582150:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361506.599771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.599898:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130755712 00000100:00100000:1.0:1788361506.599907:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130755712 00002000:00100000:1.0:1788361506.599964:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (0->1048575) req@ffff9a8abf16f800 x1875232130755712/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.599971:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16f800 with x1875232130755712 ext(0->1048575) 00002000:00010000:1.0:1788361506.599976:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16f800 00000100:00100000:1.0:1788361506.600012:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:1.0:1788361506.600019:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130755712:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361506.616948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361506.617036:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130755840 00000100:00100000:3.0:1788361506.617046:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130755840 00002000:00100000:3.0:1788361506.617115:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (1048576->2097151) req@ffff9a8a9086c380 x1875232130755840/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361506.617126:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086c380 with x1875232130755840 ext(1048576->2097151) 00002000:00010000:3.0:1788361506.617133:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086c380 00000100:00100000:3.0:1788361506.617171:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:3.0:1788361506.617189:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:2352:x1875232130755840:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361506.618545:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130755712:12345-192.168.203.60@tcp:4:dd.0 Request processed in 18519us (18775us total) trans 30064771096 rc 0/0 00000100:00100000:1.0:1788361506.618555:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00002000:00100000:1.0:1788361506.618566:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (0->1048575) req@ffff9a8abf16f800 x1875232130755712/t30064771096(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.618575:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16f800 with x1875232130755712 ext(0->1048575) 00002000:00010000:1.0:1788361506.618580:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16f800 00000100:00100000:0.0:1788361506.636908:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130755840:12345-192.168.203.60@tcp:4:dd.0 Request processed in 19718us (19961us total) trans 30064771097 rc 0/0 00000100:00100000:0.0:1788361506.636933:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00002000:00100000:0.0:1788361506.636945:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (1048576->2097151) req@ffff9a8a9086c380 x1875232130755840/t30064771097(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.636955:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086c380 with x1875232130755840 ext(1048576->2097151) 00002000:00010000:0.0:1788361506.636961:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086c380 00000100:00100000:0.0:1788361506.639246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361506.640562:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130755968 00000100:00100000:2.0:1788361506.640573:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130755968 00002000:00100000:2.0:1788361506.640685:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (2097152->3145727) req@ffff9a8abf16d180 x1875232130755968/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.640874:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16d180 with x1875232130755968 ext(2097152->3145727) 00002000:00010000:2.0:1788361506.640881:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16d180 00000100:00100000:2.0:1788361506.640964:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:2.0:1788361506.640974:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130755968:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361506.650515:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+12:2351:x1875232130755968:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9533us (11269us total) trans 30064771098 rc 0/0 00000100:00100000:1.0:1788361506.650529:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00002000:00100000:1.0:1788361506.650540:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (2097152->3145727) req@ffff9a8abf16d180 x1875232130755968/t30064771098(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.650551:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16d180 with x1875232130755968 ext(2097152->3145727) 00002000:00010000:1.0:1788361506.650557:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16d180 00000040:00080000:0.0:1788361506.656468:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361506.656479:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361506.656634:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 8 count 8 00000040:00080000:0.0:1788361506.656642:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361506.659463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361506.659655:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130756096 00000100:00100000:0.0:1788361506.659667:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130756096 00002000:00100000:0.0:1788361506.659720:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (3145728->4194303) req@ffff9a8a9086ce00 x1875232130756096/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.659732:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086ce00 with x1875232130756096 ext(3145728->4194303) 00002000:00010000:0.0:1788361506.659738:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086ce00 00000100:00100000:0.0:1788361506.659812:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:0.0:1788361506.659821:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130756096:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361506.665588:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130756096:12345-192.168.203.60@tcp:4:dd.0 Request processed in 5758us (6125us total) trans 30064771099 rc 0/0 00000100:00100000:0.0:1788361506.665610:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00002000:00100000:0.0:1788361506.665622:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (3145728->4194303) req@ffff9a8a9086ce00 x1875232130756096/t30064771099(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.665634:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086ce00 with x1875232130756096 ext(3145728->4194303) 00002000:00010000:0.0:1788361506.665641:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086ce00 00000100:00100000:3.0:1788361506.675991:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361506.677724:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130756224 00000100:00100000:0.0:1788361506.677738:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130756224 00002000:00100000:0.0:1788361506.677790:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (4194304->5242879) req@ffff9a8a8ae70e00 x1875232130756224/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.677802:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae70e00 with x1875232130756224 ext(4194304->5242879) 00002000:00010000:0.0:1788361506.677809:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a8ae70e00 00000100:00100000:0.0:1788361506.677893:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:0.0:1788361506.677902:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130756224:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361506.688558:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+16:2350:x1875232130756224:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10647us (12566us total) trans 30064771100 rc 0/0 00000100:00100000:0.0:1788361506.688572:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00002000:00100000:0.0:1788361506.688584:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (4194304->5242879) req@ffff9a8a8ae70e00 x1875232130756224/t30064771100(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.688594:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae70e00 with x1875232130756224 ext(4194304->5242879) 00002000:00010000:0.0:1788361506.688601:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a8ae70e00 00000100:00100000:2.0:1788361506.689925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.690003:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130756352 00000100:00100000:1.0:1788361506.690012:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130756352 00002000:00100000:1.0:1788361506.690053:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (5242880->6291455) req@ffff9a8a9086e680 x1875232130756352/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.690064:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086e680 with x1875232130756352 ext(5242880->6291455) 00002000:00010000:1.0:1788361506.690069:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086e680 00000100:00100000:1.0:1788361506.690143:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:1.0:1788361506.690152:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+16:2349:x1875232130756352:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361506.701462:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+18:2349:x1875232130756352:12345-192.168.203.60@tcp:4:dd.0 Request processed in 11299us (11545us total) trans 30064771101 rc 0/0 00000100:00100000:1.0:1788361506.701475:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00002000:00100000:1.0:1788361506.701488:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (5242880->6291455) req@ffff9a8a9086e680 x1875232130756352/t30064771101(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.701499:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086e680 with x1875232130756352 ext(5242880->6291455) 00002000:00010000:1.0:1788361506.701506:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086e680 00000100:00100000:1.0:1788361506.701930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361506.702533:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130756480 00000100:00100000:3.0:1788361506.702542:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130756480 00002000:00100000:3.0:1788361506.702582:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (6291456->7340031) req@ffff9a8a834cb480 x1875232130756480/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361506.702592:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cb480 with x1875232130756480 ext(6291456->7340031) 00002000:00010000:3.0:1788361506.702596:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cb480 00000100:00100000:3.0:1788361506.702625:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:3.0:1788361506.702633:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+18:2349:x1875232130756480:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361506.710404:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+20:2349:x1875232130756480:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7759us (8463us total) trans 30064771102 rc 0/0 00000100:00100000:3.0:1788361506.710417:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00002000:00100000:3.0:1788361506.710437:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (6291456->7340031) req@ffff9a8a834cb480 x1875232130756480/t30064771102(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361506.710448:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cb480 with x1875232130756480 ext(6291456->7340031) 00002000:00010000:3.0:1788361506.710456:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cb480 00000100:00100000:0.0:1788361506.716984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361506.717161:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130756608 00000100:00100000:2.0:1788361506.717172:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130756608 00002000:00100000:2.0:1788361506.717283:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (7340032->8388607) req@ffff9a8abf16dc00 x1875232130756608/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.717294:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16dc00 with x1875232130756608 ext(7340032->8388607) 00002000:00010000:2.0:1788361506.717301:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16dc00 00000100:00100000:2.0:1788361506.717369:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:2.0:1788361506.717380:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+20:2350:x1875232130756608:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361506.726362:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+22:2350:x1875232130756608:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8974us (9378us total) trans 30064771103 rc 0/0 00000100:00100000:3.0:1788361506.726375:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00002000:00100000:3.0:1788361506.726388:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (7340032->8388607) req@ffff9a8abf16dc00 x1875232130756608/t30064771103(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361506.726398:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16dc00 with x1875232130756608 ext(7340032->8388607) 00002000:00010000:3.0:1788361506.726406:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16dc00 00000100:00100000:0.0:1788361506.734254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.734368:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130756736 00000100:00100000:1.0:1788361506.734377:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130756736 00002000:00100000:1.0:1788361506.734484:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (8388608->9437183) req@ffff9a8abf16d880 x1875232130756736/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.734497:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16d880 with x1875232130756736 ext(8388608->9437183) 00002000:00010000:1.0:1788361506.734503:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16d880 00000100:00100000:1.0:1788361506.734544:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788361506.734554:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+22:2350:x1875232130756736:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361506.744067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361506.744190:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130756864 00000100:00100000:2.0:1788361506.744209:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130756864 00002000:00100000:2.0:1788361506.744258:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (9437184->10485759) req@ffff9a8abf16c380 x1875232130756864/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.744270:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16c380 with x1875232130756864 ext(9437184->10485759) 00002000:00010000:2.0:1788361506.744276:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16c380 00000100:00100000:2.0:1788361506.744310:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:2.0:1788361506.744319:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+24:2350:x1875232130756864:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361506.764495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361506.765901:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130756992 00000100:00100000:2.0:1788361506.765922:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130756992 00002000:00100000:2.0:1788361506.765976:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (10485760->11534335) req@ffff9a8abf16ce00 x1875232130756992/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.765989:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16ce00 with x1875232130756992 ext(10485760->11534335) 00002000:00010000:2.0:1788361506.765995:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16ce00 00000100:00100000:2.0:1788361506.766026:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:2.0:1788361506.766036:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:2349:x1875232130756992:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361506.788045:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:2350:x1875232130756736:12345-192.168.203.60@tcp:4:dd.0 Request processed in 53481us (53790us total) trans 30064771104 rc 0/0 00000100:00100000:2.0:1788361506.788060:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00002000:00100000:2.0:1788361506.788078:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc7:0x0] (8388608->9437183) req@ffff9a8abf16d880 x1875232130756736/t30064771104(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.788101:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16d880 with x1875232130756736 ext(8388608->9437183) 00002000:00010000:2.0:1788361506.788108:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16d880 00000100:00100000:2.0:1788361506.790722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361506.790778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.791423:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130757120 00000100:00100000:1.0:1788361506.791434:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130757120 00002000:00100000:1.0:1788361506.791482:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (11534336->12582911) req@ffff9a8a9086d500 x1875232130757120/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.791493:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086d500 with x1875232130757120 ext(11534336->12582911) 00002000:00010000:1.0:1788361506.791499:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086d500 00000100:00100000:1.0:1788361506.791522:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130757248 00000100:00100000:1.0:1788361506.791526:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130757248 00000100:00100000:2.0:1788361506.791702:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:2.0:1788361506.791715:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+28:2350:x1875232130757120:12345-192.168.203.60@tcp:4:dd.0 00002000:00100000:1.0:1788361506.791745:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (12582912->13631487) req@ffff9a8a9086ed80 x1875232130757248/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.791752:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086ed80 with x1875232130757248 ext(12582912->13631487) 00002000:00010000:1.0:1788361506.791755:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086ed80 00000100:00100000:0.0:1788361506.795657:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:2350:x1875232130756864:12345-192.168.203.60@tcp:4:dd.0 Request processed in 51329us (51590us total) trans 30064771105 rc 0/0 00000100:00100000:0.0:1788361506.795672:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00002000:00100000:0.0:1788361506.795684:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (9437184->10485759) req@ffff9a8abf16c380 x1875232130756864/t30064771105(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.795695:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16c380 with x1875232130756864 ext(9437184->10485759) 00002000:00010000:0.0:1788361506.795702:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16c380 00000100:00100000:0.0:1788361506.795733:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:0.0:1788361506.795744:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:2349:x1875232130757248:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361506.796823:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:2349:x1875232130756992:12345-192.168.203.60@tcp:4:dd.0 Request processed in 30783us (32332us total) trans 30064771106 rc 0/0 00000100:00100000:2.0:1788361506.796844:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00002000:00100000:2.0:1788361506.796854:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (10485760->11534335) req@ffff9a8abf16ce00 x1875232130756992/t30064771106(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.796863:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16ce00 with x1875232130756992 ext(10485760->11534335) 00002000:00010000:2.0:1788361506.796868:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf16ce00 00000100:00100000:2.0:1788361506.806546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361506.806932:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130757376 00000100:00100000:0.0:1788361506.806943:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130757376 00002000:00100000:0.0:1788361506.807006:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (13631488->14680063) req@ffff9a8a9086ca80 x1875232130757376/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.807018:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086ca80 with x1875232130757376 ext(13631488->14680063) 00002000:00010000:0.0:1788361506.807024:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086ca80 00000100:00100000:0.0:1788361506.807054:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:0.0:1788361506.807064:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+32:2349:x1875232130757376:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361506.816549:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+34:2349:x1875232130757248:12345-192.168.203.60@tcp:4:dd.0 Request processed in 20798us (25760us total) trans 30064771107 rc 0/0 00000100:00100000:0.0:1788361506.816564:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00002000:00100000:0.0:1788361506.816576:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc7:0x0] (12582912->13631487) req@ffff9a8a9086ed80 x1875232130757248/t30064771107(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.816587:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086ed80 with x1875232130757248 ext(12582912->13631487) 00002000:00010000:0.0:1788361506.816594:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086ed80 00000100:00100000:2.0:1788361506.821080:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+34:2350:x1875232130757120:12345-192.168.203.60@tcp:4:dd.0 Request processed in 29359us (30355us total) trans 30064771108 rc 0/0 00000100:00100000:2.0:1788361506.821114:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00002000:00100000:2.0:1788361506.821126:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc7:0x0] (11534336->12582911) req@ffff9a8a9086d500 x1875232130757120/t30064771108(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.821138:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086d500 with x1875232130757120 ext(11534336->12582911) 00002000:00010000:2.0:1788361506.821146:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086d500 00000100:00100000:2.0:1788361506.822654:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:2349:x1875232130757376:12345-192.168.203.60@tcp:4:dd.0 Request processed in 15584us (16110us total) trans 30064771109 rc 0/0 00000100:00100000:2.0:1788361506.822667:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00002000:00100000:2.0:1788361506.822676:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc7:0x0] (13631488->14680063) req@ffff9a8a9086ca80 x1875232130757376/t30064771109(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.822686:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086ca80 with x1875232130757376 ext(13631488->14680063) 00002000:00010000:2.0:1788361506.822703:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086ca80 00000100:00100000:1.0:1788361506.823398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361506.823476:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130757760 00000100:00100000:0.0:1788361506.823483:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130757760 00000100:00100000:0.0:1788361506.823534:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:0.0:1788361506.823544:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:34987:x1875232130757760:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:0.0:1788361506.823821:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:34987:x1875232130757760:12345-192.168.203.60@tcp:35:dd.0 Request processed in 277us (423us total) trans 30064771304 rc 0/0 00000100:00100000:0.0:1788361506.823828:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:3.0:1788361506.824134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361506.824821:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130757504 00000100:00100000:2.0:1788361506.824828:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130757504 00002000:00100000:2.0:1788361506.824946:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (14680064->15728639) req@ffff9a8a8ae73b80 x1875232130757504/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.824957:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae73b80 with x1875232130757504 ext(14680064->15728639) 00002000:00010000:2.0:1788361506.824962:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a8ae73b80 00000100:00100000:2.0:1788361506.825029:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:2.0:1788361506.825038:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:2350:x1875232130757504:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361506.835717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361506.835756:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130758016 00000100:00100000:0.0:1788361506.835764:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130758016 00000100:00100000:0.0:1788361506.835817:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 273 00000100:00100000:0.0:1788361506.835827:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:34988:x1875232130758016:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361506.836006:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361506.836029:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6615989 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f729 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.836232:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615990 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.836250:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615990 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.838005:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615990 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.838039:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.838052:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.838064:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361506.838409:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:2350:x1875232130757504:12345-192.168.203.60@tcp:4:dd.0 Request processed in 13367us (14270us total) trans 30064771110 rc 0/0 00000100:00100000:1.0:1788361506.838422:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00002000:00100000:1.0:1788361506.839122:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc7:0x0] (14680064->15728639) req@ffff9a8a8ae73b80 x1875232130757504/t30064771110(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.839134:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae73b80 with x1875232130757504 ext(14680064->15728639) 00002000:00010000:1.0:1788361506.839140:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a8ae73b80 00000004:00080000:0.0:1788361506.840021:0:35346:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc7:0x0], index 1: 0 00010000:00010000:0.0:1788361506.840303:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661599e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840323:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661599e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840336:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661599e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840394:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615990 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840402:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615990 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840408:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615990 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840414:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361506.840418:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615990 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840426:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615990 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840505:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:0.0:1788361506.840509:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361506.840515:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615990 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840521:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615990 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361506.840536:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2ac86ea reply state 000000004156370e transno 30064771305 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361506.840546:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361506.840588:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fc00/0xf6a94c97d6615989 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f729 expref: 24 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840615:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661599e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f729 expref: 23 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.840623:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:0.0:1788361506.840625:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361506.840628:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fa00, rc 0) 00000100:00100000:0.0:1788361506.840700:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+24:34988:x1875232130758016:12345-192.168.203.60@tcp:101:dd.0 Request processed in 4873us (4992us total) trans 30064771305 rc 0/0 00000100:00100000:0.0:1788361506.840709:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 273 00010000:00010000:2.0:1788361506.842643:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.842660:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.842668:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.842674:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361506.842678:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.842685:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.842702:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xdee864c2 (ffff9a8a90b43300) 00010000:00010000:2.0:1788361506.842705:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361506.842710:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361506.842732:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615997 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361506.850471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361506.852488:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130758144 00000100:00100000:3.0:1788361506.852517:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130758144 00000100:00100000:0.0:1788361506.852636:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:0.0:1788361506.852649:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+8:34988:x1875232130758144:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361506.852668:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361506.852693:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66159ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f730 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361506.852721:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361506.852748:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=896s v=(0 0) 00010000:00010000:0.0:1788361506.852753:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361506.852764:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66159ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f730 expref: 9 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.852781:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec90f2ea/0xf6a94c97d66159ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f730 expref: 9 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361506.852815:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573fc00, rc 0) 00000100:00100000:0.0:1788361506.852952:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88444050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:34988:x1875232130758144:12345-192.168.203.60@tcp:101:dd.0 Request processed in 306us (2490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361506.852960:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00080000:1.0:1788361506.853255:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361506.877331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361506.877482:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130758272 00000100:00100000:0.0:1788361506.877494:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130758272 00002000:00100000:0.0:1788361506.877558:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (0->1048575) req@ffff9a8a8ae72a00 x1875232130758272/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.877571:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae72a00 with x1875232130758272 ext(0->1048575) 00002000:00010000:0.0:1788361506.877577:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae72a00 00000100:00100000:0.0:1788361506.877611:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1788361506.877621:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130758272:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361506.895315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361506.895499:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+11:2350:x1875232130758272:12345-192.168.203.60@tcp:4:dd.0 Request processed in 17877us (18175us total) trans 30064771163 rc 0/0 00000100:00100000:2.0:1788361506.895512:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00002000:00100000:2.0:1788361506.895525:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (0->1048575) req@ffff9a8a8ae72a00 x1875232130758272/t30064771163(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.895535:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae72a00 with x1875232130758272 ext(0->1048575) 00002000:00010000:2.0:1788361506.895543:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae72a00 00000100:00100000:2.0:1788361506.895570:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130758400 00000100:00100000:2.0:1788361506.895578:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130758400 00002000:00100000:2.0:1788361506.895614:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (1048576->2097151) req@ffff9a8a8ae70700 x1875232130758400/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.895623:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae70700 with x1875232130758400 ext(1048576->2097151) 00002000:00010000:2.0:1788361506.895627:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae70700 00000100:00100000:2.0:1788361506.896394:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:2.0:1788361506.896408:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+11:2352:x1875232130758400:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361506.906294:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361506.907061:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130758528 00000100:00100000:2.0:1788361506.907073:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130758528 00002000:00100000:2.0:1788361506.907167:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (2097152->3145727) req@ffff9a8a8ae71f80 x1875232130758528/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.907184:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae71f80 with x1875232130758528 ext(2097152->3145727) 00002000:00010000:2.0:1788361506.907199:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae71f80 00000100:00100000:2.0:1788361506.907231:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:2.0:1788361506.907241:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130758528:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361506.912347:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2352:x1875232130758400:12345-192.168.203.60@tcp:4:dd.0 Request processed in 15933us (17031us total) trans 30064771164 rc 0/0 00000100:00100000:2.0:1788361506.912362:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00002000:00100000:2.0:1788361506.912374:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (1048576->2097151) req@ffff9a8a8ae70700 x1875232130758400/t30064771164(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.912384:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae70700 with x1875232130758400 ext(1048576->2097151) 00002000:00010000:2.0:1788361506.912390:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae70700 00000100:00100000:0.0:1788361506.917871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.919295:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130758656 00000100:00100000:1.0:1788361506.919307:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130758656 00002000:00100000:1.0:1788361506.919934:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (3145728->4194303) req@ffff9a8abf16d500 x1875232130758656/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.919949:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16d500 with x1875232130758656 ext(3145728->4194303) 00002000:00010000:1.0:1788361506.919955:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16d500 00000100:00100000:1.0:1788361506.919992:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:1.0:1788361506.920005:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:2352:x1875232130758656:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361506.923443:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130758528:12345-192.168.203.60@tcp:4:dd.0 Request processed in 16194us (17149us total) trans 30064771165 rc 0/0 00000100:00100000:2.0:1788361506.923459:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00002000:00100000:2.0:1788361506.923472:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (2097152->3145727) req@ffff9a8a8ae71f80 x1875232130758528/t30064771165(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.923483:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae71f80 with x1875232130758528 ext(2097152->3145727) 00002000:00010000:2.0:1788361506.923490:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae71f80 00000100:00100000:3.0:1788361506.931004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361506.932528:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130758784 00000100:00100000:2.0:1788361506.932539:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130758784 00002000:00100000:2.0:1788361506.932587:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (4194304->5242879) req@ffff9a8a8ae73100 x1875232130758784/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.932599:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae73100 with x1875232130758784 ext(4194304->5242879) 00002000:00010000:2.0:1788361506.932606:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae73100 00000100:00100000:2.0:1788361506.932641:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:2.0:1788361506.932663:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+18:2351:x1875232130758784:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361506.933644:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+19:2352:x1875232130758656:12345-192.168.203.60@tcp:4:dd.0 Request processed in 13640us (15779us total) trans 30064771166 rc 0/0 00000100:00100000:1.0:1788361506.933655:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00002000:00100000:1.0:1788361506.933675:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (3145728->4194303) req@ffff9a8abf16d500 x1875232130758656/t30064771166(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.933687:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16d500 with x1875232130758656 ext(3145728->4194303) 00002000:00010000:1.0:1788361506.933692:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16d500 00000100:00100000:3.0:1788361506.945549:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361506.945865:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130758912 00000100:00100000:1.0:1788361506.945875:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130758912 00002000:00100000:1.0:1788361506.945935:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (5242880->6291455) req@ffff9a8a8ae73480 x1875232130758912/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.945947:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae73480 with x1875232130758912 ext(5242880->6291455) 00002000:00010000:1.0:1788361506.945954:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae73480 00000100:00100000:1.0:1788361506.946873:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:1.0:1788361506.946893:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+19:2349:x1875232130758912:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361506.948799:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+20:2351:x1875232130758784:12345-192.168.203.60@tcp:4:dd.0 Request processed in 16129us (17798us total) trans 30064771167 rc 0/0 00000100:00100000:3.0:1788361506.948815:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00002000:00100000:3.0:1788361506.948825:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (4194304->5242879) req@ffff9a8a8ae73100 x1875232130758784/t30064771167(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361506.948836:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae73100 with x1875232130758784 ext(4194304->5242879) 00002000:00010000:3.0:1788361506.948843:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae73100 00000100:00100000:3.0:1788361506.955210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361506.955297:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130759040 00000100:00100000:0.0:1788361506.955308:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130759040 00002000:00100000:0.0:1788361506.955355:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (6291456->7340031) req@ffff9a8a8ae72300 x1875232130759040/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.955366:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae72300 with x1875232130759040 ext(6291456->7340031) 00002000:00010000:0.0:1788361506.955372:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae72300 00000100:00100000:0.0:1788361506.955444:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:0.0:1788361506.955454:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+21:2350:x1875232130759040:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361506.967638:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+23:2349:x1875232130758912:12345-192.168.203.60@tcp:4:dd.0 Request processed in 20740us (22088us total) trans 30064771168 rc 0/0 00000100:00100000:1.0:1788361506.967654:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00002000:00100000:1.0:1788361506.967667:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (5242880->6291455) req@ffff9a8a8ae73480 x1875232130758912/t30064771168(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361506.967677:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae73480 with x1875232130758912 ext(5242880->6291455) 00002000:00010000:1.0:1788361506.967684:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae73480 00000100:00100000:0.0:1788361506.970506:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+23:2350:x1875232130759040:12345-192.168.203.60@tcp:4:dd.0 Request processed in 15042us (15295us total) trans 30064771169 rc 0/0 00000100:00100000:0.0:1788361506.970535:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00002000:00100000:0.0:1788361506.970547:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (6291456->7340031) req@ffff9a8a8ae72300 x1875232130759040/t30064771169(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.970559:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae72300 with x1875232130759040 ext(6291456->7340031) 00002000:00010000:0.0:1788361506.970565:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae72300 00000100:00100000:1.0:1788361506.974739:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361506.974842:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130759168 00000100:00100000:2.0:1788361506.974851:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130759168 00002000:00100000:2.0:1788361506.974970:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (7340032->8388607) req@ffff9a8a834c9180 x1875232130759168/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361506.974982:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834c9180 with x1875232130759168 ext(7340032->8388607) 00002000:00010000:2.0:1788361506.974988:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834c9180 00000100:00100000:2.0:1788361506.975019:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:2.0:1788361506.975028:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+23:2349:x1875232130759168:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361506.985122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361506.986123:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130759296 00000100:00100000:3.0:1788361506.986134:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130759296 00002000:00100000:3.0:1788361506.986189:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (8388608->9437183) req@ffff9a8a834c9880 x1875232130759296/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361506.986199:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834c9880 with x1875232130759296 ext(8388608->9437183) 00002000:00010000:3.0:1788361506.986206:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834c9880 00000100:00100000:3.0:1788361506.986837:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:3.0:1788361506.986849:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:2349:x1875232130759296:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361506.988884:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:2349:x1875232130759168:12345-192.168.203.60@tcp:4:dd.0 Request processed in 13849us (14146us total) trans 30064771170 rc 0/0 00000100:00100000:3.0:1788361506.989446:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 126 00002000:00100000:3.0:1788361506.989472:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (7340032->8388607) req@ffff9a8a834c9180 x1875232130759168/t30064771170(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361506.989481:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834c9180 with x1875232130759168 ext(7340032->8388607) 00002000:00010000:3.0:1788361506.989488:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834c9180 00000100:00100000:3.0:1788361506.994330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361506.996355:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130759424 00000100:00100000:0.0:1788361506.996369:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130759424 00002000:00100000:0.0:1788361506.996423:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (9437184->10485759) req@ffff9a8a8ae70000 x1875232130759424/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/0 e 0 to 0 dl 1788361517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361506.996435:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae70000 with x1875232130759424 ext(9437184->10485759) 00002000:00010000:0.0:1788361506.996442:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae70000 00000100:00100000:0.0:1788361506.996483:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:0.0:1788361506.996494:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:2349:x1875232130759424:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361507.007170:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130759296:12345-192.168.203.60@tcp:4:dd.0 Request processed in 20314us (22078us total) trans 30064771171 rc 0/0 00000100:00100000:3.0:1788361507.007195:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00002000:00100000:3.0:1788361507.007207:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc7:0x0] (8388608->9437183) req@ffff9a8a834c9880 x1875232130759296/t30064771171(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361507.007219:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834c9880 with x1875232130759296 ext(8388608->9437183) 00002000:00010000:3.0:1788361507.007225:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834c9880 00000100:00100000:3.0:1788361507.007876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.007972:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130759552 00000100:00100000:2.0:1788361507.007980:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130759552 00002000:00100000:2.0:1788361507.008021:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (10485760->11534335) req@ffff9a8a8ae73800 x1875232130759552/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:568/0 lens 488/0 e 0 to 0 dl 1788361518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361507.008031:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae73800 with x1875232130759552 ext(10485760->11534335) 00002000:00010000:2.0:1788361507.008034:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae73800 00000100:00100000:2.0:1788361507.008063:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:2.0:1788361507.008073:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130759552:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361507.017851:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130759424:12345-192.168.203.60@tcp:4:dd.0 Request processed in 21347us (23519us total) trans 30064771172 rc 0/0 00000100:00100000:2.0:1788361507.017867:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 128 00002000:00100000:2.0:1788361507.017881:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc7:0x0] (9437184->10485759) req@ffff9a8a8ae70000 x1875232130759424/t30064771172(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:567/0 lens 488/448 e 0 to 0 dl 1788361517 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361507.017892:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae70000 with x1875232130759424 ext(9437184->10485759) 00002000:00010000:2.0:1788361507.017925:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae70000 00000100:00100000:2.0:1788361507.022981:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+31:2350:x1875232130759552:12345-192.168.203.60@tcp:4:dd.0 Request processed in 14901us (15098us total) trans 30064771173 rc 0/0 00000100:00100000:2.0:1788361507.022994:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00002000:00100000:2.0:1788361507.023007:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (10485760->11534335) req@ffff9a8a8ae73800 x1875232130759552/t30064771173(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:568/0 lens 488/448 e 0 to 0 dl 1788361518 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361507.023016:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae73800 with x1875232130759552 ext(10485760->11534335) 00002000:00010000:2.0:1788361507.023023:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae73800 00000100:00100000:0.0:1788361507.023972:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.024468:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130759680 00000100:00100000:2.0:1788361507.024477:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130759680 00002000:00100000:2.0:1788361507.024523:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (11534336->12582911) req@ffff9a8abf16ed80 x1875232130759680/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:568/0 lens 488/0 e 0 to 0 dl 1788361518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361507.024533:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16ed80 with x1875232130759680 ext(11534336->12582911) 00002000:00010000:2.0:1788361507.024537:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16ed80 00000100:00100000:2.0:1788361507.024571:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:2.0:1788361507.024581:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+31:2350:x1875232130759680:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361507.032223:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+33:2350:x1875232130759680:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7634us (8243us total) trans 30064771174 rc 0/0 00000100:00100000:2.0:1788361507.032238:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00002000:00100000:2.0:1788361507.032249:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (11534336->12582911) req@ffff9a8abf16ed80 x1875232130759680/t30064771174(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:568/0 lens 488/448 e 0 to 0 dl 1788361518 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361507.032260:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16ed80 with x1875232130759680 ext(11534336->12582911) 00002000:00010000:2.0:1788361507.032267:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16ed80 00000100:00100000:0.0:1788361507.033958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361507.034038:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130759808 00000100:00100000:3.0:1788361507.034048:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130759808 00002000:00100000:3.0:1788361507.034122:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (12582912->13631487) req@ffff9a8abf16ca80 x1875232130759808/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:568/0 lens 488/0 e 0 to 0 dl 1788361518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361507.034134:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16ca80 with x1875232130759808 ext(12582912->13631487) 00002000:00010000:3.0:1788361507.034139:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16ca80 00000100:00100000:3.0:1788361507.034170:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:3.0:1788361507.034189:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:2350:x1875232130759808:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361507.046721:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:2350:x1875232130759808:12345-192.168.203.60@tcp:4:dd.0 Request processed in 12530us (12758us total) trans 30064771175 rc 0/0 00000100:00100000:2.0:1788361507.046750:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 131 00002000:00100000:2.0:1788361507.046763:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc7:0x0] (12582912->13631487) req@ffff9a8abf16ca80 x1875232130759808/t30064771175(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:568/0 lens 488/448 e 0 to 0 dl 1788361518 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361507.046775:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16ca80 with x1875232130759808 ext(12582912->13631487) 00002000:00010000:2.0:1788361507.046782:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16ca80 00000100:00100000:0.0:1788361507.056773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.056965:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130759936 00000100:00100000:2.0:1788361507.056975:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130759936 00002000:00100000:2.0:1788361507.057025:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (13631488->14680063) req@ffff9a8abf16fb80 x1875232130759936/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:568/0 lens 488/0 e 0 to 0 dl 1788361518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361507.057037:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16fb80 with x1875232130759936 ext(13631488->14680063) 00002000:00010000:2.0:1788361507.057044:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16fb80 00000100:00100000:2.0:1788361507.057080:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:2.0:1788361507.057119:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+35:2352:x1875232130759936:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361507.064180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.065662:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130760320 00000100:00100000:2.0:1788361507.065676:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130760320 00000100:00100000:2.0:1788361507.065736:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:2.0:1788361507.065747:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+23:34988:x1875232130760320:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:0.0:1788361507.065887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.066206:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+24:34988:x1875232130760320:12345-192.168.203.60@tcp:35:dd.0 Request processed in 461us (2036us total) trans 30064771306 rc 0/0 00000100:00100000:2.0:1788361507.066214:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:2.0:1788361507.066240:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130760064 00000100:00100000:2.0:1788361507.066244:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130760064 00002000:00100000:2.0:1788361507.066271:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (14680064->15728639) req@ffff9a8a8926c000 x1875232130760064/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:568/0 lens 488/0 e 0 to 0 dl 1788361518 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361507.066295:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926c000 with x1875232130760064 ext(14680064->15728639) 00002000:00010000:2.0:1788361507.066301:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926c000 00000100:00100000:2.0:1788361507.066322:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:2.0:1788361507.066331:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+37:2351:x1875232130760064:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361507.066655:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2352:x1875232130759936:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9536us (9890us total) trans 30064771176 rc 0/0 00000100:00100000:0.0:1788361507.066664:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 132 00002000:00100000:0.0:1788361507.066671:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc7:0x0] (13631488->14680063) req@ffff9a8abf16fb80 x1875232130759936/t30064771176(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:568/0 lens 488/448 e 0 to 0 dl 1788361518 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361507.066692:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16fb80 with x1875232130759936 ext(13631488->14680063) 00002000:00010000:0.0:1788361507.066696:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16fb80 00000100:00100000:1.0:1788361507.074945:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+39:2351:x1875232130760064:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8604us (9048us total) trans 30064771177 rc 0/0 00000100:00100000:1.0:1788361507.074959:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00002000:00100000:1.0:1788361507.074989:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc7:0x0] (14680064->15728639) req@ffff9a8a8926c000 x1875232130760064/t30064771177(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:568/0 lens 488/448 e 0 to 0 dl 1788361518 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361507.074998:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926c000 with x1875232130760064 ext(14680064->15728639) 00002000:00010000:1.0:1788361507.075005:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926c000 00000100:00100000:2.0:1788361507.088038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.088124:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130760448 00000100:00100000:1.0:1788361507.088133:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130760448 00000100:00100000:1.0:1788361507.088192:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 274 00000100:00100000:1.0:1788361507.088203:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+24:34989:x1875232130760448:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:1.0:1788361507.088229:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361507.088252:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159b3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f737 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.088294:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.088309:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.088324:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.088446:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159b3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f737 expref: 26 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.088465:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f737 expref: 25 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.088474:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361507.088482:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361507.088487:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622000, rc 0) 00000100:00100000:1.0:1788361507.088564:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+25:34989:x1875232130760448:12345-192.168.203.60@tcp:101:chown.0 Request processed in 356us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361507.088572:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 274 00000100:00100000:0.0:1788361507.090928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.091030:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130760704 00000100:00100000:1.0:1788361507.091038:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130760704 00000100:00100000:1.0:1788361507.091182:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 275 00000100:00100000:1.0:1788361507.091192:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:34989:x1875232130760704:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:1.0:1788361507.091250:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361507.091277:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615974 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f71b expref: 25 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.091295:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361507.091300:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361507.091331:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.091344:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.091354:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361507.091793:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].9, 88 off8840 00000004:00080000:1.0:1788361507.091803:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 897106717026ns, next at 898106714627ns, rc = 0 00000004:00010000:1.0:1788361507.091883:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bc8be7ea reply state 000000003296de47 transno 30064771307 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361507.091905:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361507.092013:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+26:34989:x1875232130760704:12345-192.168.203.60@tcp:36:chown.0 Request processed in 823us (1103us total) trans 30064771307 rc 0/0 00000100:00100000:1.0:1788361507.092021:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 275 00010000:00010000:2.0:1788361507.093741:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.093768:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.093775:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.093781:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361507.093786:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.093795:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.093812:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:2.0:1788361507.093816:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361507.093820:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.093827:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d66159c1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361507.094816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.094951:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130760832 00000100:00100000:2.0:1788361507.094961:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130760832 00000100:00100000:2.0:1788361507.095053:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 276 00000100:00100000:2.0:1788361507.095064:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:34989:x1875232130760832:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361507.095126:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361507.095145:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66159c8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f73e expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.095210:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66159c8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f73e expref: 26 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.095224:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66159c8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f73e expref: 26 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.095244:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:2.0:1788361507.095247:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361507.095250:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:2.0:1788361507.095298:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:34989:x1875232130760832:12345-192.168.203.60@tcp:101:chown.0 Request processed in 237us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361507.095305:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 276 00000100:00100000:0.0:1788361507.097296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.097338:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130760960 00000100:00100000:2.0:1788361507.097346:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130760960 00000100:00100000:2.0:1788361507.097425:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788361507.097434:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+36:2349:x1875232130760960:12345-192.168.203.60@tcp:2:chown.0 00002000:00010000:2.0:1788361507.097702:0:35983:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:2.0:1788361507.097705:0:35983:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb mtime from disk: 0 -> 1788361507 00002000:00010000:2.0:1788361507.097717:0:35983:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361507.097718:0:35983:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb ctime from disk: 0 -> 1788361507 00002000:00010000:2.0:1788361507.097719:0:35983:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361507.097830:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+37:2349:x1875232130760960:12345-192.168.203.60@tcp:2:chown.0 Request processed in 396us (536us total) trans 30064771111 rc 0/0 00000100:00100000:2.0:1788361507.097838:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:0.0:1788361507.109434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361507.109492:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130761088 00000100:00100000:3.0:1788361507.109502:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130761088 00000100:00100000:3.0:1788361507.109711:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 277 00000100:00100000:3.0:1788361507.109724:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+26:34990:x1875232130761088:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:3.0:1788361507.109860:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361507.109885:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66159cf lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f745 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.109934:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66159d6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.109950:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66159d6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.109961:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66159d6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.110059:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66159cf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f745 expref: 28 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.110076:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcaa00/0xf6a94c97d66159d6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f745 expref: 27 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.110241:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:3.0:1788361507.110245:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361507.110250:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcaa00, rc 0) 00000100:00100000:2.0:1788361507.110375:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+27:34990:x1875232130761088:12345-192.168.203.60@tcp:101:chown.0 Request processed in 653us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361507.110384:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 277 00000100:00100000:0.0:1788361507.113013:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.113132:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130761344 00000100:00100000:1.0:1788361507.113141:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130761344 00000100:00100000:1.0:1788361507.113197:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 278 00000100:00100000:1.0:1788361507.113206:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:34990:x1875232130761344:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:1.0:1788361507.113258:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361507.113283:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d661599e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f729 expref: 27 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.113300:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:1.0:1788361507.113305:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361507.113336:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.113351:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.113361:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361507.114239:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].9, 88 off8912 00000004:00080000:1.0:1788361507.114251:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 897129165099ns, next at 898129162383ns, rc = 0 00000004:00010000:1.0:1788361507.114338:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b34d4324 reply state 00000000323ca85e transno 30064771308 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361507.114360:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361507.114967:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+28:34990:x1875232130761344:12345-192.168.203.60@tcp:36:chown.0 Request processed in 1759us (1958us total) trans 30064771308 rc 0/0 00000100:00100000:1.0:1788361507.114976:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 278 00010000:00010000:2.0:1788361507.118119:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.118138:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.118145:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.118152:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361507.118157:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.118166:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.118185:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:2.0:1788361507.118189:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361507.118194:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.118199:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d66159dd lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361507.118362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.118473:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130761472 00000100:00100000:2.0:1788361507.118482:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130761472 00000100:00100000:2.0:1788361507.118539:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 279 00000100:00100000:2.0:1788361507.118549:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:34990:x1875232130761472:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361507.118574:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361507.118594:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66159e4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f74c expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.118657:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66159e4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f74c expref: 28 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.118671:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9c00/0xf6a94c97d66159e4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f74c expref: 28 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.118691:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:2.0:1788361507.118693:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361507.118695:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9c00, rc 0) 00000100:00100000:2.0:1788361507.118751:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:34990:x1875232130761472:12345-192.168.203.60@tcp:101:chown.0 Request processed in 203us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361507.118758:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 279 00000100:00100000:0.0:1788361507.120798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361507.120999:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130761600 00000100:00100000:3.0:1788361507.121007:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130761600 00000100:00100000:3.0:1788361507.121063:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:3.0:1788361507.121073:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+39:2350:x1875232130761600:12345-192.168.203.60@tcp:2:chown.0 00002000:00010000:3.0:1788361507.121292:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1788361507.121295:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb mtime from disk: 0 -> 1788361507 00002000:00010000:3.0:1788361507.121308:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788361507.121310:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb ctime from disk: 0 -> 1788361507 00002000:00010000:3.0:1788361507.121312:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788361507.121368:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+40:2350:x1875232130761600:12345-192.168.203.60@tcp:2:chown.0 Request processed in 296us (575us total) trans 30064771178 rc 0/0 00000100:00100000:3.0:1788361507.121376:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:1.0:1788361507.171850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.172517:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130761728 00000100:00100000:2.0:1788361507.172528:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130761728 00000100:00100000:2.0:1788361507.172754:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 280 00000100:00100000:2.0:1788361507.172766:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+28:34996:x1875232130761728:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:2.0:1788361507.172789:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361507.172811:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66159eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f753 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361507.173835:0:35347:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 957us 00010000:00010000:1.0:1788361507.190152:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66159f2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.190176:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66159f2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.190188:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66159f2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361507.190250:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 512 00000004:00200000:1.0:1788361507.190255:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361507.190303:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66159f2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.190341:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d66159eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f753 expref: 30 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.190361:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66159f2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f753 expref: 29 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.190370:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:1.0:1788361507.190374:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361507.190378:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623e00, rc 0) 00000100:00100000:1.0:1788361507.190436:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:34996:x1875232130761728:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 17672us (18594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361507.190455:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 280 00000100:00100000:0.0:1788361507.192758:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.192821:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130761856 00000100:00100000:1.0:1788361507.192828:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130761856 00000100:00100000:1.0:1788361507.192873:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 281 00000100:00100000:1.0:1788361507.192882:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:34996:x1875232130761856:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:1.0:1788361507.192903:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361507.192936:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66159f9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f75a expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193001:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615a00 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193016:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615a00 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193027:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615a00 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193040:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615a07 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193046:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615a07 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193053:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615a07 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193272:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193297:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193304:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361507.193333:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00000004:00200000:1.0:1788361507.193339:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361507.193360:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193371:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193380:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615a00 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193387:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615a00 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193393:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615a00 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193399:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361507.193404:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615a00 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193413:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615a00 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193425:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:1.0:1788361507.193433:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361507.193438:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615a00 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193444:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615a00 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193455:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615a07 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193461:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615a07 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193467:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615a07 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193473:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361507.193475:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615a07 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193482:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615a07 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193490:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff9a8984a32600) 00010000:00010000:1.0:1788361507.193493:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361507.193495:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615a07 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193500:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615a07 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193536:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d66159f9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f75a expref: 31 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193556:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f75a expref: 30 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.193563:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361507.193565:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361507.193567:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622e00, rc 0) 00000100:00100000:1.0:1788361507.193754:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:34996:x1875232130761856:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 872us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361507.193762:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 281 00000100:00100000:0.0:1788361507.197354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.197895:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130762112 00000100:00100000:2.0:1788361507.197905:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130762112 00000100:00100000:2.0:1788361507.198009:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 282 00000100:00100000:2.0:1788361507.198019:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+30:34996:x1875232130762112:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:2.0:1788361507.198043:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361507.198064:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a15 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f761 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.198311:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615a1c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.198336:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615a1c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.198349:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615a1c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361507.198361:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:2.0:1788361507.198512:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a15 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f761 expref: 33 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.198530:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615a1c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f761 expref: 32 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.198539:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:2.0:1788361507.198542:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361507.198558:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8400, rc 0) 00000100:00100000:2.0:1788361507.198609:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+32:34996:x1875232130762112:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 591us (1262us total) trans 30064771309 rc 0/0 00000100:00100000:2.0:1788361507.198970:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 282 00000100:00100000:0.0:1788361507.201820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.201888:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130762368 00000100:00100000:1.0:1788361507.201897:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130762368 00000100:00100000:1.0:1788361507.201962:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 283 00000100:00100000:1.0:1788361507.201972:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+32:34996:x1875232130762368:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:1.0:1788361507.201997:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361507.202017:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6615a2a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f768 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.202144:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615a31 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.202162:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615a31 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.202174:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615a31 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361507.202198:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:1.0:1788361507.202356:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6615a2a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f768 expref: 35 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.202373:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615a31 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f768 expref: 34 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.202383:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361507.202385:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788361507.202389:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622800, rc 0) 00000100:00100000:1.0:1788361507.202450:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:34996:x1875232130762368:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 480us (638us total) trans 30064771310 rc 0/0 00000100:00100000:1.0:1788361507.202458:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 283 00000100:00100000:0.0:1788361507.204710:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.206340:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130762496 00000100:00100000:1.0:1788361507.206352:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130762496 00000100:00100000:0.0:1788361507.206572:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1788361507.206582:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:2350:x1875232130762496:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361507.206598:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361507.206721:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615a1c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f761 expref: 34 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361507.206741:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:0.0:1788361507.206747:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361507.206808:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:2350:x1875232130762496:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 227us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361507.206817:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00010000:00010000:3.0:1788361507.232518:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361507.332301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.332615:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130762624 00000100:00100000:1.0:1788361507.332625:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130762624 00000100:00100000:1.0:1788361507.332740:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1788361507.332752:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+37:2351:x1875232130762624:12345-192.168.203.60@tcp:1:lfs.500 00010000:00010000:1.0:1788361507.332801:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.332824:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000259755f4/0xf6a94c97d6615982 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f722 expref: 37 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.332833:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc7:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788361507.332838:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361507.332843:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 4/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.332892:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000259755f4/0xf6a94c97d6615982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f722 expref: 37 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.332917:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000259755f4/0xf6a94c97d6615982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f722 expref: 37 pid: 36286 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361507.332932:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144227712:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361507.333019:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8352f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361507.337156:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144227712:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361507.337185:0:36286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361507.348207:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.348351:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130762752 00000100:00100000:2.0:1788361507.348361:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130762752 00010000:00010000:2.0:1788361507.348398:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000259755f4/0xf6a94c97d6615982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f722 expref: 38 pid: 36286 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361507.348783:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:2.0:1788361507.348792:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+38:2350:x1875232130762752:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361507.348808:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361507.348832:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000259755f4/0xf6a94c97d6615982 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f722 expref: 38 pid: 36286 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.348846:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000259755f4/0xf6a94c97d6615982 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f722 expref: 38 pid: 36286 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.348869:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000259755f4/0xf6a94c97d6615982 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f722 expref: 38 pid: 36286 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.348885:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361507.348900:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361507.348918:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.348929:0:35332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.348967:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361507.349019:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b123b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+37:2350:x1875232130762752:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 228us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361507.349027:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00010000:00010000:1.0:1788361507.349113:0:36286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.349124:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.349149:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.349156:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.349164:0:36286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.349172:0:36286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623c00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361507.349184:0:36286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.349193:0:36286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.349210:0:36286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.349217:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f24f8952/0xf6a94c97d6615a3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361507.349297:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b123100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+36:2351:x1875232130762624:12345-192.168.203.60@tcp:1:lfs.500 Request processed in 16548us (17007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361507.349304:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1788361507.354669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.354732:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130763008 00000100:00100000:2.0:1788361507.354742:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130763008 00000100:00100000:2.0:1788361507.354796:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1788361507.354805:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:34996:x1875232130763008:12345-192.168.203.60@tcp:35:lfs.500 00000004:00010000:2.0:1788361507.354871:0:35348:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x1b:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615a31 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f768 expref: 33 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361507.355327:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771311 00000001:00080000:2.0:1788361507.355370:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771312 00000001:00080000:2.0:1788361507.356837:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771313 00010000:00010000:2.0:1788361507.356943:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.356965:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f737 expref: 37 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.356975:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f75a expref: 37 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.356991:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66159c8 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f73e expref: 37 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.357000:0:35348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 6/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.357038:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66159c8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f73e expref: 37 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.357055:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66159c8 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f73e expref: 37 pid: 35346 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361507.357071:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9086ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144227840:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361507.357755:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f75a expref: 37 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.357767:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f75a expref: 37 pid: 37122 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361507.357778:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9086c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144227968:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361507.357808:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f737 expref: 37 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.357817:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f737 expref: 37 pid: 35345 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361507.357839:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9086df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144228096:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361507.357858:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85014d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788361507.363130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361507.363161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361507.364060:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130763136 00000100:00100000:3.0:1788361507.364070:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130763136 00010000:00010000:3.0:1788361507.364129:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66159c8 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f73e expref: 38 pid: 35346 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361507.364161:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130763264 00000100:00100000:3.0:1788361507.364163:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130763264 00010000:00010000:3.0:1788361507.364174:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f75a expref: 39 pid: 37122 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361507.364200:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:3.0:1788361507.364208:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130763136:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361507.364223:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361507.364231:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66159c8 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f73e expref: 39 pid: 35346 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361507.364245:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9086ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144227840:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361507.364246:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66159c8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f73e expref: 39 pid: 35346 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361507.364270:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00010000:00010000:3.0:1788361507.364277:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66159c8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f73e expref: 39 pid: 35346 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361507.364294:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130763264:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361507.364309:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361507.364318:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f75a expref: 38 pid: 37122 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.364320:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00000100:00100000:0.0:1788361507.364424:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.364487:0:35331:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788361507.364497:0:35331:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1788361507.364794:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.364806:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.364813:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361507.364940:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130763392 00000100:00100000:1.0:1788361507.364945:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130763392 00010000:00010000:1.0:1788361507.364961:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f737 expref: 39 pid: 35345 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361507.364977:0:35331:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788361507.364984:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:1.0:1788361507.364991:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8984bb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130763392:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361507.365000:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361507.365011:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f737 expref: 39 pid: 35345 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361507.365041:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130763136:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 833us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361507.365048:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:3.0:1788361507.365123:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9086c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144227968:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361507.365132:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9086df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144228096:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361507.368401:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f75a expref: 38 pid: 37122 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.368512:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615a0e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f75a expref: 38 pid: 37122 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.368533:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:2.0:1788361507.368538:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.368548:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.368556:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361507.368627:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+37:2349:x1875232130763264:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 4337us (5463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361507.368654:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00010000:00010000:1.0:1788361507.371109:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f737 expref: 36 pid: 35345 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.371147:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d66159ba lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f737 expref: 36 pid: 35345 timeout: 997 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.371150:0:35348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.371163:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361507.371168:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.371179:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.371186:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.371209:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361507.371279:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8984bb7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:2349:x1875232130763392:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 6285us (6853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361507.371288:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00010000:00010000:2.0:1788361507.373041:0:35348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.373056:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361507.373212:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771314 00000001:00080000:2.0:1788361507.374157:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771315 00000100:00100000:2.0:1788361507.374296:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9086df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144228224:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788361507.374360:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361507.374396:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85014cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361507.374522:0:37379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144228224 00000100:00100000:0.0:1788361507.374530:0:37379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144228224 00000100:00100000:0.0:1788361507.374592:0:37379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788361507.374600:0:37379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144228224:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1788361507.374621:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361507.374678:0:37379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144228224:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361507.374685:0:37379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788361507.374735:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9086df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144228224:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788361507.376000:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771316 00000100:00100000:3.0:1788361507.376075:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae71c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144228352:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788361507.376336:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361507.376356:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9ec1000 going to sleep for 11 seconds 00000100:00100000:0.0:1788361507.376369:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144228352 00000100:00100000:0.0:1788361507.376375:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144228352 00000100:00100000:0.0:1788361507.376416:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788361507.376424:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144228352:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788361507.376600:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35348:x1875232144228352:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 176us (264us total) trans 30064771112 rc 0/0 00000100:00100000:0.0:1788361507.376607:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788361507.376959:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae71c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144228352:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788361507.377019:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771317 00010000:00010000:2.0:1788361507.377056:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.377067:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.377075:0:35348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.377081:0:35348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361507.377112:0:35348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.377121:0:35348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.377148:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:2.0:1788361507.377151:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788361507.377161:0:35348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.377168:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a46 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361507.377398:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x1d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788361507.377521:0:35348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].10, 64 off8904 00000001:00080000:2.0:1788361507.377529:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771318 00010000:00010000:2.0:1788361507.377559:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:2.0:1788361507.377562:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361507.377569:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615a31 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f768 expref: 39 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361507.377707:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:34996:x1875232130763008:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 22901us (23044us total) trans 30064771319 rc 0/0 00000100:00100000:2.0:1788361507.377715:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00000020:00080000:2.0:1788361507.377719:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788361507.382124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.382162:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130763520 00000100:00100000:2.0:1788361507.382172:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130763520 00000100:00100000:2.0:1788361507.382233:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 284 00000100:00100000:2.0:1788361507.382243:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+38:34996:x1875232130763520:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361507.382271:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361507.382295:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615a4d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f76f expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.382378:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615a4d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f76f expref: 39 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.382395:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615a4d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f76f expref: 39 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.382416:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:2.0:1788361507.382419:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361507.382423:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9200, rc 0) 00000100:00100000:2.0:1788361507.382480:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+39:34996:x1875232130763520:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 239us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361507.382488:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 284 00000100:00100000:1.0:1788361507.386548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361507.386660:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130763776 00000100:00100000:3.0:1788361507.386669:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130763776 00000100:00100000:3.0:1788361507.386725:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:3.0:1788361507.386735:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:34996:x1875232130763776:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:3.0:1788361507.387011:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+40:34996:x1875232130763776:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 277us (471us total) trans 30064771320 rc 0/0 00000100:00100000:3.0:1788361507.387031:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:1.0:1788361507.441022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.441123:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130763904 00000100:00100000:2.0:1788361507.441133:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130763904 00000100:00100000:2.0:1788361507.441192:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 285 00000100:00100000:2.0:1788361507.441207:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+40:35002:x1875232130763904:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:2.0:1788361507.441235:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361507.441258:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a54 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f776 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441336:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615a5b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441353:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615a5b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441367:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615a5b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441396:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a62 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441404:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441410:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441573:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615a69 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441591:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615a69 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441602:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615a69 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361507.441634:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00000004:00200000:2.0:1788361507.441638:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361507.441659:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615a69 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441672:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615a69 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441680:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615a5b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441687:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615a5b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441703:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615a5b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441708:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361507.441713:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615a5b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441722:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615a5b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441736:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:2.0:1788361507.441739:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361507.441743:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615a5b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441749:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615a5b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441764:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a62 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441771:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a62 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441777:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a62 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441782:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361507.441785:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a62 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441801:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a62 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441810:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xdee864c2 (ffff9a8a83c0b700) 00010000:00010000:2.0:1788361507.441813:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361507.441816:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a62 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441827:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a62 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441866:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a54 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f776 expref: 42 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441880:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9800/0xf6a94c97d6615a69 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f776 expref: 41 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.441887:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:2.0:1788361507.441890:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361507.441892:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9800, rc 0) 00000100:00100000:2.0:1788361507.441976:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+41:35002:x1875232130763904:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 771us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361507.441985:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 285 00000100:00100000:0.0:1788361507.446262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.446312:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130764160 00000100:00100000:2.0:1788361507.446322:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130764160 00000100:00100000:2.0:1788361507.446386:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 286 00000100:00100000:2.0:1788361507.446395:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+41:35002:x1875232130764160:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:2.0:1788361507.446434:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361507.446457:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615a70 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f77d expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.446581:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615a77 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.446598:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615a77 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.446612:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615a77 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361507.446625:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00010000:00010000:2.0:1788361507.446765:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615a70 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f77d expref: 44 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.446783:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615a77 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f77d expref: 43 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.446792:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:2.0:1788361507.446795:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361507.446798:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361507.446857:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+43:35002:x1875232130764160:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 463us (604us total) trans 30064771321 rc 0/0 00000100:00100000:2.0:1788361507.446864:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 286 00000100:00100000:1.0:1788361507.454932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.454975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.455033:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130764416 00000100:00100000:2.0:1788361507.455043:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130764416 00000100:00100000:2.0:1788361507.455153:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 287 00000100:00100000:2.0:1788361507.455179:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+43:35002:x1875232130764416:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:2.0:1788361507.455207:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361507.455230:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a85 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f784 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.455345:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a8c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.455363:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.455377:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a8c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361507.455393:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1c:0x0]: returning size 15728640 00010000:00010000:2.0:1788361507.455768:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a85 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f784 expref: 46 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.455789:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a8c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f784 expref: 45 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.455799:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:2.0:1788361507.455802:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361507.455806:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:2.0:1788361507.455872:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+45:35002:x1875232130764416:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 696us (895us total) trans 30064771322 rc 0/0 00000100:00100000:3.0:1788361507.455879:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130764544 00000100:00100000:3.0:1788361507.455886:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130764544 00000100:00100000:3.0:1788361507.455946:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1788361507.455955:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+46:2350:x1875232130764544:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361507.455967:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361507.455985:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615a77 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f77d expref: 46 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.455999:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:3.0:1788361507.456003:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361507.456025:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+45:2350:x1875232130764544:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 71us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361507.456033:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1788361507.457843:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 287 00000100:00100000:1.0:1788361507.497877:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361507.497990:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130764672 00000100:00100000:0.0:1788361507.498000:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130764672 00000100:00100000:0.0:1788361507.498071:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788361507.498081:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+44:35002:x1875232130764672:12345-192.168.203.60@tcp:103:lfs.500 00010000:00010000:0.0:1788361507.498120:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361507.498150:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615a8c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f784 expref: 44 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361507.498197:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1c:0x0].0x0 (ffff9a8a90b43800) 00010000:00010000:0.0:1788361507.498202:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361507.498623:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+43:35002:x1875232130764672:12345-192.168.203.60@tcp:103:lfs.500 Request processed in 543us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361507.498632:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1788361507.506482:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.509295:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130764928 00000100:00100000:2.0:1788361507.509309:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130764928 00000100:00100000:2.0:1788361507.509438:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:2.0:1788361507.509448:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+43:35002:x1875232130764928:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:2.0:1788361507.509697:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+44:35002:x1875232130764928:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 250us (3223us total) trans 30064771323 rc 0/0 00000100:00100000:2.0:1788361507.509705:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:1.0:1788361507.524554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361507.524678:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130765184 00000100:00100000:3.0:1788361507.524688:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130765184 00000100:00100000:3.0:1788361507.524740:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:3.0:1788361507.524750:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+44:35002:x1875232130765184:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:3.0:1788361507.525473:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+45:35002:x1875232130765184:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 723us (926us total) trans 30064771324 rc 0/0 00000100:00100000:3.0:1788361507.525481:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:1.0:1788361507.584709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.584842:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130765440 00000100:00100000:2.0:1788361507.584852:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130765440 00000100:00100000:2.0:1788361507.584978:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 288 00000100:00100000:2.0:1788361507.584989:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+45:35012:x1875232130765440:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361507.585017:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361507.585043:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f78b expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361507.585230:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 512 00010000:00010000:2.0:1788361507.585364:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f78b expref: 47 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.585380:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361507.585384:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361507.585389:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615a9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f78b expref: 47 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.585404:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8000, rc 0) 00000100:00100000:2.0:1788361507.585454:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+46:35012:x1875232130765440:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 467us (754us total) trans 30064771325 rc 301/301 00000100:00100000:2.0:1788361507.585461:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 288 00000100:00100000:0.0:1788361507.588538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361507.589620:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130765568 00000100:00100000:3.0:1788361507.589633:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130765568 00000100:00100000:3.0:1788361507.589746:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 289 00000100:00100000:3.0:1788361507.589756:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+46:35012:x1875232130765568:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788361507.589865:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615aa8 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.589884:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615aa8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.589896:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615aa8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.589922:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615aaf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.589930:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615aaf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.589937:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615aaf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590034:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590042:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590049:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361507.590282:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590298:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615aa8 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590315:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615aa8 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590322:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615aa8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590327:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361507.590331:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615aa8 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590339:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615aa8 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590352:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:3.0:1788361507.590355:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361507.590360:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615aa8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590366:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615aa8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590379:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615aaf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590385:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615aaf lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590391:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615aaf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590396:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361507.590404:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615aaf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590410:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615aaf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590417:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff9a8a890fa400) 00010000:00010000:3.0:1788361507.590419:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361507.590422:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615aaf lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590427:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615aaf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590442:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590448:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590454:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590460:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361507.590463:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590470:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590477:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:3.0:1788361507.590480:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361507.590489:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361507.590496:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ab6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361507.590619:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+46:35012:x1875232130765568:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 864us (2090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361507.590628:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 289 00000100:00100000:1.0:1788361507.592660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.592732:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130765824 00000100:00100000:2.0:1788361507.592750:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130765824 00000100:00100000:2.0:1788361507.592805:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1788361507.592814:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+46:35012:x1875232130765824:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361507.593156:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+47:35012:x1875232130765824:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 342us (500us total) trans 30064771326 rc 0/0 00000100:00100000:2.0:1788361507.593164:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1788361507.644931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.645001:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130766080 00000100:00100000:1.0:1788361507.645012:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130766080 00000100:00100000:1.0:1788361507.645074:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 290 00000100:00100000:1.0:1788361507.645083:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+47:35022:x1875232130766080:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361507.645132:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361507.645154:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615abd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f792 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.645307:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6615ac4 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.645324:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6615ac4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.645337:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6615ac4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361507.645350:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1a:0x0]: returning size 512 00010000:00010000:1.0:1788361507.645481:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615abd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f792 expref: 50 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.645500:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623c00/0xf6a94c97d6615ac4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f792 expref: 49 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.645509:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:1.0:1788361507.645511:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788361507.645516:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623c00, rc 0) 00000100:00100000:1.0:1788361507.645750:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+49:35022:x1875232130766080:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 667us (826us total) trans 30064771327 rc 0/0 00000100:00100000:1.0:1788361507.645761:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 290 00000100:00100000:0.0:1788361507.684315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361507.686158:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130766336 00000100:00100000:2.0:1788361507.686174:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130766336 00000100:00100000:2.0:1788361507.686251:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 291 00000100:00100000:2.0:1788361507.686261:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+49:35028:x1875232130766336:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:2.0:1788361507.686293:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361507.686321:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615ad2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f799 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686407:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615ad9 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686428:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615ad9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686444:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615ad9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686461:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615ae0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686469:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615ae0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686500:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615ae0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686654:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615ae7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686665:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615ae7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686675:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615ae7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361507.686685:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 15728640 00010000:00010000:2.0:1788361507.686807:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615ad9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686815:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615ad9 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686822:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615ad9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686828:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361507.686833:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615ad9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686844:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615ad9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686860:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:2.0:1788361507.686863:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361507.686878:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615ad9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686888:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615ad9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686914:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615ae0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686924:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615ae0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686929:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615ae0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686935:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361507.686937:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615ae0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686946:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615ae0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686956:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff9a8a83c0b700) 00010000:00010000:2.0:1788361507.686958:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361507.686961:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615ae0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.686967:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615ae0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.687040:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615ad2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f799 expref: 52 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.687072:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615ae7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f799 expref: 51 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.687082:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:2.0:1788361507.687122:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361507.687124:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8600, rc 0) 00000100:00100000:2.0:1788361507.687214:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+51:35028:x1875232130766336:12345-192.168.203.60@tcp:101:dd.500 Request processed in 948us (2906us total) trans 30064771328 rc 0/0 00000100:00100000:2.0:1788361507.687223:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 291 00000100:00100000:3.0:1788361507.689290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.689616:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130766592 00000100:00100000:1.0:1788361507.689626:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130766592 00000100:00100000:1.0:1788361507.689685:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 292 00000100:00100000:1.0:1788361507.689696:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+51:35028:x1875232130766592:12345-192.168.203.60@tcp:36:dd.500 00010000:00010000:1.0:1788361507.689759:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361507.689786:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615ae7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f799 expref: 51 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.689808:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:1.0:1788361507.689814:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361507.690185:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.690201:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.690213:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361507.690271:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771329 00000004:00010000:1.0:1788361507.690299:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000053f5a8fd reply state 00000000f10d6a5f transno 30064771330 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361507.690309:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361507.690404:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+53:35028:x1875232130766592:12345-192.168.203.60@tcp:36:dd.500 Request processed in 710us (1122us total) trans 30064771330 rc 0/0 00000100:00100000:1.0:1788361507.690430:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 292 00000020:00080000:1.0:1788361507.690436:0:35345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788361507.692310:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.692325:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.692332:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.692338:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361507.692343:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.692350:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.692367:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:2.0:1788361507.692369:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361507.692374:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361507.692395:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615af5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361507.918326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.918426:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130766848 00000100:00100000:1.0:1788361507.918442:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130766848 00000100:00100000:1.0:1788361507.918542:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1788361507.918555:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+52:35028:x1875232130766848:12345-192.168.203.60@tcp:103:dd.500 00010000:00010000:1.0:1788361507.918573:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361507.918609:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615a4d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f76f expref: 52 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.918632:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:1.0:1788361507.918645:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361507.918751:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+51:35028:x1875232130766848:12345-192.168.203.60@tcp:103:dd.500 Request processed in 199us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361507.918763:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1788361507.921989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361507.922237:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130766976 00000100:00100000:0.0:1788361507.922250:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130766976 00000100:00100000:0.0:1788361507.922326:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 293 00000100:00100000:0.0:1788361507.922338:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+51:35028:x1875232130766976:12345-192.168.203.60@tcp:58:dd.500 00010000:00010000:0.0:1788361507.922476:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361507.922494:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361507.922506:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361507.922974:0:35346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].8, 136 off9280 00000100:00100000:0.0:1788361507.923119:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+51:35028:x1875232130766976:12345-192.168.203.60@tcp:58:dd.500 Request processed in 747us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361507.923131:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 293 00000100:00100000:0.0:1788361507.937732:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361507.938389:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130767104 00000100:00100000:1.0:1788361507.938404:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130767104 00000100:00100000:1.0:1788361507.938479:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 294 00000100:00100000:1.0:1788361507.938489:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+51:35028:x1875232130767104:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:1.0:1788361507.938514:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361507.938609:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615b03 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7a0 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.938676:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.938687:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615b03 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7a0 expref: 52 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.938722:0:35347:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.938736:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615b03 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7a0 expref: 52 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.938750:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361507.938753:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361507.938757:0:35347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615b03 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7a0 expref: 52 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361507.938765:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622000, rc 0) 00000100:00100000:1.0:1788361507.938839:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+52:35028:x1875232130767104:12345-192.168.203.60@tcp:101:dd.500 Request processed in 352us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361507.938846:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 294 00000100:00100000:3.0:1788361507.976608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361507.976682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361507.976722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361507.978442:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130767232 00000100:00100000:2.0:1788361507.978472:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130767488 00000100:00100000:0.0:1788361507.978477:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130767232 00000100:00100000:2.0:1788361507.978486:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130767488 00000100:00100000:3.0:1788361507.978528:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361507.978564:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:0.0:1788361507.978577:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130767232:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361507.978620:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130767616 00000100:00100000:3.0:1788361507.978626:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130767616 00000100:00100000:3.0:1788361507.978669:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:3.0:1788361507.978681:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130767616:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361507.978729:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130767232:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 152us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361507.978740:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:3.0:1788361507.978754:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130767616:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 73us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361507.978764:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:2.0:1788361507.978833:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130767360 00000100:00100000:2.0:1788361507.978839:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130767360 00000100:00100000:3.0:1788361507.978850:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:3.0:1788361507.978860:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+40:2349:x1875232130767488:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361507.978890:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1788361507.978896:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+40:2349:x1875232130767488:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 35us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361507.978915:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:2349:x1875232130767360:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361507.978930:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1788361507.978960:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:2349:x1875232130767360:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 59us (2236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361507.978969:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000001:00080000:3.0:1788361508.063019:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771112 is committed 00000001:00080000:3.0:1788361508.063036:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771107 is committed 00000001:00080000:3.0:1788361508.063059:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771110 is committed 00000001:00080000:3.0:1788361508.063080:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771111 is committed 00010000:00010000:2.0:1788361508.256719:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361508.704470:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361508.704480:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361508.704518:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 9 count 9 00000040:00080000:0.0:1788361508.704641:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361508.704761:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144228480:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361508.704859:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361508.708109:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144228480:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361508.709233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.709532:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130767744 00000100:00100000:2.0:1788361508.709542:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130767744 00000100:00100000:2.0:1788361508.709597:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 295 00000100:00100000:2.0:1788361508.709606:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+52:35029:x1875232130767744:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000100:00080000:1.0:1788361508.709621:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:2.0:1788361508.709633:0:35346:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361508.709744:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+52:35029:x1875232130767744:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 141us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361508.709749:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 295 00000100:00100000:3.0:1788361508.712387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.712445:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130767872 00000100:00100000:2.0:1788361508.712534:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130767872 00000100:00100000:2.0:1788361508.712583:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 296 00000100:00100000:2.0:1788361508.712591:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+52:35029:x1875232130767872:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788361508.712669:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b0a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712699:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712712:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712728:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b11 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712736:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712742:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712766:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712775:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712782:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361508.712818:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 0 00000004:00200000:2.0:1788361508.712823:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361508.712837:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712849:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712865:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b0a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712871:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712877:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361508.712882:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712890:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b0a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712917:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361508.712921:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361508.712933:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712939:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712953:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712958:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b11 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712963:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712968:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361508.712977:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712984:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b11 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.712992:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdcf8d881 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361508.712995:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361508.712998:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b11 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.713003:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b11 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdcf8d881 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.713234:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.713242:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.713248:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.713253:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361508.713256:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.713262:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.713281:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:2.0:1788361508.713284:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361508.713295:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.713302:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b18 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361508.713378:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+52:35029:x1875232130767872:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 786us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361508.713386:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 296 00000100:00100000:0.0:1788361508.716130:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.716306:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130768128 00000100:00100000:3.0:1788361508.716315:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130768128 00000100:00100000:3.0:1788361508.716366:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 297 00000100:00100000:3.0:1788361508.716375:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+52:35029:x1875232130768128:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361508.716396:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361508.716429:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615b1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7a7 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716556:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b26 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716572:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b26 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716584:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b26 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361508.716596:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1b:0x0]: returning size 0 00010000:00010000:3.0:1788361508.716704:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b26 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716712:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b26 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716733:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b26 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716740:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361508.716743:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b26 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716751:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b26 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716763:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:3.0:1788361508.716766:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361508.716771:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b26 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716782:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b26 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716824:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615b1f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7a7 expref: 54 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716844:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:3.0:1788361508.716846:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361508.716850:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615b1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7a7 expref: 54 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.716859:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca400, rc 0) 00000100:00100000:3.0:1788361508.716926:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+53:35029:x1875232130768128:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 551us (803us total) trans 30064771331 rc 301/301 00000100:00100000:3.0:1788361508.716942:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 297 00000100:00100000:0.0:1788361508.723921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.723997:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130768256 00000100:00100000:3.0:1788361508.724007:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130768256 00000100:00100000:3.0:1788361508.724063:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 298 00000100:00100000:3.0:1788361508.724073:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+53:35029:x1875232130768256:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788361508.724139:0:35347:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x1b:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788361508.724244:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+53:35029:x1875232130768256:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 172us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361508.724251:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 298 00000100:00100000:1.0:1788361508.728330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.728435:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130768512 00000100:00100000:2.0:1788361508.728445:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130768512 00000100:00100000:2.0:1788361508.728506:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 299 00000100:00100000:2.0:1788361508.728517:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+53:35029:x1875232130768512:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361508.728541:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361508.728545:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361508.728576:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d66159f2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f753 expref: 53 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.728594:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:2.0:1788361508.728599:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361508.728613:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b34 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7ae expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361508.729076:0:37122:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc8:0x0], index 0: 0 00010000:00010000:2.0:1788361508.729298:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b3b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.729313:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b3b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.729340:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b3b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.729400:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b34 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ae expref: 55 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.729416:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b3b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ae expref: 54 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.729423:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361508.729426:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361508.729429:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:2.0:1788361508.729487:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+54:35029:x1875232130768512:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 972us (1165us total) trans 30064771332 rc 0/0 00000100:00100000:2.0:1788361508.729495:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 299 00000100:00100000:0.0:1788361508.735368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.735516:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130768768 00000100:00100000:2.0:1788361508.735526:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130768768 00000100:00100000:2.0:1788361508.735626:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 300 00000100:00100000:2.0:1788361508.735638:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:35029:x1875232130768768:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361508.735703:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361508.735733:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615b3b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ae expref: 54 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735752:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361508.735764:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361508.735788:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b49 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735815:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b49 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735826:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b49 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735843:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b50 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xf507dcec bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735850:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b50 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xf507dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735857:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b50 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xf507dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735940:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b49 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735948:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b49 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735954:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b49 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735960:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361508.735964:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b49 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735972:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b49 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735981:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:2.0:1788361508.735989:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361508.735993:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b49 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.735999:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615b49 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.736010:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b50 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xf507dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.736031:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b50 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xf507dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.736036:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b50 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xf507dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.736041:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361508.736044:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b50 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xf507dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.736049:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b50 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1a:0x0].0xf507dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.736057:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0xf507dcec (ffff9a8a83c0b700) 00010000:00010000:2.0:1788361508.736059:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361508.736062:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b50 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xf507dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.736068:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b50 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1a:0x0].0xf507dcec bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361508.736192:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+53:35029:x1875232130768768:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 556us (832us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788361508.736205:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 300 00000100:00100000:0.0:1788361508.738081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361508.738359:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130768896 00000100:00100000:1.0:1788361508.738366:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130768896 00000100:00100000:1.0:1788361508.738459:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 301 00000100:00100000:1.0:1788361508.738469:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+53:35029:x1875232130768896:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361508.738489:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361508.738509:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615b57 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7b5 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361508.738550:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361508.738575:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361508.738587:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361508.738680:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615b57 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7b5 expref: 55 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361508.738698:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7b5 expref: 54 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361508.738707:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:1.0:1788361508.738709:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361508.738713:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622400, rc 0) 00000100:00100000:1.0:1788361508.738805:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+54:35029:x1875232130768896:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 337us (728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361508.738813:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 301 00000100:00100000:1.0:1788361508.741019:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.741263:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130769152 00000100:00100000:2.0:1788361508.741272:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130769152 00000100:00100000:2.0:1788361508.741326:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 302 00000100:00100000:2.0:1788361508.741334:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+54:35029:x1875232130769152:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361508.741414:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.741431:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.741443:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361508.742025:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].11, 88 off8992 00000004:00080000:2.0:1788361508.742034:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 898756947934ns, next at 899756945634ns, rc = 0 00000004:00010000:2.0:1788361508.742293:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003f6a63c2 reply state 00000000851093c9 transno 30064771333 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361508.742304:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361508.742437:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+56:35029:x1875232130769152:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1102us (1424us total) trans 30064771333 rc 0/0 00000100:00100000:2.0:1788361508.742445:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 302 00010000:00010000:2.0:1788361508.746344:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.746362:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.746386:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.746393:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361508.746398:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.746407:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.746426:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:2.0:1788361508.746430:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361508.746436:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.746443:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b65 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361508.746879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.746954:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130769280 00000100:00100000:2.0:1788361508.746963:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130769280 00000100:00100000:2.0:1788361508.747011:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 303 00000100:00100000:2.0:1788361508.747019:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:35029:x1875232130769280:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361508.747044:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361508.747062:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b6c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7bc expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.747206:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b6c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7bc expref: 56 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.747235:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b6c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7bc expref: 56 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.747257:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:2.0:1788361508.747260:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361508.747263:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:2.0:1788361508.747321:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+56:35029:x1875232130769280:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 301us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361508.747328:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 303 00000100:00100000:0.0:1788361508.751320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.751416:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130769408 00000100:00100000:3.0:1788361508.751425:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130769408 00000100:00100000:3.0:1788361508.751541:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:3.0:1788361508.751553:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+5:2349:x1875232130769408:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788361508.751760:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361508.751894:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130769408:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 342us (581us total) trans 30064771113 rc 0/0 00000100:00100000:3.0:1788361508.751992:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:0.0:1788361508.767469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.767559:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130769664 00000100:00100000:3.0:1788361508.767570:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130769664 00000100:00100000:3.0:1788361508.767632:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:3.0:1788361508.767642:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+56:35029:x1875232130769664:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361508.767885:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+57:35029:x1875232130769664:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 245us (424us total) trans 30064771334 rc 0/0 00000100:00100000:3.0:1788361508.767894:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:1.0:1788361508.769879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.769970:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130769920 00000100:00100000:3.0:1788361508.769989:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130769920 00000100:00100000:3.0:1788361508.770042:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 304 00000100:00100000:3.0:1788361508.770054:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+57:35029:x1875232130769920:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788361508.770184:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+57:35029:x1875232130769920:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 135us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361508.770191:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 304 00000100:00100000:0.0:1788361508.771545:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.771627:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130770048 00000100:00100000:2.0:1788361508.771634:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130770048 00000100:00100000:2.0:1788361508.771683:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 305 00000100:00100000:2.0:1788361508.771693:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+57:35029:x1875232130770048:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361508.771711:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361508.771733:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b73 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7c3 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.771806:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b7a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.771822:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b7a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.771836:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b7a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361508.771875:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361508.771922:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b7a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.771950:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615b73 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7c3 expref: 59 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.771970:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b7a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7c3 expref: 58 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.771979:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:2.0:1788361508.771982:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788361508.771986:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9200, rc 0) 00000100:00100000:2.0:1788361508.772037:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+58:35029:x1875232130770048:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 346us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361508.772044:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 305 00000100:00100000:0.0:1788361508.774553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.774636:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130770176 00000100:00100000:2.0:1788361508.774644:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130770176 00000100:00100000:2.0:1788361508.774723:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:2.0:1788361508.774733:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130770176:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361508.774750:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361508.774771:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d7fab4b/0xf6a94c97d6615b81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7ca expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361508.774801:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983b25, blocks: 0x1 00010000:00010000:2.0:1788361508.774823:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=898s v=(0 0) 00010000:00010000:2.0:1788361508.774828:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361508.774837:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d7fab4b/0xf6a94c97d6615b81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ca expref: 7 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.774877:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d7fab4b/0xf6a94c97d6615b81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ca expref: 7 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361508.774892:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8000, rc 0) 00000100:00100000:2.0:1788361508.774992:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130770176:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 260us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361508.775000:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361508.777732:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.777811:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130770432 00000100:00100000:3.0:1788361508.777820:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130770432 00000100:00100000:3.0:1788361508.777919:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 306 00000100:00100000:3.0:1788361508.777929:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+58:35029:x1875232130770432:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788361508.778041:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+58:35029:x1875232130770432:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361508.778050:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 306 00000100:00100000:0.0:1788361508.784001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.784129:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130770560 00000100:00100000:3.0:1788361508.784139:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130770560 00000100:00100000:3.0:1788361508.784341:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:3.0:1788361508.784352:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:35029:x1875232130770560:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361508.784372:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361508.784392:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7d1 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.784424:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d7fab4b/0xf6a94c97d6615b81 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ca expref: 8 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.784434:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361508.784439:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361508.784459:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 8 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.784492:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d7fab4b/0xf6a94c97d6615b81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ca expref: 8 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.784506:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d7fab4b/0xf6a94c97d6615b81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ca expref: 8 pid: 35980 timeout: 998 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361508.784521:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a870b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144228608:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361508.784710:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9ec1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788361508.791930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361508.792020:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130770688 00000100:00100000:1.0:1788361508.792029:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130770688 00010000:00010000:1.0:1788361508.792071:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d7fab4b/0xf6a94c97d6615b81 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ca expref: 9 pid: 35980 timeout: 998 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361508.792152:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:1.0:1788361508.792173:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130770688:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361508.792195:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361508.792244:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d7fab4b/0xf6a94c97d6615b81 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ca expref: 9 pid: 35980 timeout: 998 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361508.792259:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d7fab4b/0xf6a94c97d6615b81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ca expref: 9 pid: 35980 timeout: 998 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361508.792288:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361508.792292:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361508.792302:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 9 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361508.792313:0:36007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 9 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361508.792350:0:36007:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 9 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361508.792365:0:36007:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89853ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:36007:1875232144228736:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361508.792599:0:36007:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9f30c00 going to sleep for 11 seconds 00010000:00010000:3.0:1788361508.794313:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d7fab4b/0xf6a94c97d6615b81 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ca expref: 9 pid: 35980 timeout: 998 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361508.794333:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a870b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144228608:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361508.794359:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 8 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361508.794371:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca400, rc 0) 00000100:00100000:2.0:1788361508.794662:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+8:35029:x1875232130770560:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 10310us (10670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361508.794672:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:3.0:1788361508.795437:0:36007:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89853ddf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:36007:1875232144228736:192.168.203.60@tcp:105: 00010000:00010000:3.0:1788361508.795456:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361508.795499:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130770688:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3337us (3578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361508.795508:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:0.0:1788361508.813654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.816383:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130770816 00000100:00100000:2.0:1788361508.816405:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130770816 00002000:00100000:2.0:1788361508.816535:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (0->1048575) req@ffff9a8aa9cf1500 x1875232130770816/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361508.816546:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf1500 with x1875232130770816 ext(0->1048575) 00002000:00010000:2.0:1788361508.816553:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf1500 00000100:00100000:2.0:1788361508.816645:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:2.0:1788361508.816656:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2351:x1875232130770816:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361508.834445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.834732:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130770944 00000100:00100000:3.0:1788361508.834752:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130770944 00002000:00100000:3.0:1788361508.834799:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (1048576->2097151) req@ffff9a8a9086d880 x1875232130770944/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361508.834809:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086d880 with x1875232130770944 ext(1048576->2097151) 00002000:00010000:3.0:1788361508.834815:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086d880 00000100:00100000:3.0:1788361508.834847:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:3.0:1788361508.834856:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130770944:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361508.848407:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2351:x1875232130770816:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 31737us (34747us total) trans 30064771114 rc 0/0 00000100:00100000:0.0:1788361508.848439:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00002000:00100000:0.0:1788361508.848456:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (0->1048575) req@ffff9a8aa9cf1500 x1875232130770816/t30064771114(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361508.848468:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf1500 with x1875232130770816 ext(0->1048575) 00002000:00010000:0.0:1788361508.848476:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf1500 00000100:00100000:1.0:1788361508.851715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.851905:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130771072 00000100:00100000:2.0:1788361508.851916:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130771072 00002000:00100000:2.0:1788361508.851962:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (2097152->3145727) req@ffff9a89853df800 x1875232130771072/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361508.851987:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853df800 with x1875232130771072 ext(2097152->3145727) 00002000:00010000:2.0:1788361508.851993:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853df800 00000100:00100000:2.0:1788361508.852038:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 136 00000100:00100000:2.0:1788361508.852048:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130771072:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361508.858417:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130770944:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 23551us (23971us total) trans 30064771115 rc 0/0 00000100:00100000:2.0:1788361508.858432:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 135 00002000:00100000:2.0:1788361508.858445:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (1048576->2097151) req@ffff9a8a9086d880 x1875232130770944/t30064771115(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361508.858456:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086d880 with x1875232130770944 ext(1048576->2097151) 00002000:00010000:2.0:1788361508.858463:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086d880 00000100:00100000:2.0:1788361508.861795:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130771072:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 9739us (10080us total) trans 30064771116 rc 0/0 00000100:00100000:2.0:1788361508.863404:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 136 00002000:00100000:2.0:1788361508.863422:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (2097152->3145727) req@ffff9a89853df800 x1875232130771072/t30064771116(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361508.863433:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853df800 with x1875232130771072 ext(2097152->3145727) 00002000:00010000:2.0:1788361508.863440:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853df800 00000100:00100000:1.0:1788361508.873188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361508.873416:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130771200 00000100:00100000:0.0:1788361508.873426:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130771200 00002000:00100000:0.0:1788361508.873477:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (3145728->4194303) req@ffff9a89853dce00 x1875232130771200/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361508.873488:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dce00 with x1875232130771200 ext(3145728->4194303) 00002000:00010000:0.0:1788361508.873494:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853dce00 00000100:00100000:0.0:1788361508.873533:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:0.0:1788361508.873543:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130771200:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361508.886134:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2352:x1875232130771200:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 12543us (12904us total) trans 30064771117 rc 0/0 00000100:00100000:0.0:1788361508.886149:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 137 00002000:00100000:0.0:1788361508.886162:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (3145728->4194303) req@ffff9a89853dce00 x1875232130771200/t30064771117(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361508.886172:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dce00 with x1875232130771200 ext(3145728->4194303) 00002000:00010000:0.0:1788361508.886179:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853dce00 00000100:00100000:1.0:1788361508.888620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361508.888715:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130771328 00000100:00100000:0.0:1788361508.888726:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130771328 00002000:00100000:0.0:1788361508.888777:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (4194304->5242879) req@ffff9a89853de680 x1875232130771328/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361508.888800:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853de680 with x1875232130771328 ext(4194304->5242879) 00002000:00010000:0.0:1788361508.888806:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853de680 00000100:00100000:0.0:1788361508.889011:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:0.0:1788361508.889024:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:2351:x1875232130771328:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361508.899198:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130771328:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 10167us (10576us total) trans 30064771118 rc 0/0 00000100:00100000:0.0:1788361508.899213:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 138 00002000:00100000:0.0:1788361508.899227:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (4194304->5242879) req@ffff9a89853de680 x1875232130771328/t30064771118(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361508.899236:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853de680 with x1875232130771328 ext(4194304->5242879) 00002000:00010000:0.0:1788361508.899244:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853de680 00000100:00100000:1.0:1788361508.901010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.901287:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130771456 00000100:00100000:2.0:1788361508.901298:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130771456 00002000:00100000:2.0:1788361508.901348:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (5242880->6291455) req@ffff9a89853ded80 x1875232130771456/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361508.901376:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853ded80 with x1875232130771456 ext(5242880->6291455) 00002000:00010000:2.0:1788361508.901381:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853ded80 00000100:00100000:2.0:1788361508.901513:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:2.0:1788361508.901524:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130771456:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361508.912124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.912521:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130771584 00000100:00100000:3.0:1788361508.912530:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130771584 00002000:00100000:3.0:1788361508.912575:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (6291456->7340031) req@ffff9a89853dc000 x1875232130771584/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361508.912586:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dc000 with x1875232130771584 ext(6291456->7340031) 00002000:00010000:3.0:1788361508.912592:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853dc000 00000100:00100000:3.0:1788361508.912627:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 140 00000100:00100000:3.0:1788361508.912637:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+19:2351:x1875232130771584:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361508.913016:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+21:2351:x1875232130771456:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 11491us (12010us total) trans 30064771119 rc 0/0 00000100:00100000:1.0:1788361508.913026:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 139 00002000:00100000:1.0:1788361508.913033:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (5242880->6291455) req@ffff9a89853ded80 x1875232130771456/t30064771119(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361508.913042:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853ded80 with x1875232130771456 ext(5242880->6291455) 00002000:00010000:1.0:1788361508.913045:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853ded80 00000100:00100000:3.0:1788361508.921153:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+21:2351:x1875232130771584:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8505us (9026us total) trans 30064771120 rc 0/0 00000100:00100000:3.0:1788361508.921178:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 140 00002000:00100000:3.0:1788361508.921190:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (6291456->7340031) req@ffff9a89853dc000 x1875232130771584/t30064771120(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361508.921200:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dc000 with x1875232130771584 ext(6291456->7340031) 00002000:00010000:3.0:1788361508.921207:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853dc000 00000100:00100000:1.0:1788361508.923317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361508.923446:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130771712 00000100:00100000:0.0:1788361508.923455:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130771712 00002000:00100000:0.0:1788361508.923500:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (7340032->8388607) req@ffff9a89853ddc00 x1875232130771712/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361508.923511:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853ddc00 with x1875232130771712 ext(7340032->8388607) 00002000:00010000:0.0:1788361508.923516:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853ddc00 00000100:00100000:0.0:1788361508.923591:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:0.0:1788361508.923601:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:2352:x1875232130771712:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361508.929960:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+23:2352:x1875232130771712:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6350us (6642us total) trans 30064771121 rc 0/0 00000100:00100000:3.0:1788361508.929985:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 141 00002000:00100000:3.0:1788361508.930000:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (7340032->8388607) req@ffff9a89853ddc00 x1875232130771712/t30064771121(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361508.930011:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853ddc00 with x1875232130771712 ext(7340032->8388607) 00002000:00010000:3.0:1788361508.930018:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853ddc00 00000100:00100000:0.0:1788361508.940282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.940381:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130771840 00000100:00100000:2.0:1788361508.940391:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130771840 00002000:00100000:2.0:1788361508.940441:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (8388608->9437183) req@ffff9a8aa9cf2d80 x1875232130771840/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361508.940462:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf2d80 with x1875232130771840 ext(8388608->9437183) 00002000:00010000:2.0:1788361508.940469:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf2d80 00000100:00100000:2.0:1788361508.940502:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 142 00000100:00100000:2.0:1788361508.940511:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+23:2349:x1875232130771840:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361508.952026:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:2349:x1875232130771840:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 11506us (11743us total) trans 30064771122 rc 0/0 00000100:00100000:2.0:1788361508.952040:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 142 00002000:00100000:2.0:1788361508.952052:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (8388608->9437183) req@ffff9a8aa9cf2d80 x1875232130771840/t30064771122(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361508.952063:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf2d80 with x1875232130771840 ext(8388608->9437183) 00002000:00010000:2.0:1788361508.952070:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf2d80 00000100:00100000:0.0:1788361508.955470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.955575:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130771968 00000100:00100000:3.0:1788361508.955585:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130771968 00002000:00100000:3.0:1788361508.955633:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (9437184->10485759) req@ffff9a8aa9cf0a80 x1875232130771968/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361508.955645:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf0a80 with x1875232130771968 ext(9437184->10485759) 00002000:00010000:3.0:1788361508.955651:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf0a80 00000100:00100000:3.0:1788361508.955681:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:3.0:1788361508.955690:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+25:2349:x1875232130771968:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361508.962071:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+27:2349:x1875232130771968:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6372us (6599us total) trans 30064771123 rc 0/0 00000100:00100000:3.0:1788361508.962124:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 143 00002000:00100000:3.0:1788361508.962141:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (9437184->10485759) req@ffff9a8aa9cf0a80 x1875232130771968/t30064771123(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361508.962153:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf0a80 with x1875232130771968 ext(9437184->10485759) 00002000:00010000:3.0:1788361508.962160:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf0a80 00000100:00100000:1.0:1788361508.965171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.965253:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130772096 00000100:00100000:3.0:1788361508.965263:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130772096 00002000:00100000:3.0:1788361508.965312:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (10485760->11534335) req@ffff9a89853dea00 x1875232130772096/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361508.965334:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dea00 with x1875232130772096 ext(10485760->11534335) 00002000:00010000:3.0:1788361508.965339:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853dea00 00000100:00100000:3.0:1788361508.965373:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:3.0:1788361508.965382:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:2350:x1875232130772096:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361508.972827:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130772096:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7435us (7654us total) trans 30064771124 rc 0/0 00000100:00100000:3.0:1788361508.972840:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 144 00002000:00100000:3.0:1788361508.972852:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (10485760->11534335) req@ffff9a89853dea00 x1875232130772096/t30064771124(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361508.972863:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dea00 with x1875232130772096 ext(10485760->11534335) 00002000:00010000:3.0:1788361508.972870:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853dea00 00000100:00100000:0.0:1788361508.983377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361508.983476:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130772224 00000100:00100000:2.0:1788361508.983485:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130772224 00002000:00100000:2.0:1788361508.983541:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (11534336->12582911) req@ffff9a8aa9cf3b80 x1875232130772224/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361508.983705:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf3b80 with x1875232130772224 ext(11534336->12582911) 00002000:00010000:2.0:1788361508.983711:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf3b80 00000100:00100000:2.0:1788361508.983745:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:2.0:1788361508.983757:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130772224:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361508.991665:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130772224:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7901us (8286us total) trans 30064771125 rc 0/0 00000100:00100000:2.0:1788361508.991680:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 145 00002000:00100000:2.0:1788361508.991694:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (11534336->12582911) req@ffff9a8aa9cf3b80 x1875232130772224/t30064771125(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361508.991705:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf3b80 with x1875232130772224 ext(11534336->12582911) 00002000:00010000:2.0:1788361508.991713:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf3b80 00000100:00100000:0.0:1788361508.994133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361508.994191:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130772352 00000100:00100000:3.0:1788361508.994200:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130772352 00002000:00100000:0.0:1788361508.994286:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (12582912->13631487) req@ffff9a8aa9cf2a00 x1875232130772352/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/0 e 0 to 0 dl 1788361519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361508.994297:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf2a00 with x1875232130772352 ext(12582912->13631487) 00002000:00010000:0.0:1788361508.994303:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf2a00 00000100:00100000:0.0:1788361508.994389:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 146 00000100:00100000:0.0:1788361508.994400:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+31:2351:x1875232130772352:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361509.001804:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+33:2351:x1875232130772352:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7396us (7670us total) trans 30064771126 rc 0/0 00000100:00100000:0.0:1788361509.001822:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 146 00002000:00100000:0.0:1788361509.001835:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (12582912->13631487) req@ffff9a8aa9cf2a00 x1875232130772352/t30064771126(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:569/0 lens 488/448 e 0 to 0 dl 1788361519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361509.001845:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf2a00 with x1875232130772352 ext(12582912->13631487) 00002000:00010000:0.0:1788361509.001852:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf2a00 00000100:00100000:1.0:1788361509.007047:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361509.007206:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130772480 00000100:00100000:3.0:1788361509.007214:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130772480 00002000:00100000:2.0:1788361509.007407:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (13631488->14680063) req@ffff9a89853dc700 x1875232130772480/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361509.007418:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dc700 with x1875232130772480 ext(13631488->14680063) 00002000:00010000:2.0:1788361509.007424:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853dc700 00000100:00100000:2.0:1788361509.007454:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:2.0:1788361509.007463:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:2350:x1875232130772480:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361509.011740:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:2350:x1875232130772480:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 4272us (4696us total) trans 30064771127 rc 0/0 00000100:00100000:2.0:1788361509.011751:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 147 00002000:00100000:2.0:1788361509.011761:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc8:0x0] (13631488->14680063) req@ffff9a89853dc700 x1875232130772480/t30064771127(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361509.011775:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dc700 with x1875232130772480 ext(13631488->14680063) 00002000:00010000:2.0:1788361509.011780:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853dc700 00000100:00100000:1.0:1788361509.017679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361509.017798:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130772608 00000100:00100000:2.0:1788361509.017808:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130772608 00002000:00100000:2.0:1788361509.017870:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (14680064->15728639) req@ffff9a89853df480 x1875232130772608/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361509.017881:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853df480 with x1875232130772608 ext(14680064->15728639) 00002000:00010000:2.0:1788361509.017888:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853df480 00000100:00100000:2.0:1788361509.018697:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:2.0:1788361509.018711:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+35:2350:x1875232130772608:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361509.026027:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+37:2350:x1875232130772608:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7310us (8346us total) trans 30064771128 rc 0/0 00000100:00100000:2.0:1788361509.026040:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 148 00002000:00100000:2.0:1788361509.026052:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (14680064->15728639) req@ffff9a89853df480 x1875232130772608/t30064771128(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361509.026062:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853df480 with x1875232130772608 ext(14680064->15728639) 00002000:00010000:2.0:1788361509.026069:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853df480 00000100:00100000:1.0:1788361509.028188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361509.028631:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130772736 00000100:00100000:0.0:1788361509.028639:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130772736 00002000:00100000:0.0:1788361509.028679:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (15728640->16777215) req@ffff9a89853de300 x1875232130772736/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361509.028689:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853de300 with x1875232130772736 ext(15728640->16777215) 00002000:00010000:0.0:1788361509.028694:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853de300 00000100:00100000:0.0:1788361509.028732:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:0.0:1788361509.028746:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+37:2349:x1875232130772736:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361509.043458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361509.044309:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130772736:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 15566us (16126us total) trans 30064771129 rc 0/0 00000100:00100000:0.0:1788361509.044329:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 149 00002000:00100000:0.0:1788361509.044343:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (15728640->16777215) req@ffff9a89853de300 x1875232130772736/t30064771129(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361509.044354:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853de300 with x1875232130772736 ext(15728640->16777215) 00002000:00010000:0.0:1788361509.044362:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853de300 00000100:00100000:0.0:1788361509.044385:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130772864 00000100:00100000:0.0:1788361509.044391:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130772864 00002000:00100000:0.0:1788361509.044424:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (16777216->17825791) req@ffff9a8a870b1180 x1875232130772864/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361509.044433:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b1180 with x1875232130772864 ext(16777216->17825791) 00002000:00010000:0.0:1788361509.044436:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b1180 00000100:00100000:0.0:1788361509.044513:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 150 00000100:00100000:0.0:1788361509.044524:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130772864:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361509.051703:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+41:2349:x1875232130772864:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7171us (8243us total) trans 30064771130 rc 0/0 00000100:00100000:1.0:1788361509.051718:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 150 00002000:00100000:1.0:1788361509.051732:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (16777216->17825791) req@ffff9a8a870b1180 x1875232130772864/t30064771130(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361509.051744:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b1180 with x1875232130772864 ext(16777216->17825791) 00002000:00010000:1.0:1788361509.051751:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b1180 00000100:00100000:3.0:1788361509.052631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361509.053239:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130772992 00000100:00100000:0.0:1788361509.053248:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130772992 00002000:00100000:0.0:1788361509.053290:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (17825792->18874367) req@ffff9a8a870b1c00 x1875232130772992/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361509.053301:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b1c00 with x1875232130772992 ext(17825792->18874367) 00002000:00010000:0.0:1788361509.053305:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b1c00 00000100:00100000:0.0:1788361509.053337:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:0.0:1788361509.053346:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+41:2350:x1875232130772992:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361509.061305:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+43:2350:x1875232130772992:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7950us (8666us total) trans 30064771131 rc 0/0 00000100:00100000:0.0:1788361509.061333:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 151 00002000:00100000:0.0:1788361509.061346:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (17825792->18874367) req@ffff9a8a870b1c00 x1875232130772992/t30064771131(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361509.061357:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b1c00 with x1875232130772992 ext(17825792->18874367) 00002000:00010000:0.0:1788361509.061363:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b1c00 00000100:00100000:2.0:1788361509.063122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.063171:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130773120 00000100:00100000:1.0:1788361509.063180:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130773120 00002000:00100000:1.0:1788361509.063239:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (18874368->19922943) req@ffff9a8a9086d180 x1875232130773120/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361509.063251:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086d180 with x1875232130773120 ext(18874368->19922943) 00002000:00010000:1.0:1788361509.063257:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086d180 00000100:00100000:1.0:1788361509.063289:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00100000:1.0:1788361509.063299:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130773120:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361509.072191:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+45:2349:x1875232130773120:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8883us (9097us total) trans 30064771132 rc 0/0 00000100:00100000:2.0:1788361509.072205:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 152 00002000:00100000:2.0:1788361509.072216:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (18874368->19922943) req@ffff9a8a9086d180 x1875232130773120/t30064771132(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361509.072243:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086d180 with x1875232130773120 ext(18874368->19922943) 00002000:00010000:2.0:1788361509.072251:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a9086d180 00000100:00100000:3.0:1788361509.076947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.077119:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130773248 00000100:00100000:1.0:1788361509.077128:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130773248 00002000:00100000:1.0:1788361509.077178:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (19922944->20971519) req@ffff9a8a870b1880 x1875232130773248/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361509.077190:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b1880 with x1875232130773248 ext(19922944->20971519) 00002000:00010000:1.0:1788361509.077196:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b1880 00000100:00100000:1.0:1788361509.077230:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:1.0:1788361509.077239:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+45:2350:x1875232130773248:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361509.086432:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+47:2350:x1875232130773248:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 9184us (9484us total) trans 30064771133 rc 0/0 00000100:00100000:1.0:1788361509.086446:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 153 00002000:00100000:1.0:1788361509.086458:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (19922944->20971519) req@ffff9a8a870b1880 x1875232130773248/t30064771133(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361509.086468:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b1880 with x1875232130773248 ext(19922944->20971519) 00002000:00010000:1.0:1788361509.086475:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b1880 00000100:00100000:2.0:1788361509.089141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.089305:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130773376 00000100:00100000:1.0:1788361509.089314:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130773376 00000100:00100000:1.0:1788361509.089386:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 307 00000100:00100000:1.0:1788361509.089396:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+58:35029:x1875232130773376:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788361509.114326:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771305 is committed 00000001:00080000:0.0:1788361509.114350:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771330 is committed 00000004:00080000:0.0:1788361509.114363:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:0.0:1788361509.114385:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:0.0:1788361509.114400:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771333 is committed 00000004:00080000:0.0:1788361509.114402:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000100:00100000:3.0:1788361509.114492:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+44:35029:x1875232130773376:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 25092us (25353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361509.114503:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 307 00000001:00080000:0.0:1788361509.114551:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771334 is committed 00000020:00080000:0.0:1788361509.114566:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8aa9ec1b40 refcount 2 committed 0 result 0 batchid 25769803901 00000020:00080000:0.0:1788361509.114570:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8aa8f83100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8aa9ec16c0 00000020:00080000:0.0:1788361509.114573:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8aa8f83800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ac1364c00 00000020:00080000:0.0:1788361509.114591:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803900 batchid updated 00000100:00100000:0.0:1788361509.114704:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144228864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788361509.114754:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788361509.114863:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803901 committed batchid 25769803900 00000020:00080000:3.0:1788361509.115037:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803900 00000100:00100000:0.0:1788361509.115454:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361509.115462:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9086df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144228992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788361509.115492:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361509.115526:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144228864 00000100:00100000:0.0:1788361509.115532:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144228864 00000100:00100000:0.0:1788361509.115624:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144228992 00000100:00100000:0.0:1788361509.115629:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144228992 00000100:00080000:1.0:1788361509.115662:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361509.115666:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361509.115766:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788361509.115774:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144228864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361509.115832:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788361509.115845:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144228992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788361509.115943:0:35983:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:3.0:1788361509.115946:0:35983:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb mtime from disk: 1788361507 -> 1788361507 00002000:00010000:3.0:1788361509.115949:0:35983:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788361509.115951:0:35983:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb ctime from disk: 1788361507 -> 1788361507 00002000:00010000:3.0:1788361509.115954:0:35983:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc7:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788361509.115968:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144228864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (1213us total) trans 30064771134 rc 0/0 00000100:00100000:0.0:1788361509.115974:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788361509.115977:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144228992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (485us total) trans 30064771179 rc 0/0 00000100:00100000:3.0:1788361509.115982:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000004:00080000:0.0:1788361509.116010:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a9086df80/2, rc 0, transno 30064771179 00000100:00100000:0.0:1788361509.116024:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9086df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144228992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788361509.116036:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771112 gen 2 00000004:00080000:0.0:1788361509.116042:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771112 committed transno 30064771112 00000100:00100000:0.0:1788361509.116069:0:3313:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8aa9cf0700 x1875232144228864/t30064771134(30064771134) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788361525 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788361509.116078:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8aa9cf0700/2, rc 0, transno 30064771134 00000100:00100000:0.0:1788361509.116115:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144228864:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361509.116258:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361509.116348:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144229248:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361509.116377:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361509.116402:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144229120:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788361509.116421:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361509.116610:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144229248 00000100:00100000:1.0:1788361509.116615:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144229248 00000100:00100000:1.0:1788361509.116677:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144229120 00000100:00100000:1.0:1788361509.116681:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144229120 00000100:00100000:1.0:1788361509.116709:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788361509.116716:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144229248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788361509.116807:0:35983:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:1.0:1788361509.116811:0:35983:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb mtime from disk: 0 -> 1788361509 00002000:00010000:1.0:1788361509.116813:0:35983:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361509.116815:0:35983:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb ctime from disk: 1788361509 -> 1788361509 00002000:00010000:1.0:1788361509.116818:0:35983:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788361509.116848:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1875232144229248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (471us total) trans 30064771135 rc 0/0 00000100:00100000:1.0:1788361509.116856:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788361509.116871:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788361509.116877:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144229120:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788361509.116889:0:35983:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:199 count 1 00002000:00010000:1.0:1788361509.116923:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc7:0x0] initial LVB size: 15728640, mtime: 0x6a983b23, atime: 0x0, ctime: 0x6a983b23, blocks: 0x7807 00010000:00010000:1.0:1788361509.116931:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6615b8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.116946:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=899s v=(0 0) 00010000:00010000:1.0:1788361509.116951:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361509.116967:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6615b8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.116984:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6615b8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.116995:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6615b8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.117004:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6615b8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.117024:0:35983:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788361509.117466:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1875232144229120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 589us (1042us total) trans 30064771136 rc 0/0 00000100:00100000:1.0:1788361509.117473:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:1.0:1788361509.117496:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361509.117503:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6615b8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.117512:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361509.117517:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6615b8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.117527:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6615b8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.117557:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6615b8f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.117565:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c6898f/0xf6a94c97d6615b8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.117587:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361509.117589:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361509.117590:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788361509.117755:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a89858af800/2, rc 0, transno 30064771135 00000100:00100000:3.0:1788361509.117762:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144229248:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788361509.117770:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8987649c00/2, rc 0, transno 30064771136 00000100:00100000:3.0:1788361509.117773:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144229120:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788361509.117781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.117819:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130773504 00000100:00100000:1.0:1788361509.117823:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130773504 00000100:00100000:1.0:1788361509.117856:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:1.0:1788361509.117864:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:2350:x1875232130773504:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788361509.174192:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:2350:x1875232130773504:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 56319us (56401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361509.174207:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000001:00080000:3.0:1788361509.174628:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771134 is committed 00000001:00080000:3.0:1788361509.174640:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771131 is committed 00000001:00080000:3.0:1788361509.174679:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771136 is committed 00000001:00080000:3.0:1788361509.174688:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771133 is committed 00000100:00100000:3.0:1788361509.176291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361509.176403:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130773760 00000100:00100000:0.0:1788361509.176412:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130773760 00000100:00100000:0.0:1788361509.176527:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 308 00000100:00100000:0.0:1788361509.176539:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+24:35029:x1875232130773760:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788361509.176601:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361509.176632:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615b7a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7c3 expref: 24 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.176652:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:0.0:1788361509.176658:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361509.176692:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.176725:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.176736:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361509.176927:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b822eab9 reply state 0000000018f6a355 transno 30064771335 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361509.176937:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361509.177042:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:35029:x1875232130773760:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 504us (756us total) trans 30064771335 rc 0/0 00000100:00100000:0.0:1788361509.177050:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 308 00000100:00100000:2.0:1788361509.179852:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.180191:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130773888 00010000:00010000:0.0:1788361509.180198:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361509.180200:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130773888 00010000:00010000:0.0:1788361509.180212:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.180220:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.180227:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361509.180231:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.180240:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361509.180260:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00010000:00010000:0.0:1788361509.180261:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8984a32900) 00000100:00100000:1.0:1788361509.180272:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+6:2350:x1875232130773888:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00010000:00010000:0.0:1788361509.180280:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361509.180288:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.180295:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615b96 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361509.180540:0:35983:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb size from disk: 20971520 -> 20971520 00002000:00010000:1.0:1788361509.180826:0:35983:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb mtime from disk: 1788361509 -> 1788361508 00002000:00010000:1.0:1788361509.180829:0:35983:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb atime from disk: 0 -> 1788361508 00002000:00010000:1.0:1788361509.180831:0:35983:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb ctime from disk: 1788361509 -> 1788361508 00002000:00010000:1.0:1788361509.180833:0:35983:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 40967 00000100:00100000:1.0:1788361509.180908:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130773888:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 628us (1054us total) trans 30064771137 rc 0/0 00000100:00100000:1.0:1788361509.180917:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:2.0:1788361509.182752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361509.182835:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130774144 00000100:00100000:3.0:1788361509.182843:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130774144 00000100:00100000:3.0:1788361509.182904:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 309 00000100:00100000:3.0:1788361509.182926:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+24:35029:x1875232130774144:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788361509.183059:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.183080:0:37551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7b5 expref: 24 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.183159:0:37551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.183203:0:37551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7b5 expref: 24 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.183218:0:37551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7b5 expref: 24 pid: 35345 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361509.183233:0:37551:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a870b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:37551:1875232144229376:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361509.183305:0:37551:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9ec1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788361509.191028:0:37551:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a870b1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:37551:1875232144229376:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361509.191059:0:37551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361509.191698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361509.191792:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130774272 00000100:00100000:0.0:1788361509.191800:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130774272 00010000:00010000:0.0:1788361509.191906:0:38408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7b5 expref: 25 pid: 35345 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361509.191987:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:0.0:1788361509.191996:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+25:2350:x1875232130774272:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361509.192010:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361509.192018:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7b5 expref: 25 pid: 35345 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.192029:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7b5 expref: 25 pid: 35345 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.192050:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615b5e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7b5 expref: 25 pid: 35345 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.192064:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:0.0:1788361509.192069:0:38408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.192079:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.192135:0:38408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.192205:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361509.192251:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+24:2350:x1875232130774272:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 254us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361509.192258:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00010000:00010000:2.0:1788361509.192955:0:37551:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.192963:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.192994:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.193002:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.193008:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.193015:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361509.193019:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.193039:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.193051:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:2.0:1788361509.193053:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788361509.193057:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.193062:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615b9d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361509.193143:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+23:35029:x1875232130774144:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 10220us (10396us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788361509.193153:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 309 00000100:00100000:2.0:1788361509.194763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361509.194837:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130774400 00000100:00100000:3.0:1788361509.194846:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130774400 00000100:00100000:3.0:1788361509.194906:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:3.0:1788361509.194916:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130774400:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788361509.194963:0:35980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.194985:0:35980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 7 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.195008:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xc8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788361509.195013:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361509.195017:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.195074:0:35980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 7 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.195114:0:35980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 7 pid: 36286 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361509.195130:0:35980:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a870b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35980:1875232144229504:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361509.195402:0:35980:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9ec1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361509.197298:0:35980:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a870b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35980:1875232144229504:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361509.197325:0:35980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361509.235486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.235763:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130774528 00000100:00100000:1.0:1788361509.235773:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130774528 00010000:00010000:1.0:1788361509.235834:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 8 pid: 36286 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361509.235877:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:1.0:1788361509.235887:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+8:2349:x1875232130774528:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361509.235915:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361509.235945:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 8 pid: 36286 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.235960:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 8 pid: 36286 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.236230:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d5a6e42/0xf6a94c97d6615b88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d1 expref: 8 pid: 36286 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.236249:0:35331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361509.236254:0:35331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361509.236260:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.236271:0:35331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.236554:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361509.236617:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+7:2349:x1875232130774528:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 730us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361509.236625:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00010000:00010000:2.0:1788361509.237658:0:35980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.237672:0:35980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.237706:0:35980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.237727:0:35980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.237735:0:35980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.237743:0:35980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361509.237747:0:35980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.237757:0:35980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.237776:0:35980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.237783:0:35980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0c003a5/0xf6a94c97d6615ba4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361509.237925:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+6:2349:x1875232130774400:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 43008us (43166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361509.237935:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:2.0:1788361509.241742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361509.242043:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130774784 00000100:00100000:3.0:1788361509.242053:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130774784 00000100:00100000:3.0:1788361509.242409:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 310 00000100:00100000:3.0:1788361509.242515:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+23:35029:x1875232130774784:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788361509.242601:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bab lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.242621:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bab lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.242633:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bab lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.242986:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.242996:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b6c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7bc expref: 24 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.243002:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.243030:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b6c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7bc expref: 24 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.243040:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b6c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7bc expref: 24 pid: 35346 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361509.243051:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a870b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144229632:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361509.243268:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9ec1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361509.245266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361509.245672:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130774912 00000100:00100000:0.0:1788361509.245682:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130774912 00010000:00010000:0.0:1788361509.245719:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b6c lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7bc expref: 25 pid: 35346 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361509.245755:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:0.0:1788361509.245763:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8984bb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:2351:x1875232130774912:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361509.245778:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361509.245786:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b6c lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7bc expref: 25 pid: 35346 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.245812:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b6c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7bc expref: 25 pid: 35346 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.245843:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:0.0:1788361509.245849:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.245858:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.245884:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.245916:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361509.245966:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8984bb7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:2351:x1875232130774912:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 203us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361509.245974:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00010000:00010000:1.0:1788361509.247256:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615b6c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7bc expref: 24 pid: 35346 timeout: 999 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361509.247288:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a870b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144229632:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361509.247308:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.247318:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.247325:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361509.247763:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771336 00000001:00080000:1.0:1788361509.247997:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771337 00000001:00080000:1.0:1788361509.248043:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771338 00000100:00100000:1.0:1788361509.248328:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89853dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144229760:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788361509.248388:0:35347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361509.248460:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a89026000 going to sleep for 11 seconds 00000100:00100000:2.0:1788361509.248552:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144229760 00000100:00100000:2.0:1788361509.248559:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144229760 00000100:00100000:2.0:1788361509.248660:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788361509.248670:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144229760:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788361509.248750:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144229760:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361509.248757:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788361509.248809:0:35347:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771136 gen 2 00000004:00080000:1.0:1788361509.248815:0:35347:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8aa9cf0700, transno 30064771134 00000004:00080000:1.0:1788361509.248839:0:35347:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a89858af800, transno 30064771135 00000004:00080000:1.0:1788361509.248843:0:35347:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8987649c00, transno 30064771136 00000100:00100000:1.0:1788361509.248858:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89853dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144229760:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788361509.249500:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771339 00000100:00100000:1.0:1788361509.249565:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89853dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144229888:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788361509.249597:0:35347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361509.249620:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788361509.249644:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144229888 00000100:00100000:0.0:1788361509.249651:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144229888 00000100:00100000:0.0:1788361509.249686:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788361509.249694:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35347:x1875232144229888:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788361509.249912:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35347:x1875232144229888:12345-0@lo:1000:mdt00_002.0 Request processed in 218us (313us total) trans 30064771138 rc 0/0 00000100:00100000:0.0:1788361509.249920:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:3.0:1788361509.250080:0:35367:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1788361509.250515:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89853dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:35347:1875232144229888:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788361509.250549:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250559:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250567:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250574:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361509.250579:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250587:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250606:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8984a32900) 00010000:00010000:1.0:1788361509.250609:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361509.250615:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250622:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bb2 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250657:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250671:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250677:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250682:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361509.250685:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250691:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250699:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361509.250701:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361509.250708:0:35347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615b03 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7a0 expref: 27 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250720:0:35347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615b03 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7a0 expref: 27 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250728:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615b03 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7a0 expref: 27 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.250755:0:35347:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622000/0xf6a94c97d6615b03 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7a0 expref: 27 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361509.250768:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89853dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144230016:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361509.250842:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8814ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361509.253656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.253815:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89853dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144230016:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361509.253844:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.253854:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615afc lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.253886:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615bb9 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.253908:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615bb9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.253923:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615bb9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.253934:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615bb9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.253940:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615bb9 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.253947:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615bb9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.253953:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361509.253957:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615bb9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.253964:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615bb9 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.253993:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361509.253996:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361509.254000:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615bb9 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.254006:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615bb9 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.254015:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bab lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.254021:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bab lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.254027:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bab lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.254032:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361509.254034:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bab lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.254041:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bab lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.254048:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361509.254051:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361509.254053:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bab lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.254058:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bab lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1b:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361509.254106:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130775040 00000100:00100000:3.0:1788361509.254114:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130775040 00000100:00100000:2.0:1788361509.254403:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:2.0:1788361509.254415:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:35028:x1875232130775040:12345-192.168.203.60@tcp:49:dd.500 00000100:00100000:2.0:1788361509.254572:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:35028:x1875232130775040:12345-192.168.203.60@tcp:49:dd.500 Request processed in 159us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361509.254580:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:1.0:1788361509.254661:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+27:35029:x1875232130774784:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 12150us (12926us total) trans 30064771340 rc 0/0 00000100:00100000:1.0:1788361509.254669:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 310 00000020:00080000:1.0:1788361509.254674:0:35347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788361509.254835:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361509.254840:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361509.255580:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 9 00000040:00080000:0.0:1788361509.255589:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361509.263803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361509.263946:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130775168 00000100:00100000:3.0:1788361509.263957:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130775168 00000100:00100000:3.0:1788361509.264011:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:3.0:1788361509.264022:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+6:35028:x1875232130775168:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:3.0:1788361509.264042:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361509.264065:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b9055b9/0xf6a94c97d6615bc0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7d8 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361509.264143:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc8:0x0] initial LVB size: 20971520, mtime: 0x6a983b24, atime: 0x6a983b24, ctime: 0x6a983b24, blocks: 0xa007 00010000:00010000:3.0:1788361509.264228:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=899s v=(0 0) 00010000:00010000:3.0:1788361509.264234:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361509.264245:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b9055b9/0xf6a94c97d6615bc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d8 expref: 7 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.264264:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009b9055b9/0xf6a94c97d6615bc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7d8 expref: 7 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361509.264278:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcba00, rc 0) 00000100:00100000:3.0:1788361509.264387:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:35028:x1875232130775168:12345-192.168.203.60@tcp:101:dd.500 Request processed in 367us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361509.264395:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:1.0:1788361509.280260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361509.280348:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130775296 00000100:00100000:0.0:1788361509.280357:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130775296 00002000:00100000:0.0:1788361509.280397:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (20971520->22020095) req@ffff9a89853dfb80 x1875232130775296/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00010000:00010000:3.0:1788361509.280401:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00100000:0.0:1788361509.280410:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dfb80 with x1875232130775296 ext(20971520->22020095) 00002000:00010000:0.0:1788361509.280416:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853dfb80 00000100:00100000:0.0:1788361509.280447:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 154 00000100:00100000:0.0:1788361509.280456:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130775296:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:0.0:1788361509.284772:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130775296:12345-192.168.203.60@tcp:4:dd.500 Request processed in 4307us (4515us total) trans 30064771139 rc 0/0 00000100:00100000:0.0:1788361509.284787:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 154 00002000:00100000:0.0:1788361509.284799:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (20971520->22020095) req@ffff9a89853dfb80 x1875232130775296/t30064771139(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788361509.284810:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dfb80 with x1875232130775296 ext(20971520->22020095) 00002000:00010000:0.0:1788361509.284817:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89853dfb80 00000100:00100000:2.0:1788361509.290868:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.291181:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130775424 00000100:00100000:1.0:1788361509.291190:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130775424 00002000:00100000:1.0:1788361509.291253:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (22020096->23068671) req@ffff9a898af35f80 x1875232130775424/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361509.291264:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af35f80 with x1875232130775424 ext(22020096->23068671) 00002000:00010000:1.0:1788361509.291269:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898af35f80 00000100:00100000:1.0:1788361509.291556:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 155 00000100:00100000:1.0:1788361509.291567:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+9:2349:x1875232130775424:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:1.0:1788361509.302640:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130775424:12345-192.168.203.60@tcp:4:dd.500 Request processed in 11065us (11771us total) trans 30064771140 rc 0/0 00000100:00100000:1.0:1788361509.302654:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 155 00002000:00100000:1.0:1788361509.302666:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (22020096->23068671) req@ffff9a898af35f80 x1875232130775424/t30064771140(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361509.302676:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af35f80 with x1875232130775424 ext(22020096->23068671) 00002000:00010000:1.0:1788361509.302683:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898af35f80 00000100:00100000:3.0:1788361509.304146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.304252:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130775552 00000100:00100000:1.0:1788361509.304259:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130775552 00002000:00100000:1.0:1788361509.304294:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (23068672->24117247) req@ffff9a8a870b3b80 x1875232130775552/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361509.304318:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b3b80 with x1875232130775552 ext(23068672->24117247) 00002000:00010000:1.0:1788361509.304321:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b3b80 00000100:00100000:1.0:1788361509.304433:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 156 00000100:00100000:1.0:1788361509.304440:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+11:2350:x1875232130775552:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:1.0:1788361509.316969:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130775552:12345-192.168.203.60@tcp:4:dd.500 Request processed in 12518us (12817us total) trans 30064771141 rc 0/0 00000100:00100000:1.0:1788361509.316984:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 156 00002000:00100000:1.0:1788361509.316997:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (23068672->24117247) req@ffff9a8a870b3b80 x1875232130775552/t30064771141(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361509.317007:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b3b80 with x1875232130775552 ext(23068672->24117247) 00002000:00010000:1.0:1788361509.317016:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b3b80 00000100:00100000:3.0:1788361509.324874:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361509.325216:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130775680 00000100:00100000:0.0:1788361509.325225:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130775680 00002000:00100000:0.0:1788361509.325276:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (24117248->25165823) req@ffff9a8a870b2a00 x1875232130775680/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788361509.325287:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b2a00 with x1875232130775680 ext(24117248->25165823) 00002000:00010000:0.0:1788361509.325294:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b2a00 00000100:00100000:0.0:1788361509.325390:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 157 00000100:00100000:0.0:1788361509.325401:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130775680:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:3.0:1788361509.332230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361509.332309:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130775936 00000100:00100000:2.0:1788361509.332318:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130775936 00000100:00100000:2.0:1788361509.332419:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:2.0:1788361509.332429:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:35029:x1875232130775936:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361509.332710:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130775680:12345-192.168.203.60@tcp:4:dd.500 Request processed in 7310us (7845us total) trans 30064771142 rc 0/0 00000100:00100000:0.0:1788361509.332720:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 157 00002000:00100000:0.0:1788361509.332730:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (24117248->25165823) req@ffff9a8a870b2a00 x1875232130775680/t30064771142(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788361509.332749:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b2a00 with x1875232130775680 ext(24117248->25165823) 00002000:00010000:0.0:1788361509.332755:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b2a00 00000004:00080000:2.0:1788361509.333132:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x1e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788361509.333260:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771341 00010000:00010000:2.0:1788361509.333304:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.333322:0:35348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.333335:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.333355:0:35348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.333361:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.333365:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361509.333381:0:35348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788361509.333450:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:35029:x1875232130775936:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1022us (1228us total) trans 30064771342 rc 0/0 00000100:00100000:2.0:1788361509.333456:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00000020:00080000:2.0:1788361509.333460:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788361509.333534:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361509.333548:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.333555:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361509.333559:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.333568:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.333582:0:35334:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1e:0x0].0x0 (ffff9a8a83c0b700) 00010000:00010000:0.0:1788361509.333585:0:35334:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788361509.333591:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.333596:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615bc7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.333615:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361509.333617:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361509.333619:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361509.348329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.348549:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130776064 00000100:00100000:1.0:1788361509.348559:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130776064 00002000:00100000:1.0:1788361509.348611:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (25165824->26214399) req@ffff9a8a870b1f80 x1875232130776064/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361509.348623:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b1f80 with x1875232130776064 ext(25165824->26214399) 00002000:00010000:1.0:1788361509.348630:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b1f80 00000100:00100000:1.0:1788361509.348663:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:1.0:1788361509.348673:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130776064:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:3.0:1788361509.353173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.353236:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130776192 00000100:00100000:1.0:1788361509.353246:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130776192 00002000:00100000:1.0:1788361509.353295:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (26214400->27262975) req@ffff9a8a870b3100 x1875232130776192/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361509.353322:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b3100 with x1875232130776192 ext(26214400->27262975) 00002000:00010000:1.0:1788361509.353329:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b3100 00000100:00100000:1.0:1788361509.353408:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:1.0:1788361509.353428:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130776192:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:0.0:1788361509.357181:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+19:2350:x1875232130776064:12345-192.168.203.60@tcp:4:dd.500 Request processed in 8485us (8838us total) trans 30064771143 rc 0/0 00000100:00100000:0.0:1788361509.357196:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 158 00002000:00100000:0.0:1788361509.357208:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc8:0x0] (25165824->26214399) req@ffff9a8a870b1f80 x1875232130776064/t30064771143(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788361509.357219:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b1f80 with x1875232130776064 ext(25165824->26214399) 00002000:00010000:0.0:1788361509.357226:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b1f80 00000100:00100000:1.0:1788361509.362114:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+19:2351:x1875232130776192:12345-192.168.203.60@tcp:4:dd.500 Request processed in 8647us (8914us total) trans 30064771144 rc 0/0 00000100:00100000:1.0:1788361509.362132:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 159 00002000:00100000:1.0:1788361509.362148:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (26214400->27262975) req@ffff9a8a870b3100 x1875232130776192/t30064771144(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361509.362169:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b3100 with x1875232130776192 ext(26214400->27262975) 00002000:00010000:1.0:1788361509.362178:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b3100 00000100:00100000:0.0:1788361509.373369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361509.373435:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130776320 00000100:00100000:2.0:1788361509.373454:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130776320 00002000:00100000:2.0:1788361509.373512:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (27262976->28311551) req@ffff9a8aa9cf2680 x1875232130776320/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788361509.373533:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf2680 with x1875232130776320 ext(27262976->28311551) 00002000:00010000:2.0:1788361509.373540:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf2680 00000100:00100000:2.0:1788361509.373574:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 160 00000100:00100000:2.0:1788361509.373586:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+19:2350:x1875232130776320:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:3.0:1788361509.389118:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+21:2350:x1875232130776320:12345-192.168.203.60@tcp:4:dd.500 Request processed in 15491us (15714us total) trans 30064771145 rc 0/0 00000100:00100000:3.0:1788361509.389133:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 160 00002000:00100000:3.0:1788361509.389148:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (27262976->28311551) req@ffff9a8aa9cf2680 x1875232130776320/t30064771145(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788361509.389189:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf2680 with x1875232130776320 ext(27262976->28311551) 00002000:00010000:3.0:1788361509.389197:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf2680 00000100:00100000:0.0:1788361509.390603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361509.390672:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130776448 00000100:00100000:2.0:1788361509.390682:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130776448 00002000:00100000:2.0:1788361509.390724:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (28311552->29360127) req@ffff9a8aa9cf2300 x1875232130776448/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788361509.390749:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf2300 with x1875232130776448 ext(28311552->29360127) 00002000:00010000:2.0:1788361509.390754:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf2300 00000100:00100000:2.0:1788361509.390798:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 161 00000100:00100000:2.0:1788361509.390818:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+21:2350:x1875232130776448:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:2.0:1788361509.397492:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+23:2350:x1875232130776448:12345-192.168.203.60@tcp:4:dd.500 Request processed in 6674us (6884us total) trans 30064771146 rc 0/0 00000100:00100000:2.0:1788361509.397506:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 161 00002000:00100000:2.0:1788361509.397519:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc8:0x0] (28311552->29360127) req@ffff9a8aa9cf2300 x1875232130776448/t30064771146(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788361509.397530:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf2300 with x1875232130776448 ext(28311552->29360127) 00002000:00010000:2.0:1788361509.397537:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf2300 00000100:00100000:0.0:1788361509.408665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361509.408879:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130776576 00000100:00100000:1.0:1788361509.408889:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130776576 00002000:00100000:1.0:1788361509.408951:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (29360128->30408703) req@ffff9a8aa9cf0000 x1875232130776576/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361509.408962:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf0000 with x1875232130776576 ext(29360128->30408703) 00002000:00010000:1.0:1788361509.408968:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf0000 00000100:00100000:1.0:1788361509.409043:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:1.0:1788361509.409053:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+23:2349:x1875232130776576:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:1.0:1788361509.418484:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+25:2349:x1875232130776576:12345-192.168.203.60@tcp:4:dd.500 Request processed in 9418us (9814us total) trans 30064771147 rc 0/0 00000100:00100000:1.0:1788361509.418503:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 162 00002000:00100000:1.0:1788361509.419462:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc8:0x0] (29360128->30408703) req@ffff9a8aa9cf0000 x1875232130776576/t30064771147(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361509.419473:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf0000 with x1875232130776576 ext(29360128->30408703) 00002000:00010000:1.0:1788361509.419480:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8aa9cf0000 00000100:00100000:2.0:1788361509.419751:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361509.420170:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130776704 00000100:00100000:3.0:1788361509.420181:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130776704 00002000:00100000:3.0:1788361509.420228:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (30408704->31457279) req@ffff9a898af37480 x1875232130776704/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/0 e 0 to 0 dl 1788361520 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788361509.420237:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af37480 with x1875232130776704 ext(30408704->31457279) 00002000:00010000:3.0:1788361509.420240:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898af37480 00000100:00100000:3.0:1788361509.420281:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:3.0:1788361509.420292:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:2352:x1875232130776704:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:0.0:1788361509.423508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361509.423880:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130776960 00000100:00100000:3.0:1788361509.423890:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130776960 00000100:00100000:3.0:1788361509.423965:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:3.0:1788361509.423976:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab76d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:35028:x1875232130776960:12345-192.168.203.60@tcp:35:dd.500 00000001:00080000:3.0:1788361509.424317:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771343 00000001:00080000:3.0:1788361509.424385:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771344 00000100:00100000:3.0:1788361509.429259:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab76d7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:35028:x1875232130776960:12345-192.168.203.60@tcp:35:dd.500 Request processed in 5273us (5750us total) trans 30064771345 rc 0/0 00000100:00100000:3.0:1788361509.429283:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000020:00080000:3.0:1788361509.429291:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788361509.432935:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:2352:x1875232130776704:12345-192.168.203.60@tcp:4:dd.500 Request processed in 12635us (13176us total) trans 30064771148 rc 0/0 00000100:00100000:3.0:1788361509.432949:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 163 00002000:00100000:3.0:1788361509.432962:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc8:0x0] (30408704->31457279) req@ffff9a898af37480 x1875232130776704/t30064771148(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:570/0 lens 488/448 e 0 to 0 dl 1788361520 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788361509.432985:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af37480 with x1875232130776704 ext(30408704->31457279) 00002000:00010000:3.0:1788361509.432993:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898af37480 00000100:00100000:1.0:1788361509.497651:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361509.497788:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130777088 00000100:00100000:0.0:1788361509.497970:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130777088 00000100:00100000:0.0:1788361509.498035:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 311 00000100:00100000:0.0:1788361509.498045:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:35039:x1875232130777088:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1788361509.498289:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615bce lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.498313:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615bce lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.498326:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615bce lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.498344:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615bd5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.498352:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615bd5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361509.498359:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615bd5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.499386:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.499398:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.499407:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361509.499457:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.499472:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615bce lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.499480:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615bce lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.499487:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615bce lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.499493:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361509.499498:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615bce lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.499506:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615bce lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500017:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x0 (ffff9a8984a32a00) 00010000:00010000:1.0:1788361509.500021:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361509.500027:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615bce lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500034:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fe00/0xf6a94c97d6615bce lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500048:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615bd5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500055:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615bd5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500061:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615bd5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500067:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361509.500069:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615bd5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500076:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615bd5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500083:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1a:0x0].0x852f64c2 (ffff9a8a90b43300) 00010000:00010000:1.0:1788361509.500171:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361509.500176:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615bd5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500182:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615bd5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1a:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500211:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500218:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500224:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500229:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361509.500231:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500237:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500245:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1b:0x0].0x0 (ffff9a8a90b43100) 00010000:00010000:1.0:1788361509.500247:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361509.500250:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361509.500256:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615bdc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361509.500471:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:35039:x1875232130777088:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 2423us (2825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361509.500480:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 311 00010000:00010000:1.0:1788361510.312583:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788361510.628909:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771177 is committed 00000001:00080000:1.0:1788361510.628975:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771179 is committed 00000001:00080000:1.0:1788361510.628987:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771178 is committed 00000100:00100000:0.0:1788361511.073283:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89853dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144230144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361511.073368:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361511.073409:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144230144 00000100:00100000:1.0:1788361511.073417:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144230144 00000100:00100000:0.0:1788361511.073443:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361511.073455:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a870b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144230656:0@lo:400:kworker.0 00000100:00100000:1.0:1788361511.073478:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788361511.073491:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144230144:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361511.073498:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788361511.073530:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 178847744 pending 0 free 3772776448 avail 3770679296 00000100:00100000:0.0:1788361511.073531:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a870b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144230272:0@lo:400:kworker.0 00000100:00100000:0.0:1788361511.073576:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361511.073581:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a870b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144230528:0@lo:400:kworker.0 00000100:00100000:3.0:1788361511.073620:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361511.073638:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144230144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 148us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361511.073640:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771179 gen 2 00000100:00100000:3.0:1788361511.073644:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:0.0:1788361511.073648:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a9086df80, transno 30064771179 00000100:00100000:3.0:1788361511.073664:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a870b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144230400:0@lo:400:kworker.0 00000100:00100000:1.0:1788361511.073665:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788361511.073670:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89853dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144230144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361511.073690:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361511.073701:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a870b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144230784:0@lo:400:kworker.0 00000100:00080000:1.0:1788361511.073702:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361511.073721:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144230656 00000100:00100000:1.0:1788361511.073726:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144230656 00000100:00100000:0.0:1788361511.073740:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361511.073768:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144230528 00000100:00100000:1.0:1788361511.073773:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144230528 00000100:00100000:3.0:1788361511.073774:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361511.073780:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144230784 00000100:00100000:0.0:1788361511.073786:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144230784 00000100:00100000:1.0:1788361511.073817:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788361511.073827:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144230656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361511.073869:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144230656:12345-0@lo:400:kworker.0 Request processed in 45us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361511.074774:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788361511.074783:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788361511.074788:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144230528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361511.074798:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361511.074811:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144230784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361511.074821:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144230400 00000100:00100000:1.0:1788361511.074827:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144230400 00000100:00100000:0.0:1788361511.074838:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144230528:12345-0@lo:400:kworker.0 Request processed in 55us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361511.074846:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788361511.074862:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144230784:12345-0@lo:400:kworker.0 Request processed in 54us (1121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361511.074873:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788361511.074894:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a870b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144230528:0@lo:400:kworker.0 00000100:00100000:1.0:1788361511.074895:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144230400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361511.074934:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788361511.074949:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144230400:12345-0@lo:400:kworker.0 Request processed in 68us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361511.074959:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788361511.074965:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144230272 00000100:00100000:3.0:1788361511.074971:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144230272 00000100:00080000:1.0:1788361511.074989:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361511.074995:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361511.075006:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788361511.075015:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144230272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361511.075044:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a870b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144230400:0@lo:400:kworker.0 00000100:00100000:3.0:1788361511.075063:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144230272:12345-0@lo:400:kworker.0 Request processed in 49us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361511.075072:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788361511.075079:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a870b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144230784:0@lo:400:kworker.0 00000100:00100000:0.0:1788361511.075110:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a870b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144230656:0@lo:400:kworker.0 00000100:00100000:0.0:1788361511.075124:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a870b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144230272:0@lo:400:kworker.0 00010000:00010000:3.0:1788361511.328352:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361511.328854:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361511.328860:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361511.328974:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 9 count 9 00000040:00080000:2.0:1788361511.328983:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361511.584820:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898af37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144230912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361511.584899:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361511.585013:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144230912 00000100:00100000:0.0:1788361511.585021:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144230912 00000100:00100000:0.0:1788361511.585071:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361511.585079:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144230912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361511.585136:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 144769024 pending 17039360 free 3830448128 avail 3828350976 00000100:00100000:0.0:1788361511.585218:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144230912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361511.585225:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361511.585331:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898af37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144230912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361512.345902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361512.346392:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130777216 00000100:00100000:1.0:1788361512.346402:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130777216 00000100:00080000:2.0:1788361512.346629:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361512.346708:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 312 00000100:00100000:1.0:1788361512.346719:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:34971:x1875232130777216:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788361512.346821:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:34971:x1875232130777216:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 105us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361512.346828:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 312 00000100:00100000:3.0:1788361512.349198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361512.349314:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130777472 00000100:00100000:0.0:1788361512.349324:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130777472 00000100:00100000:0.0:1788361512.349377:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:0.0:1788361512.349385:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:34971:x1875232130777472:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361512.349926:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:34971:x1875232130777472:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 539us (732us total) trans 30064771346 rc 0/0 00000100:00100000:0.0:1788361512.349935:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00010000:00010000:0.0:1788361512.352744:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361512.495970:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361512.496174:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130777600 00000100:00100000:0.0:1788361512.496184:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130777600 00000100:00100000:0.0:1788361512.496252:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 313 00000100:00100000:0.0:1788361512.496261:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:35479:x1875232130777600:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:0.0:1788361512.496278:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361512.496296:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615be3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7df expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361512.496362:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361512.496383:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361512.496394:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361512.496564:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788361512.496794:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1788361512.496804:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 15 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361512.496897:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361512.496922:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615be3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7df expref: 7 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361512.496938:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7df expref: 6 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361512.496947:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361512.496950:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361512.496954:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00100000:0.0:1788361512.497183:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:35479:x1875232130777600:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 921us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361512.497191:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 313 00000100:00100000:2.0:1788361513.095351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361513.095396:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361513.095443:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361513.095526:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130777984 00000100:00100000:3.0:1788361513.095536:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130777984 00000100:00100000:3.0:1788361513.095604:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:3.0:1788361513.095629:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:2351:x1875232130777984:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361513.095738:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:2351:x1875232130777984:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 111us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361513.095745:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00080000:2.0:1788361513.096026:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361513.096117:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130777728 00000100:00100000:0.0:1788361513.096122:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130777728 00000100:00100000:0.0:1788361513.096159:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:0.0:1788361513.096167:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130777728:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361513.096211:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130777728:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 45us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361513.096217:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:1.0:1788361513.096856:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130778240 00000100:00100000:1.0:1788361513.096862:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130778240 00000100:00100000:1.0:1788361513.096921:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:1.0:1788361513.096930:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2351:x1875232130778240:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361513.096984:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2351:x1875232130778240:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 56us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361513.096992:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:3.0:1788361513.098166:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361513.098221:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361513.098316:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130778112 00000100:00100000:1.0:1788361513.098322:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130778112 00000100:00100000:1.0:1788361513.098410:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:1.0:1788361513.098419:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2351:x1875232130778112:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361513.098484:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2351:x1875232130778112:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361513.098491:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00080000:3.0:1788361513.098683:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361513.099746:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130777856 00000100:00100000:2.0:1788361513.099755:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130777856 00000100:00100000:2.0:1788361513.099827:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:2.0:1788361513.099836:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+33:2351:x1875232130777856:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361513.099901:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+33:2351:x1875232130777856:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361513.099908:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00010000:00010000:1.0:1788361513.377712:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788361514.191971:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771346 is committed 00000020:00080000:2.0:1788361514.191997:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8ac05e00c0 refcount 2 committed 0 result 0 batchid 25769803902 00000020:00080000:2.0:1788361514.192003:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ab705cd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a865d4900 00000020:00080000:2.0:1788361514.192006:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ab705c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8aa9cf4c00 00000020:00080000:2.0:1788361514.192058:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803901 batchid updated 00000020:00080000:0.0:1788361514.192479:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803902 committed batchid 25769803901 00000020:00080000:0.0:1788361514.192644:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803901 00000001:00080000:3.0:1788361514.211832:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771143 is committed 00000001:00080000:3.0:1788361514.211856:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771138 is committed 00000001:00080000:3.0:1788361514.212032:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771147 is committed 00000001:00080000:3.0:1788361514.212068:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771148 is committed 00000001:02000400:2.0:1788361514.332886:0:38599:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10b: Test RW-PCC with group quota on loop PCC device ========================================================== 11:05:14 (1788361514) 00010000:00010000:3.0:1788361514.400492:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361515.424846:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361515.475154:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361515.475252:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130778496 00000100:00100000:3.0:1788361515.475261:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130778496 00000100:00100000:3.0:1788361515.475335:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 314 00000100:00100000:3.0:1788361515.475347:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+21:35760:x1875232130778496:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361515.475367:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361515.475385:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bf1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7e6 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.475451:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bf8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.475465:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.475476:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.475548:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615bff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.475556:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615bff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.475564:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615bff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476188:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615c06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476200:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615c06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476208:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615c06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361515.476218:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788361515.476380:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476388:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bf8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476394:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476399:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361515.476403:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476421:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476432:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:3.0:1788361515.476435:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361515.476439:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bf8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476445:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615bf8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476457:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615bff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476464:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615bff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476470:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615bff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476475:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361515.476478:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615bff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476484:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615bff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476491:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361515.476493:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361515.476496:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615bff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476510:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615bff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.476850:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615bf1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7e6 expref: 24 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361515.476962:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788361515.477474:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615c06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7e6 expref: 23 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.477483:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:3.0:1788361515.477485:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361515.477488:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcb200, rc 0) 00000100:00100000:3.0:1788361515.477551:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+23:35760:x1875232130778496:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2207us (2405us total) trans 30064771347 rc 0/0 00000100:00100000:3.0:1788361515.477559:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 314 00000100:00100000:2.0:1788361515.481241:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361515.481480:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130778624 00000100:00100000:1.0:1788361515.481489:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130778624 00000100:00100000:1.0:1788361515.481543:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 315 00000100:00100000:1.0:1788361515.481553:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+23:35760:x1875232130778624:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788361515.481649:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+23:35760:x1875232130778624:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 97us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361515.481656:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 315 00000100:00100000:1.0:1788361515.481842:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361515.482277:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130778752 00000100:00100000:2.0:1788361515.482283:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130778752 00000100:00100000:2.0:1788361515.482362:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1788361515.482370:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+23:2350:x1875232130778752:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361515.482382:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361515.482406:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615c06 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7e6 expref: 23 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.482422:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361515.482428:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361515.482466:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+22:2350:x1875232130778752:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 97us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361515.482489:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1788361515.571938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361515.572063:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130779008 00000100:00100000:2.0:1788361515.572073:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130779008 00000100:00100000:2.0:1788361515.572216:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 316 00000100:00100000:2.0:1788361515.572226:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+22:35775:x1875232130779008:12345-192.168.203.60@tcp:36:mkdir.0 00010000:00010000:2.0:1788361515.572297:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361515.572321:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d661593c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f70d expref: 22 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.572339:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361515.572343:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361515.572697:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.572711:0:37551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7df expref: 5 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.572720:0:37551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.572751:0:37551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7df expref: 5 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.572764:0:37551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7df expref: 5 pid: 37551 timeout: 1005 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361515.572778:0:37551:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b065880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:37551:1875232144231040:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361515.572896:0:37551:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361515.575529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361515.575626:0:37551:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b065880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:37551:1875232144231040:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361515.575650:0:37551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361515.575715:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130779136 00000100:00100000:1.0:1788361515.575722:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130779136 00010000:00010000:1.0:1788361515.575767:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7df expref: 6 pid: 37551 timeout: 1005 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361515.575802:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:1.0:1788361515.575809:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130779136:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361515.575824:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361515.575830:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7df expref: 6 pid: 37551 timeout: 1005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.575842:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7df expref: 6 pid: 37551 timeout: 1005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.575871:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615bea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7df expref: 6 pid: 37551 timeout: 1005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.575885:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:1.0:1788361515.575889:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.575908:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.575916:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.575935:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361515.575977:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130779136:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 167us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361515.575984:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00010000:00010000:0.0:1788361515.576147:0:37551:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.576154:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.576176:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.576185:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.576192:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361515.576985:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788361515.578050:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 512 00010000:00010000:0.0:1788361515.578061:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.578067:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.578072:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.578076:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361515.578078:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.578116:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.578127:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361515.578129:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361515.578132:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.578136:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6615c14 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361515.578153:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000074b18413 reply state 000000007bd83dfd transno 30064771348 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361515.578159:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361515.578220:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+23:35775:x1875232130779008:12345-192.168.203.60@tcp:36:mkdir.0 Request processed in 5996us (6290us total) trans 30064771348 rc 0/0 00000100:00100000:0.0:1788361515.578226:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 316 00010000:00010000:2.0:1788361515.580638:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.580652:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.580660:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.580666:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361515.580671:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.580679:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.580693:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff9a8a90b43400) 00010000:00010000:2.0:1788361515.580697:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361515.580700:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.580707:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615c1b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361515.587980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361515.589151:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130779264 00000100:00100000:3.0:1788361515.589162:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130779264 00000100:00100000:3.0:1788361515.589225:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 317 00000100:00100000:3.0:1788361515.589236:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+22:35776:x1875232130779264:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1788361515.589259:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361515.589279:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615c22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7ed expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.589346:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615c29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.589372:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.589384:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361515.589441:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1788361515.589445:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361515.589472:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615c29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.589497:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615c22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ed expref: 24 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.589512:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615c29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ed expref: 23 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.589519:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361515.589522:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361515.589525:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bca200, rc 0) 00000100:00100000:3.0:1788361515.589587:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+23:35776:x1875232130779264:12345-192.168.203.60@tcp:101:dd.0 Request processed in 354us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361515.589594:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 317 00000100:00100000:3.0:1788361515.592532:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361515.592592:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130779392 00000100:00100000:2.0:1788361515.592601:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130779392 00000100:00100000:2.0:1788361515.592653:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 318 00000100:00100000:2.0:1788361515.592662:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+23:35776:x1875232130779392:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361515.592680:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361515.592707:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615c30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7f4 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.592774:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615c37 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.592787:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615c37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.592798:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615c37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.592815:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615c3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.592822:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.592828:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.592943:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615c45 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.592952:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615c45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.592960:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615c45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361515.592995:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 512 00000004:00200000:2.0:1788361515.592999:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361515.593144:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615c45 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593173:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615c37 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593180:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615c37 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593188:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615c37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593193:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361515.593197:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615c37 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593208:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615c37 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593223:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:2.0:1788361515.593226:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361515.593230:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615c37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593235:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615c37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593254:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615c3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593260:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615c3e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593266:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615c3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593281:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361515.593287:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615c3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593293:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615c3e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593304:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bf5a1df (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361515.593307:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361515.593310:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615c3e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593319:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615c3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bf5a1df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593353:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615c30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7f4 expref: 25 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593366:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9400/0xf6a94c97d6615c45 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7f4 expref: 24 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361515.593374:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:2.0:1788361515.593376:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788361515.593378:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9400, rc 0) 00000100:00100000:2.0:1788361515.593439:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+24:35776:x1875232130779392:12345-192.168.203.60@tcp:101:dd.0 Request processed in 778us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361515.593449:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 318 00000100:00100000:1.0:1788361515.595646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361515.595730:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130779648 00000100:00100000:0.0:1788361515.595814:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130779648 00000100:00100000:0.0:1788361515.595866:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 319 00000100:00100000:0.0:1788361515.595874:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+24:35776:x1875232130779648:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361515.595890:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361515.595904:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615c4c lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f7fb expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.596000:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615c53 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.596022:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615c53 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.596030:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615c53 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.596040:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.596044:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.596048:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361515.596913:0:37551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc8:0x0], index 1: 0 00010000:00010000:0.0:1788361515.597060:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615c61 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597071:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615c61 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597079:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615c61 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597146:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615c53 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597153:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615c53 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597170:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615c53 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597182:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361515.597187:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615c53 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597194:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615c53 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597205:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:0.0:1788361515.597208:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361515.597213:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615c53 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597218:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615c53 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361515.597230:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005a2e716f reply state 00000000b8bc7128 transno 30064771349 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361515.597239:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361515.597510:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573ee00/0xf6a94c97d6615c4c lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7fb expref: 27 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597526:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615c61 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7fb expref: 26 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.597533:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361515.597536:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361515.597539:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f200, rc 0) 00000100:00100000:0.0:1788361515.597648:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+27:35776:x1875232130779648:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1772us (2008us total) trans 30064771349 rc 0/0 00000100:00100000:0.0:1788361515.597662:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 319 00010000:00010000:0.0:1788361515.599624:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.599638:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.599646:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.599703:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361515.599709:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.599717:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.599797:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff9a8a90b43d00) 00010000:00010000:0.0:1788361515.599801:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361515.599805:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.599812:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c5a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361515.604365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361515.604486:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130779776 00000100:00100000:3.0:1788361515.604495:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130779776 00000100:00100000:3.0:1788361515.604571:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:3.0:1788361515.604582:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:35776:x1875232130779776:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1788361515.604612:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361515.604632:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6615c6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f802 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361515.604698:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788361515.604720:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=905s v=(0 0) 00010000:00010000:3.0:1788361515.604725:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361515.604902:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6615c6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f802 expref: 10 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.604919:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6615c6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f802 expref: 10 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361515.604932:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcbe00, rc 0) 00000100:00080000:2.0:1788361515.605050:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361515.605906:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:35776:x1875232130779776:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1321us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361515.605916:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:3.0:1788361515.628621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361515.629993:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130779904 00000100:00100000:2.0:1788361515.630003:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130779904 00002000:00100000:2.0:1788361515.630054:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (0->1048575) req@ffff9a89921af100 x1875232130779904/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.630066:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921af100 with x1875232130779904 ext(0->1048575) 00002000:00010000:2.0:1788361515.630071:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921af100 00000100:00100000:2.0:1788361515.630461:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 164 00000100:00100000:2.0:1788361515.630471:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130779904:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361515.639237:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361515.639310:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130780032 00000100:00100000:0.0:1788361515.639320:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130780032 00002000:00100000:0.0:1788361515.639366:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (1048576->2097151) req@ffff9a89859c9180 x1875232130780032/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361515.639377:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c9180 with x1875232130780032 ext(1048576->2097151) 00002000:00010000:0.0:1788361515.639396:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c9180 00000100:00100000:0.0:1788361515.639466:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:0.0:1788361515.639476:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+12:2352:x1875232130780032:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361515.659791:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130779904:12345-192.168.203.60@tcp:4:dd.0 Request processed in 29310us (31167us total) trans 30064771180 rc 0/0 00000100:00100000:2.0:1788361515.659806:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 164 00002000:00100000:2.0:1788361515.659820:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (0->1048575) req@ffff9a89921af100 x1875232130779904/t30064771180(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.659831:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921af100 with x1875232130779904 ext(0->1048575) 00002000:00010000:2.0:1788361515.659837:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921af100 00000100:00100000:1.0:1788361515.668341:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2352:x1875232130780032:12345-192.168.203.60@tcp:4:dd.0 Request processed in 28854us (29101us total) trans 30064771181 rc 0/0 00000100:00100000:1.0:1788361515.668356:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 165 00002000:00100000:1.0:1788361515.668371:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (1048576->2097151) req@ffff9a89859c9180 x1875232130780032/t30064771181(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.668381:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c9180 with x1875232130780032 ext(1048576->2097151) 00002000:00010000:1.0:1788361515.668388:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c9180 00000100:00100000:3.0:1788361515.670589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361515.670655:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130780160 00000100:00100000:2.0:1788361515.670665:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130780160 00002000:00100000:2.0:1788361515.670710:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (2097152->3145727) req@ffff9a89921af480 x1875232130780160/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.670721:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921af480 with x1875232130780160 ext(2097152->3145727) 00002000:00010000:2.0:1788361515.670727:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921af480 00000100:00100000:2.0:1788361515.670761:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:2.0:1788361515.670771:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:2351:x1875232130780160:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361515.680671:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+16:2351:x1875232130780160:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9890us (10079us total) trans 30064771182 rc 0/0 00000100:00100000:0.0:1788361515.680686:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 166 00002000:00100000:0.0:1788361515.680701:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (2097152->3145727) req@ffff9a89921af480 x1875232130780160/t30064771182(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361515.680711:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921af480 with x1875232130780160 ext(2097152->3145727) 00002000:00010000:0.0:1788361515.680718:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921af480 00000100:00100000:2.0:1788361515.687999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361515.688347:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130780288 00000100:00100000:1.0:1788361515.688357:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130780288 00002000:00100000:1.0:1788361515.689406:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (3145728->4194303) req@ffff9a898b067b80 x1875232130780288/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.689420:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b067b80 with x1875232130780288 ext(3145728->4194303) 00002000:00010000:1.0:1788361515.689434:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b067b80 00000100:00100000:1.0:1788361515.689621:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:1.0:1788361515.689633:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+16:2349:x1875232130780288:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361515.698604:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+18:2349:x1875232130780288:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8964us (10606us total) trans 30064771183 rc 0/0 00000100:00100000:1.0:1788361515.698618:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 167 00002000:00100000:1.0:1788361515.698628:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (3145728->4194303) req@ffff9a898b067b80 x1875232130780288/t30064771183(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.698637:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b067b80 with x1875232130780288 ext(3145728->4194303) 00002000:00010000:1.0:1788361515.698642:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b067b80 00000100:00100000:1.0:1788361515.704889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361515.705016:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130780416 00000100:00100000:3.0:1788361515.705026:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130780416 00002000:00100000:3.0:1788361515.705072:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (4194304->5242879) req@ffff9a89859c8000 x1875232130780416/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361515.705101:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c8000 with x1875232130780416 ext(4194304->5242879) 00002000:00010000:3.0:1788361515.705106:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c8000 00000100:00100000:3.0:1788361515.705130:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:3.0:1788361515.705145:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+18:2350:x1875232130780416:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361515.715393:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:2350:x1875232130780416:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10237us (10500us total) trans 30064771184 rc 0/0 00000100:00100000:2.0:1788361515.715407:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 168 00002000:00100000:2.0:1788361515.715419:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (4194304->5242879) req@ffff9a89859c8000 x1875232130780416/t30064771184(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.715431:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c8000 with x1875232130780416 ext(4194304->5242879) 00002000:00010000:2.0:1788361515.715439:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c8000 00000001:00080000:1.0:1788361515.716619:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771182 is committed 00000100:00100000:1.0:1788361515.717258:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361515.717342:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130780544 00000100:00100000:0.0:1788361515.717350:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130780544 00002000:00100000:0.0:1788361515.717391:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (5242880->6291455) req@ffff9a89859c9500 x1875232130780544/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361515.717401:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c9500 with x1875232130780544 ext(5242880->6291455) 00002000:00010000:0.0:1788361515.717406:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c9500 00000100:00100000:0.0:1788361515.717437:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:0.0:1788361515.717445:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130780544:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361515.727052:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+16:2349:x1875232130780544:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9597us (9787us total) trans 30064771185 rc 0/0 00000100:00100000:0.0:1788361515.727068:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 169 00002000:00100000:0.0:1788361515.727081:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (5242880->6291455) req@ffff9a89859c9500 x1875232130780544/t30064771185(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361515.727150:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c9500 with x1875232130780544 ext(5242880->6291455) 00002000:00010000:0.0:1788361515.727156:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c9500 00000100:00100000:3.0:1788361515.729352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361515.729408:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130780672 00000100:00100000:1.0:1788361515.729418:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130780672 00002000:00100000:1.0:1788361515.729465:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (6291456->7340031) req@ffff9a89921ae300 x1875232130780672/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.729476:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ae300 with x1875232130780672 ext(6291456->7340031) 00002000:00010000:1.0:1788361515.729480:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ae300 00000100:00100000:1.0:1788361515.729718:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:1.0:1788361515.729728:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+16:2350:x1875232130780672:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361515.736675:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+18:2350:x1875232130780672:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6939us (7320us total) trans 30064771186 rc 0/0 00000100:00100000:2.0:1788361515.736688:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 170 00002000:00100000:2.0:1788361515.736700:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (6291456->7340031) req@ffff9a89921ae300 x1875232130780672/t30064771186(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.736710:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ae300 with x1875232130780672 ext(6291456->7340031) 00002000:00010000:2.0:1788361515.736716:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ae300 00000100:00100000:1.0:1788361515.740690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361515.740750:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130780800 00000100:00100000:2.0:1788361515.740759:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130780800 00002000:00100000:2.0:1788361515.740806:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (7340032->8388607) req@ffff9a89859c8a80 x1875232130780800/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.740817:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c8a80 with x1875232130780800 ext(7340032->8388607) 00002000:00010000:2.0:1788361515.740824:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c8a80 00000100:00100000:2.0:1788361515.740868:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:2.0:1788361515.740877:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+18:2350:x1875232130780800:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361515.747499:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:2350:x1875232130780800:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6613us (6813us total) trans 30064771187 rc 0/0 00000100:00100000:2.0:1788361515.747524:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 171 00002000:00100000:2.0:1788361515.747536:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (7340032->8388607) req@ffff9a89859c8a80 x1875232130780800/t30064771187(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.747546:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c8a80 with x1875232130780800 ext(7340032->8388607) 00002000:00010000:2.0:1788361515.747552:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c8a80 00000100:00100000:3.0:1788361515.754216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361515.754392:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130780928 00000100:00100000:0.0:1788361515.754402:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130780928 00002000:00100000:0.0:1788361515.754447:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (8388608->9437183) req@ffff9a89921ac000 x1875232130780928/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361515.754458:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ac000 with x1875232130780928 ext(8388608->9437183) 00002000:00010000:0.0:1788361515.754463:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ac000 00000100:00100000:0.0:1788361515.754553:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00100000:0.0:1788361515.754564:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+20:2350:x1875232130780928:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361515.766481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361515.773398:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130781056 00000100:00100000:2.0:1788361515.773412:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130781056 00002000:00100000:2.0:1788361515.773460:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (9437184->10485759) req@ffff9a89859c9880 x1875232130781056/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.773472:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c9880 with x1875232130781056 ext(9437184->10485759) 00002000:00010000:2.0:1788361515.773478:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c9880 00000100:00100000:2.0:1788361515.773504:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:2.0:1788361515.773513:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+22:2352:x1875232130781056:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361515.775041:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+24:2350:x1875232130780928:12345-192.168.203.60@tcp:4:dd.0 Request processed in 20472us (20828us total) trans 30064771188 rc 0/0 00000100:00100000:1.0:1788361515.775064:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 172 00002000:00100000:1.0:1788361515.775073:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc8:0x0] (8388608->9437183) req@ffff9a89921ac000 x1875232130780928/t30064771188(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.775082:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ac000 with x1875232130780928 ext(8388608->9437183) 00002000:00010000:1.0:1788361515.775121:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ac000 00000100:00100000:3.0:1788361515.782269:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+24:2352:x1875232130781056:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8747us (15786us total) trans 30064771189 rc 0/0 00000100:00100000:3.0:1788361515.782283:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 173 00002000:00100000:3.0:1788361515.782295:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (9437184->10485759) req@ffff9a89859c9880 x1875232130781056/t30064771189(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361515.782306:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c9880 with x1875232130781056 ext(9437184->10485759) 00002000:00010000:3.0:1788361515.782312:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c9880 00000100:00100000:2.0:1788361515.788703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361515.788801:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130781184 00000100:00100000:1.0:1788361515.788822:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130781184 00002000:00100000:1.0:1788361515.788874:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (10485760->11534335) req@ffff9a898b065880 x1875232130781184/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.788886:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b065880 with x1875232130781184 ext(10485760->11534335) 00002000:00010000:1.0:1788361515.788892:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b065880 00000100:00100000:1.0:1788361515.788955:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:1.0:1788361515.788965:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+24:2351:x1875232130781184:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361515.799950:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+26:2351:x1875232130781184:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10976us (11246us total) trans 30064771190 rc 0/0 00000100:00100000:1.0:1788361515.799964:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 174 00002000:00100000:1.0:1788361515.799977:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (10485760->11534335) req@ffff9a898b065880 x1875232130781184/t30064771190(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.799987:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b065880 with x1875232130781184 ext(10485760->11534335) 00002000:00010000:1.0:1788361515.799994:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b065880 00000100:00100000:0.0:1788361515.810292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361515.810436:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130781312 00000100:00100000:2.0:1788361515.810447:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130781312 00002000:00100000:2.0:1788361515.810493:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (11534336->12582911) req@ffff9a8aa9cf0e00 x1875232130781312/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.810503:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf0e00 with x1875232130781312 ext(11534336->12582911) 00002000:00010000:2.0:1788361515.810509:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8aa9cf0e00 00000100:00100000:2.0:1788361515.810617:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 175 00000100:00100000:2.0:1788361515.810627:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:2349:x1875232130781312:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361515.820178:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+28:2349:x1875232130781312:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9543us (9885us total) trans 30064771191 rc 0/0 00000100:00100000:2.0:1788361515.820200:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 175 00002000:00100000:2.0:1788361515.820214:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (11534336->12582911) req@ffff9a8aa9cf0e00 x1875232130781312/t30064771191(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.820225:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf0e00 with x1875232130781312 ext(11534336->12582911) 00002000:00010000:2.0:1788361515.820232:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8aa9cf0e00 00000100:00100000:3.0:1788361515.826422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361515.826548:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130781440 00000100:00100000:2.0:1788361515.826558:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130781440 00002000:00100000:2.0:1788361515.826608:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (12582912->13631487) req@ffff9a89921af800 x1875232130781440/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.826620:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921af800 with x1875232130781440 ext(12582912->13631487) 00002000:00010000:2.0:1788361515.826625:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921af800 00000100:00100000:2.0:1788361515.826661:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 176 00000100:00100000:2.0:1788361515.826672:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+28:2350:x1875232130781440:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361515.837509:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+30:2350:x1875232130781440:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10827us (11083us total) trans 30064771192 rc 0/0 00000100:00100000:2.0:1788361515.837523:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 176 00002000:00100000:2.0:1788361515.837536:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc8:0x0] (12582912->13631487) req@ffff9a89921af800 x1875232130781440/t30064771192(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.837547:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921af800 with x1875232130781440 ext(12582912->13631487) 00002000:00010000:2.0:1788361515.837554:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921af800 00000100:00100000:0.0:1788361515.843315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361515.843474:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130781568 00000100:00100000:1.0:1788361515.843484:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130781568 00002000:00100000:1.0:1788361515.843591:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (13631488->14680063) req@ffff9a8aa9cf0700 x1875232130781568/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.843613:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf0700 with x1875232130781568 ext(13631488->14680063) 00002000:00010000:1.0:1788361515.843619:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8aa9cf0700 00000100:00100000:1.0:1788361515.843655:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 177 00000100:00100000:1.0:1788361515.843664:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:2349:x1875232130781568:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361515.853642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361515.853768:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130781824 00000100:00100000:1.0:1788361515.853778:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130781824 00000100:00100000:1.0:1788361515.853835:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:1.0:1788361515.853845:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:35776:x1875232130781824:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:1.0:1788361515.854232:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:35776:x1875232130781824:12345-192.168.203.60@tcp:35:dd.0 Request processed in 387us (599us total) trans 30064771350 rc 0/0 00000100:00100000:1.0:1788361515.854242:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:1.0:1788361515.854810:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+32:2349:x1875232130781568:12345-192.168.203.60@tcp:4:dd.0 Request processed in 11146us (11503us total) trans 30064771193 rc 0/0 00000100:00100000:1.0:1788361515.854819:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 177 00002000:00100000:1.0:1788361515.854829:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc8:0x0] (13631488->14680063) req@ffff9a8aa9cf0700 x1875232130781568/t30064771193(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.854839:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf0700 with x1875232130781568 ext(13631488->14680063) 00002000:00010000:1.0:1788361515.854846:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8aa9cf0700 00000100:00100000:1.0:1788361515.855350:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361515.855403:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130781952 00000100:00100000:0.0:1788361515.855409:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130781952 00002000:00100000:0.0:1788361515.855441:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (14680064->15728639) req@ffff9a89859c8380 x1875232130781952/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361515.855451:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c8380 with x1875232130781952 ext(14680064->15728639) 00002000:00010000:0.0:1788361515.855454:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c8380 00000100:00100000:1.0:1788361515.855527:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00100000:1.0:1788361515.855536:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:2351:x1875232130781952:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361515.864932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361515.865014:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130782208 00000100:00100000:0.0:1788361515.865024:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130782208 00000100:00100000:0.0:1788361515.865122:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 320 00000100:00100000:0.0:1788361515.865226:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+27:35777:x1875232130782208:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361515.865251:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361515.865282:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615c76 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f809 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361515.865431:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:2351:x1875232130781952:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9894us (10080us total) trans 30064771194 rc 0/0 00000100:00100000:1.0:1788361515.865445:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 178 00002000:00100000:1.0:1788361515.865456:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc8:0x0] (14680064->15728639) req@ffff9a89859c8380 x1875232130781952/t30064771194(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.865465:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c8380 with x1875232130781952 ext(14680064->15728639) 00002000:00010000:1.0:1788361515.865470:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859c8380 00010000:00010000:0.0:1788361515.865748:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615c7d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.865763:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615c7d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.865775:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615c7d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.865791:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.865799:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.865806:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361515.866237:0:35347:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xc9:0x0], index 0: 0 00010000:00010000:0.0:1788361515.866380:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c8b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.866388:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c8b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.866396:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c8b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.866441:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615c7d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.866457:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615c7d lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.866463:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615c7d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.866469:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361515.866473:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615c7d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.866479:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615c7d lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.866964:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:0.0:1788361515.866967:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361515.866973:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615c7d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.866979:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615c7d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361515.866993:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000069f6d997 reply state 0000000019dee18b transno 30064771351 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361515.867001:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361515.867032:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615c76 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f809 expref: 30 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.867044:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c8b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f809 expref: 29 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361515.867064:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff9a8a90b43000) 00010000:00010000:0.0:1788361515.867066:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361515.867069:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e200, rc 0) 00000100:00100000:1.0:1788361515.867412:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:35777:x1875232130782208:12345-192.168.203.60@tcp:101:dd.0 Request processed in 2280us (2485us total) trans 30064771351 rc 0/0 00000100:00100000:1.0:1788361515.868326:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 320 00010000:00010000:1.0:1788361515.869304:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.869317:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.869325:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.869331:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361515.869335:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.869343:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.869359:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff9a8a90b43d00) 00010000:00010000:1.0:1788361515.869363:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361515.869367:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.869389:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615c84 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361515.874246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361515.878059:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130782336 00000100:00100000:1.0:1788361515.878073:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130782336 00000100:00100000:1.0:1788361515.878161:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:1.0:1788361515.878172:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+6:35777:x1875232130782336:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361515.878191:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361515.878209:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f3f31f5/0xf6a94c97d6615c99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f810 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361515.878236:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361515.878257:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=905s v=(0 0) 00010000:00010000:1.0:1788361515.878262:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361515.878272:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f3f31f5/0xf6a94c97d6615c99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f810 expref: 7 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.878287:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f3f31f5/0xf6a94c97d6615c99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f810 expref: 7 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361515.878299:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622a00, rc 0) 00000100:00080000:2.0:1788361515.878348:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361515.879923:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+7:35777:x1875232130782336:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1746us (5678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361515.879933:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:2.0:1788361515.902383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361515.902487:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130782464 00000100:00100000:3.0:1788361515.902497:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130782464 00002000:00100000:3.0:1788361515.902544:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (0->1048575) req@ffff9a8992065c00 x1875232130782464/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361515.902556:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992065c00 with x1875232130782464 ext(0->1048575) 00002000:00010000:3.0:1788361515.902562:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992065c00 00000100:00100000:3.0:1788361515.902593:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00100000:3.0:1788361515.902603:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130782464:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361515.918112:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992065c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130782464:12345-192.168.203.60@tcp:4:dd.0 Request processed in 15506us (15733us total) trans 30064771149 rc 0/0 00000100:00100000:2.0:1788361515.918134:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00100000:1.0:1788361515.918143:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00002000:00100000:2.0:1788361515.918146:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (0->1048575) req@ffff9a8992065c00 x1875232130782464/t30064771149(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.918157:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992065c00 with x1875232130782464 ext(0->1048575) 00002000:00010000:2.0:1788361515.918163:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992065c00 00000100:00100000:2.0:1788361515.918258:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130782592 00000100:00100000:2.0:1788361515.918265:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130782592 00002000:00100000:2.0:1788361515.918297:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (1048576->2097151) req@ffff9a89859ca300 x1875232130782592/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.918305:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859ca300 with x1875232130782592 ext(1048576->2097151) 00002000:00010000:2.0:1788361515.918308:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859ca300 00000100:00100000:2.0:1788361515.918331:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 180 00000100:00100000:2.0:1788361515.918339:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+9:2352:x1875232130782592:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361515.934418:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+11:2352:x1875232130782592:12345-192.168.203.60@tcp:4:dd.0 Request processed in 16067us (16326us total) trans 30064771150 rc 0/0 00000100:00100000:2.0:1788361515.934433:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 180 00002000:00100000:2.0:1788361515.934446:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (1048576->2097151) req@ffff9a89859ca300 x1875232130782592/t30064771150(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.934457:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859ca300 with x1875232130782592 ext(1048576->2097151) 00002000:00010000:2.0:1788361515.934463:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859ca300 00000100:00100000:0.0:1788361515.935233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361515.935307:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130782720 00000100:00100000:2.0:1788361515.935316:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130782720 00002000:00100000:2.0:1788361515.935374:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (2097152->3145727) req@ffff9a8a870b0a80 x1875232130782720/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.935384:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b0a80 with x1875232130782720 ext(2097152->3145727) 00002000:00010000:2.0:1788361515.935388:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b0a80 00000100:00100000:2.0:1788361515.935423:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:2.0:1788361515.935432:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130782720:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361515.948595:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130782720:12345-192.168.203.60@tcp:4:dd.0 Request processed in 13153us (13352us total) trans 30064771151 rc 0/0 00000100:00100000:1.0:1788361515.948621:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 181 00002000:00100000:1.0:1788361515.948633:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (2097152->3145727) req@ffff9a8a870b0a80 x1875232130782720/t30064771151(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.948643:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b0a80 with x1875232130782720 ext(2097152->3145727) 00002000:00010000:1.0:1788361515.948649:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b0a80 00000100:00100000:0.0:1788361515.952074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361515.952183:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130782848 00000100:00100000:3.0:1788361515.952193:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130782848 00002000:00100000:3.0:1788361515.952240:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (3145728->4194303) req@ffff9a8a870b2d80 x1875232130782848/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361515.952274:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b2d80 with x1875232130782848 ext(3145728->4194303) 00002000:00010000:3.0:1788361515.952280:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b2d80 00000100:00100000:3.0:1788361515.952316:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 182 00000100:00100000:3.0:1788361515.952325:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130782848:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361515.964497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361515.965932:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130782848:12345-192.168.203.60@tcp:4:dd.0 Request processed in 13602us (13861us total) trans 30064771152 rc 0/0 00000100:00100000:1.0:1788361515.965945:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 182 00002000:00100000:1.0:1788361515.965958:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (3145728->4194303) req@ffff9a8a870b2d80 x1875232130782848/t30064771152(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.965969:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b2d80 with x1875232130782848 ext(3145728->4194303) 00002000:00010000:1.0:1788361515.965976:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b2d80 00000100:00100000:1.0:1788361515.966006:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130782976 00000100:00100000:1.0:1788361515.966013:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130782976 00002000:00100000:1.0:1788361515.966048:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (4194304->5242879) req@ffff9a89921adc00 x1875232130782976/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.966056:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921adc00 with x1875232130782976 ext(4194304->5242879) 00002000:00010000:1.0:1788361515.966060:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89921adc00 00000100:00100000:1.0:1788361515.966104:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 183 00000100:00100000:1.0:1788361515.966112:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2352:x1875232130782976:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361515.974964:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+17:2352:x1875232130782976:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8840us (10464us total) trans 30064771153 rc 0/0 00000100:00100000:3.0:1788361515.974977:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 183 00002000:00100000:3.0:1788361515.974988:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (4194304->5242879) req@ffff9a89921adc00 x1875232130782976/t30064771153(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361515.974998:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921adc00 with x1875232130782976 ext(4194304->5242879) 00002000:00010000:3.0:1788361515.975003:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89921adc00 00000100:00100000:2.0:1788361515.979487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361515.979582:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130783104 00000100:00100000:1.0:1788361515.979592:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130783104 00002000:00100000:1.0:1788361515.979635:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (5242880->6291455) req@ffff9a8992065880 x1875232130783104/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.979658:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992065880 with x1875232130783104 ext(5242880->6291455) 00002000:00010000:1.0:1788361515.979664:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992065880 00000100:00100000:1.0:1788361515.979693:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:1.0:1788361515.979702:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130783104:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361515.989277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361515.989358:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130783232 00000100:00100000:1.0:1788361515.989368:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130783232 00002000:00100000:1.0:1788361515.989405:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (6291456->7340031) req@ffff9a8a870b3480 x1875232130783232/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/0 e 0 to 0 dl 1788361526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.989416:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b3480 with x1875232130783232 ext(6291456->7340031) 00002000:00010000:1.0:1788361515.989421:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b3480 00000100:00100000:1.0:1788361515.989484:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00100000:1.0:1788361515.989493:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+20:2351:x1875232130783232:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361515.989572:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992065880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+20:2351:x1875232130783104:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9870us (10094us total) trans 30064771154 rc 0/0 00000100:00100000:2.0:1788361515.989580:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 184 00002000:00100000:2.0:1788361515.989587:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (5242880->6291455) req@ffff9a8992065880 x1875232130783104/t30064771154(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361515.989595:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992065880 with x1875232130783104 ext(5242880->6291455) 00002000:00010000:2.0:1788361515.989598:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992065880 00000100:00100000:1.0:1788361515.995644:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+21:2351:x1875232130783232:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6141us (6366us total) trans 30064771155 rc 0/0 00000100:00100000:1.0:1788361515.995656:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 185 00002000:00100000:1.0:1788361515.995668:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (6291456->7340031) req@ffff9a8a870b3480 x1875232130783232/t30064771155(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:576/0 lens 488/448 e 0 to 0 dl 1788361526 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361515.995678:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b3480 with x1875232130783232 ext(6291456->7340031) 00002000:00010000:1.0:1788361515.995685:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b3480 00000100:00100000:1.0:1788361516.011394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361516.011438:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130783360 00000100:00100000:3.0:1788361516.011447:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130783360 00002000:00100000:3.0:1788361516.011494:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xc9:0x0] (7340032->8388607) req@ffff9a89859c8700 x1875232130783360/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/0 e 0 to 0 dl 1788361527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361516.011505:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c8700 with x1875232130783360 ext(7340032->8388607) 00002000:00010000:3.0:1788361516.011510:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859c8700 00000100:00100000:2.0:1788361516.011773:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 186 00000100:00100000:2.0:1788361516.011787:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:2352:x1875232130783360:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361516.019370:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+23:2352:x1875232130783360:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7580us (7974us total) trans 30064771156 rc 0/0 00000100:00100000:2.0:1788361516.019382:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 186 00002000:00100000:2.0:1788361516.019394:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (7340032->8388607) req@ffff9a89859c8700 x1875232130783360/t30064771156(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/448 e 0 to 0 dl 1788361527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361516.019403:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c8700 with x1875232130783360 ext(7340032->8388607) 00002000:00010000:2.0:1788361516.019409:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859c8700 00000100:00100000:1.0:1788361516.032759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361516.033871:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130783488 00000100:00100000:0.0:1788361516.033883:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130783488 00002000:00100000:1.0:1788361516.034113:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (8388608->9437183) req@ffff9a89859c9c00 x1875232130783488/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/0 e 0 to 0 dl 1788361527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361516.034371:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c9c00 with x1875232130783488 ext(8388608->9437183) 00002000:00010000:1.0:1788361516.034377:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859c9c00 00000100:00100000:1.0:1788361516.034418:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 187 00000100:00100000:1.0:1788361516.034429:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+23:2349:x1875232130783488:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361516.044206:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:2349:x1875232130783488:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9770us (11446us total) trans 30064771157 rc 0/0 00000100:00100000:3.0:1788361516.044219:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 187 00002000:00100000:3.0:1788361516.044231:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (8388608->9437183) req@ffff9a89859c9c00 x1875232130783488/t30064771157(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/448 e 0 to 0 dl 1788361527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361516.044256:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c9c00 with x1875232130783488 ext(8388608->9437183) 00002000:00010000:3.0:1788361516.044262:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859c9c00 00000100:00100000:1.0:1788361516.069406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361516.069499:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130783616 00000100:00100000:2.0:1788361516.069508:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130783616 00002000:00100000:2.0:1788361516.069551:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (9437184->10485759) req@ffff9a89859cbb80 x1875232130783616/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/0 e 0 to 0 dl 1788361527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361516.069563:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859cbb80 with x1875232130783616 ext(9437184->10485759) 00002000:00010000:2.0:1788361516.069568:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859cbb80 00000100:00100000:2.0:1788361516.069629:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:2.0:1788361516.069639:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+25:2350:x1875232130783616:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361516.080530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361516.081511:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+27:2350:x1875232130783616:12345-192.168.203.60@tcp:4:dd.0 Request processed in 11870us (12111us total) trans 30064771158 rc 0/0 00000100:00100000:0.0:1788361516.081522:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 188 00002000:00100000:0.0:1788361516.081534:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (9437184->10485759) req@ffff9a89859cbb80 x1875232130783616/t30064771158(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/448 e 0 to 0 dl 1788361527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361516.081544:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859cbb80 with x1875232130783616 ext(9437184->10485759) 00002000:00010000:0.0:1788361516.081550:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859cbb80 00000100:00100000:0.0:1788361516.082078:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130783744 00000100:00100000:0.0:1788361516.082153:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130783744 00002000:00100000:0.0:1788361516.082186:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (10485760->11534335) req@ffff9a89859ca680 x1875232130783744/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/0 e 0 to 0 dl 1788361527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361516.082195:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859ca680 with x1875232130783744 ext(10485760->11534335) 00002000:00010000:0.0:1788361516.082198:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859ca680 00000100:00100000:2.0:1788361516.082597:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:2.0:1788361516.082610:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:2350:x1875232130783744:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361516.099999:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130783744:12345-192.168.203.60@tcp:4:dd.0 Request processed in 17382us (19467us total) trans 30064771159 rc 0/0 00000100:00100000:3.0:1788361516.100014:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 189 00002000:00100000:3.0:1788361516.100025:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (10485760->11534335) req@ffff9a89859ca680 x1875232130783744/t30064771159(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/448 e 0 to 0 dl 1788361527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361516.100035:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859ca680 with x1875232130783744 ext(10485760->11534335) 00002000:00010000:3.0:1788361516.100042:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859ca680 00000100:00100000:2.0:1788361516.102393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361516.102736:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130783872 00000100:00100000:3.0:1788361516.102746:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130783872 00002000:00100000:3.0:1788361516.102957:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (11534336->12582911) req@ffff9a8992064380 x1875232130783872/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/0 e 0 to 0 dl 1788361527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361516.102969:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992064380 with x1875232130783872 ext(11534336->12582911) 00002000:00010000:3.0:1788361516.102975:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992064380 00000100:00100000:3.0:1788361516.103013:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00100000:3.0:1788361516.103024:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130783872:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361516.116150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361516.116185:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130784000 00000100:00100000:0.0:1788361516.116195:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130784000 00002000:00100000:0.0:1788361516.116237:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (12582912->13631487) req@ffff9a8a870b2300 x1875232130784000/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/0 e 0 to 0 dl 1788361527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361516.116259:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b2300 with x1875232130784000 ext(12582912->13631487) 00002000:00010000:0.0:1788361516.116265:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b2300 00000100:00100000:0.0:1788361516.116302:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 191 00000100:00100000:0.0:1788361516.116311:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:2352:x1875232130784000:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361516.119354:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992064380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+33:2350:x1875232130783872:12345-192.168.203.60@tcp:4:dd.0 Request processed in 16320us (16956us total) trans 30064771160 rc 0/0 00000100:00100000:3.0:1788361516.120859:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 190 00002000:00100000:3.0:1788361516.120877:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (11534336->12582911) req@ffff9a8992064380 x1875232130783872/t30064771160(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/448 e 0 to 0 dl 1788361527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361516.120903:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992064380 with x1875232130783872 ext(11534336->12582911) 00002000:00010000:3.0:1788361516.120910:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992064380 00000100:00100000:1.0:1788361516.125871:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:2352:x1875232130784000:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9552us (9721us total) trans 30064771161 rc 0/0 00000100:00100000:1.0:1788361516.125885:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 191 00002000:00100000:1.0:1788361516.125899:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xc9:0x0] (12582912->13631487) req@ffff9a8a870b2300 x1875232130784000/t30064771161(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/448 e 0 to 0 dl 1788361527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361516.125910:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b2300 with x1875232130784000 ext(12582912->13631487) 00002000:00010000:1.0:1788361516.125917:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b2300 00000100:00100000:0.0:1788361516.130248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361516.130922:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130784128 00000100:00100000:3.0:1788361516.130933:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130784128 00002000:00100000:3.0:1788361516.130982:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (13631488->14680063) req@ffff9a8a834c8700 x1875232130784128/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/0 e 0 to 0 dl 1788361527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361516.130994:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834c8700 with x1875232130784128 ext(13631488->14680063) 00002000:00010000:3.0:1788361516.131000:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834c8700 00000100:00100000:3.0:1788361516.131037:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 192 00000100:00100000:3.0:1788361516.131045:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:2351:x1875232130784128:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361516.141932:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:2351:x1875232130784128:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10877us (11684us total) trans 30064771162 rc 0/0 00000100:00100000:3.0:1788361516.141946:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 192 00002000:00100000:3.0:1788361516.141959:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xc9:0x0] (13631488->14680063) req@ffff9a8a834c8700 x1875232130784128/t30064771162(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/448 e 0 to 0 dl 1788361527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361516.141968:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834c8700 with x1875232130784128 ext(13631488->14680063) 00002000:00010000:3.0:1788361516.141974:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834c8700 00000100:00100000:2.0:1788361516.149565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361516.149610:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.149706:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130784384 00000100:00100000:3.0:1788361516.149707:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130784512 00000100:00100000:3.0:1788361516.149717:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130784512 00000100:00100000:1.0:1788361516.149717:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130784384 00002000:00100000:3.0:1788361516.149765:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xc9:0x0] (14680064->15728639) req@ffff9a8992066680 x1875232130784512/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/0 e 0 to 0 dl 1788361527 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361516.149777:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992066680 with x1875232130784512 ext(14680064->15728639) 00000100:00100000:1.0:1788361516.149782:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00002000:00010000:3.0:1788361516.149783:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992066680 00000100:00100000:1.0:1788361516.149794:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:35777:x1875232130784384:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:3.0:1788361516.149828:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:3.0:1788361516.149838:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+35:2350:x1875232130784512:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361516.150148:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+30:35777:x1875232130784384:12345-192.168.203.60@tcp:35:dd.0 Request processed in 354us (589us total) trans 30064771352 rc 0/0 00000100:00100000:1.0:1788361516.150156:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1788361516.162258:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+37:2350:x1875232130784512:12345-192.168.203.60@tcp:4:dd.0 Request processed in 12411us (12636us total) trans 30064771163 rc 0/0 00000100:00100000:3.0:1788361516.162271:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 193 00002000:00100000:3.0:1788361516.162284:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xc9:0x0] (14680064->15728639) req@ffff9a8992066680 x1875232130784512/t30064771163(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:577/0 lens 488/448 e 0 to 0 dl 1788361527 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361516.162295:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992066680 with x1875232130784512 ext(14680064->15728639) 00002000:00010000:3.0:1788361516.162301:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992066680 00000100:00100000:2.0:1788361516.169711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.169914:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130784640 00000100:00100000:1.0:1788361516.169925:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130784640 00000100:00100000:1.0:1788361516.169986:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 321 00000100:00100000:1.0:1788361516.169996:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:35778:x1875232130784640:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:1.0:1788361516.170034:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361516.170055:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ca0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f817 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.170111:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.170138:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.170152:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.170249:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ca0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f817 expref: 32 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.170272:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f817 expref: 31 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.170281:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361516.170284:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361516.170287:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622c00, rc 0) 00000100:00100000:1.0:1788361516.170338:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992065500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:35778:x1875232130784640:12345-192.168.203.60@tcp:101:chown.0 Request processed in 343us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361516.170345:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 321 00000100:00100000:2.0:1788361516.174375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361516.174502:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130784896 00000100:00100000:0.0:1788361516.174512:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130784896 00000100:00100000:0.0:1788361516.174568:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 322 00000100:00100000:0.0:1788361516.174578:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+31:35778:x1875232130784896:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:0.0:1788361516.174631:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361516.174662:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f200/0xf6a94c97d6615c61 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7fb expref: 31 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.174681:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361516.174686:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361516.174711:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.174724:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.174734:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361516.176366:0:37551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].10, 88 off9000 00000004:00080000:0.0:1788361516.176380:0:37551:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 906191293783ns, next at 907191291567ns, rc = 0 00000004:00010000:0.0:1788361516.176469:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000038233f6b reply state 0000000078d65912 transno 30064771353 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361516.176480:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361516.176587:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+32:35778:x1875232130784896:12345-192.168.203.60@tcp:36:chown.0 Request processed in 2005us (2215us total) trans 30064771353 rc 0/0 00000100:00100000:0.0:1788361516.176596:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 322 00010000:00010000:0.0:1788361516.179475:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.179491:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.179498:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.179505:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361516.179509:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.179517:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.179532:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361516.179536:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788361516.179540:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.179546:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615cae lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361516.181334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.181612:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130785024 00000100:00100000:1.0:1788361516.181623:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130785024 00000100:00100000:1.0:1788361516.181675:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 323 00000100:00100000:1.0:1788361516.181685:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+31:35778:x1875232130785024:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:1.0:1788361516.181718:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361516.181736:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615cb5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f81e expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.181815:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615cb5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f81e expref: 32 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.181830:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615cb5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f81e expref: 32 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.181861:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361516.181865:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361516.181868:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622600, rc 0) 00000100:00100000:1.0:1788361516.181935:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992064a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+32:35778:x1875232130785024:12345-192.168.203.60@tcp:101:chown.0 Request processed in 251us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361516.181942:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 323 00000100:00100000:2.0:1788361516.184859:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.185138:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130785152 00000100:00100000:1.0:1788361516.185147:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130785152 00000100:00100000:1.0:1788361516.185203:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:1.0:1788361516.185213:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:2350:x1875232130785152:12345-192.168.203.60@tcp:2:chown.0 00002000:00010000:1.0:1788361516.185385:0:35983:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:1.0:1788361516.185389:0:35983:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb mtime from disk: 0 -> 1788361516 00002000:00010000:1.0:1788361516.185391:0:35983:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361516.185393:0:35983:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb ctime from disk: 0 -> 1788361516 00002000:00010000:1.0:1788361516.185396:0:35983:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc8:0x0] updating lvb blocks from disk: 1 -> 6151 00000100:00100000:1.0:1788361516.185454:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992067b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+35:2350:x1875232130785152:12345-192.168.203.60@tcp:2:chown.0 Request processed in 242us (614us total) trans 30064771195 rc 0/0 00000100:00100000:1.0:1788361516.185476:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:2.0:1788361516.192838:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144231552:0@lo:400:kworker.0 00000100:00100000:2.0:1788361516.192919:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361516.192990:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788361516.192997:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144231168:0@lo:400:kworker.0 00000100:00100000:2.0:1788361516.193027:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361516.193058:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144231680:0@lo:400:kworker.0 00000100:00100000:2.0:1788361516.193082:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361516.193245:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144231296:0@lo:400:kworker.0 00000100:00100000:0.0:1788361516.193298:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361516.193837:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144231808:0@lo:400:kworker.0 00000100:00100000:0.0:1788361516.193887:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144231296 00000100:00100000:0.0:1788361516.193894:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144231296 00000100:00100000:0.0:1788361516.193952:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788361516.193961:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144231296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361516.194008:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144231296:12345-0@lo:400:kworker.0 Request processed in 48us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361516.194013:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1788361516.194030:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361516.194248:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144231168 00000100:00100000:2.0:1788361516.194260:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144231168 00000100:00100000:2.0:1788361516.194285:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788361516.194290:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144231168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361516.194322:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144231168:12345-0@lo:400:kworker.0 Request processed in 32us (1295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361516.194327:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788361516.194366:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144231168:0@lo:400:kworker.0 00000100:00100000:0.0:1788361516.194441:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144231424:0@lo:400:kworker.0 00000100:00100000:0.0:1788361516.194537:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361516.194569:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144231936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361516.194593:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361516.194627:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144231936 00000100:00100000:0.0:1788361516.194630:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144231936 00000100:00100000:0.0:1788361516.194663:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788361516.194670:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144231936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361516.194685:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 5111808 granted 224854016 pending 20447232 free 3772776448 avail 3767533568 00000100:00100000:0.0:1788361516.194717:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144231936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361516.194723:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788361516.194739:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361516.194761:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144231936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361516.194793:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361516.194930:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144231424 00000100:00100000:2.0:1788361516.194934:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144231424 00000100:00100000:2.0:1788361516.194960:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361516.194967:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144231424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361516.195004:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144231424:12345-0@lo:400:kworker.0 Request processed in 38us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361516.195011:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788361516.196152:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144231552 00000100:00100000:2.0:1788361516.196159:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144231552 00000100:00100000:2.0:1788361516.196190:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144231680 00000100:00100000:2.0:1788361516.196193:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144231680 00000100:00100000:2.0:1788361516.196211:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144231808 00000100:00100000:2.0:1788361516.196213:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144231808 00000100:00100000:2.0:1788361516.196226:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788361516.196232:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144231552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361516.196287:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771138 gen 2 00000004:00080000:0.0:1788361516.196292:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771138 committed transno 30064771138 00000100:00100000:0.0:1788361516.196313:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144231296:0@lo:400:kworker.0 00000100:00080000:0.0:1788361516.196336:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361516.196380:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788361516.196389:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144231680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361516.196593:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788361516.196603:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144231808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361516.196665:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144231808:12345-0@lo:400:kworker.0 Request processed in 64us (1871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361516.196672:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361516.196692:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144231424:0@lo:400:kworker.0 00000100:00100000:1.0:1788361516.196721:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144231808:0@lo:400:kworker.0 00000100:00100000:2.0:1788361516.196787:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992066a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144231552:12345-0@lo:400:kworker.0 Request processed in 554us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361516.196794:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788361516.196827:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144231552:0@lo:400:kworker.0 00000100:00100000:1.0:1788361516.196975:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144231680:12345-0@lo:400:kworker.0 Request processed in 588us (3892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361516.196980:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788361516.197017:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144231680:0@lo:400:kworker.0 00000100:00100000:2.0:1788361516.204493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.204865:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130785280 00000100:00100000:1.0:1788361516.204875:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130785280 00000100:00100000:1.0:1788361516.204964:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 324 00000100:00100000:1.0:1788361516.204974:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+32:35779:x1875232130785280:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:1.0:1788361516.205001:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361516.205022:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615cbc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f825 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.205057:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615cc3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.205071:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615cc3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.205082:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615cc3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.205241:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615cbc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f825 expref: 34 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.205260:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622e00/0xf6a94c97d6615cc3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f825 expref: 33 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.205269:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff9a8a90b43000) 00010000:00010000:1.0:1788361516.205272:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361516.205275:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622e00, rc 0) 00000100:00100000:1.0:1788361516.205342:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+33:35779:x1875232130785280:12345-192.168.203.60@tcp:101:chown.0 Request processed in 368us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361516.205349:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 324 00000100:00100000:2.0:1788361516.208365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361516.208453:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130785536 00000100:00100000:3.0:1788361516.208462:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130785536 00000100:00100000:3.0:1788361516.208510:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 325 00000100:00100000:3.0:1788361516.208518:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+33:35779:x1875232130785536:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:3.0:1788361516.208563:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361516.208584:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615c8b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f809 expref: 33 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.208600:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff9a8a90b43000) 00010000:00010000:3.0:1788361516.208604:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361516.208627:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.208638:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.208661:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361516.209106:0:37551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].12, 88 off9080 00000004:00080000:3.0:1788361516.209118:0:37551:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 906224031068ns, next at 907224028444ns, rc = 0 00000004:00010000:3.0:1788361516.209198:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a52ed553 reply state 00000000ec52c463 transno 30064771354 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361516.209208:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361516.209291:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992067100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+34:35779:x1875232130785536:12345-192.168.203.60@tcp:36:chown.0 Request processed in 773us (932us total) trans 30064771354 rc 0/0 00000100:00100000:3.0:1788361516.209299:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 325 00010000:00010000:1.0:1788361516.210878:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.210892:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.210898:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.210905:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361516.210909:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.210917:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.210930:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff9a8a90b43000) 00010000:00010000:1.0:1788361516.210944:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788361516.210949:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.210956:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615cca lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361516.211708:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.211754:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130785664 00000100:00100000:1.0:1788361516.211762:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130785664 00000100:00100000:1.0:1788361516.211814:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 326 00000100:00100000:1.0:1788361516.211823:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+33:35779:x1875232130785664:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:1.0:1788361516.211843:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361516.211870:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615cd1 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f82c expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.211922:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615cd1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f82c expref: 34 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.211936:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622800/0xf6a94c97d6615cd1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f82c expref: 34 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.211953:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff9a8a90b43000) 00010000:00010000:1.0:1788361516.211956:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361516.211958:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622800, rc 0) 00000100:00100000:1.0:1788361516.212012:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+34:35779:x1875232130785664:12345-192.168.203.60@tcp:101:chown.0 Request processed in 190us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361516.212019:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 326 00000100:00100000:3.0:1788361516.213712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361516.213814:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130785792 00000100:00100000:0.0:1788361516.213820:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130785792 00000100:00100000:0.0:1788361516.213869:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:0.0:1788361516.213877:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:2352:x1875232130785792:12345-192.168.203.60@tcp:2:chown.0 00002000:00010000:0.0:1788361516.214042:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:0.0:1788361516.214045:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb mtime from disk: 0 -> 1788361516 00002000:00010000:0.0:1788361516.214048:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788361516.214050:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb ctime from disk: 0 -> 1788361516 00002000:00010000:0.0:1788361516.214052:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788361516.214146:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:2352:x1875232130785792:12345-192.168.203.60@tcp:2:chown.0 Request processed in 269us (437us total) trans 30064771164 rc 0/0 00000100:00100000:0.0:1788361516.214152:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:3.0:1788361516.249014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.249136:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130785920 00000100:00100000:1.0:1788361516.249146:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130785920 00000100:00100000:1.0:1788361516.249379:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 327 00000100:00100000:1.0:1788361516.249390:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:35785:x1875232130785920:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:1.0:1788361516.249409:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361516.249428:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615cd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f833 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.249488:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615cdf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.249501:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615cdf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.249511:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615cdf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361516.249562:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 512 00000004:00200000:1.0:1788361516.249565:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361516.249584:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615cdf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.249606:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615cd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f833 expref: 36 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.249621:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615cdf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f833 expref: 35 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.249629:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:1.0:1788361516.249632:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361516.249635:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622400, rc 0) 00000100:00100000:1.0:1788361516.249693:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+35:35785:x1875232130785920:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 306us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361516.249707:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 327 00000100:00100000:2.0:1788361516.251584:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361516.251763:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130786048 00000100:00100000:3.0:1788361516.251772:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130786048 00000100:00100000:3.0:1788361516.251863:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 328 00000100:00100000:3.0:1788361516.251873:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:35785:x1875232130786048:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361516.251891:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361516.251909:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ce6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f83a expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.251968:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615ced lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.251981:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615ced lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252008:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615ced lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252024:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615cf4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252032:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615cf4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252038:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615cf4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252175:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252184:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252192:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361516.252218:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00000004:00200000:3.0:1788361516.252221:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361516.252240:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252251:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252259:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615ced lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252288:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615ced lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252294:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615ced lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252301:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcac00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361516.252304:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615ced lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252312:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615ced lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252325:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:3.0:1788361516.252328:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361516.252332:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615ced lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252338:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6615ced lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252353:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615cf4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252359:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615cf4 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252956:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615cf4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252963:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361516.252974:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615cf4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252980:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615cf4 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.252990:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff9a8a890fa300) 00010000:00010000:3.0:1788361516.252993:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361516.252996:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615cf4 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.253001:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d6615cf4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.253037:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6615ce6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f83a expref: 37 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.253050:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f83a expref: 36 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.253058:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361516.253060:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361516.253062:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80031800, rc 0) 00000100:00100000:2.0:1788361516.253260:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992066300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+36:35785:x1875232130786048:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 1385us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361516.253279:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 328 00000100:00100000:2.0:1788361516.260969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.261246:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130786304 00000100:00100000:1.0:1788361516.261260:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130786304 00000100:00100000:1.0:1788361516.261367:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 329 00000100:00100000:1.0:1788361516.261377:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:35785:x1875232130786304:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:1.0:1788361516.261398:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361516.261416:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d02 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f841 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.261509:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615d09 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.261773:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615d09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.261785:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615d09 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361516.261798:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:1.0:1788361516.261931:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d02 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f841 expref: 39 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.261950:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615d09 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f841 expref: 38 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.261959:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361516.261962:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361516.261965:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623e00, rc 0) 00000100:00100000:1.0:1788361516.262039:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:35785:x1875232130786304:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 663us (1079us total) trans 30064771355 rc 0/0 00000100:00100000:1.0:1788361516.262047:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 329 00000100:00100000:0.0:1788361516.263907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361516.263989:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130786432 00000100:00100000:3.0:1788361516.263999:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130786432 00000100:00100000:3.0:1788361516.264059:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1788361516.264069:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+38:2349:x1875232130786432:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361516.264082:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361516.264129:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615d09 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f841 expref: 38 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.264159:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361516.264163:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361516.264556:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+37:2349:x1875232130786432:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 488us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361516.264565:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:0.0:1788361516.264682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.264805:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130786688 00000100:00100000:1.0:1788361516.264810:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130786688 00000100:00100000:1.0:1788361516.264856:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 330 00000100:00100000:1.0:1788361516.264865:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+37:35785:x1875232130786688:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:1.0:1788361516.264886:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361516.264901:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d17 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f848 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.264994:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d1e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.265009:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d1e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.265020:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d1e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361516.265032:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:1.0:1788361516.265209:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d17 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f848 expref: 40 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.265226:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d1e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f848 expref: 39 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.265234:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361516.265237:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788361516.265247:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623800, rc 0) 00000100:00100000:1.0:1788361516.265286:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:35785:x1875232130786688:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 423us (605us total) trans 30064771356 rc 0/0 00000100:00100000:1.0:1788361516.265293:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 330 00000100:00100000:0.0:1788361516.373734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361516.375817:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130786816 00000100:00100000:2.0:1788361516.375834:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130786816 00000100:00100000:2.0:1788361516.375913:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:2.0:1788361516.375924:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+35:2351:x1875232130786816:12345-192.168.203.60@tcp:1:lfs.500 00010000:00010000:2.0:1788361516.375966:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.375986:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6615c6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f802 expref: 35 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.375994:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc8:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788361516.375997:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361516.376002:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 4/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.376041:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6615c6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f802 expref: 35 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.376054:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6615c6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f802 expref: 35 pid: 36286 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361516.376082:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8992067800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36286:1875232144232064:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361516.376441:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361516.378454:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8992067800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:36286:1875232144232064:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361516.378481:0:36286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361516.395613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361516.395742:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130786944 00000100:00100000:2.0:1788361516.395751:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130786944 00010000:00010000:2.0:1788361516.395791:0:38408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6615c6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f802 expref: 36 pid: 36286 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361516.395835:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:2.0:1788361516.395856:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+36:2350:x1875232130786944:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361516.395872:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361516.395894:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6615c6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f802 expref: 36 pid: 36286 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.395908:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6615c6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f802 expref: 36 pid: 36286 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.395931:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c62114b7/0xf6a94c97d6615c6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f802 expref: 36 pid: 36286 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.395947:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361516.395951:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361516.395957:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.395986:0:38408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.396011:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361516.396068:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+35:2350:x1875232130786944:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 223us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361516.396076:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00010000:00010000:3.0:1788361516.396386:0:36286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.396398:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.396433:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.396442:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.396450:0:36286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.396470:0:36286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361516.396474:0:36286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.396555:0:36286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.396569:0:36286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.396577:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc25a85/0xf6a94c97d6615d2c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361516.396641:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+34:2351:x1875232130786816:12345-192.168.203.60@tcp:1:lfs.500 Request processed in 20719us (22917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361516.396650:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:2.0:1788361516.399844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.401338:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130787200 00000100:00100000:1.0:1788361516.401351:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130787200 00000100:00100000:1.0:1788361516.401478:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:1.0:1788361516.401489:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+39:35785:x1875232130787200:12345-192.168.203.60@tcp:35:lfs.500 00000004:00010000:1.0:1788361516.401623:0:35348:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x20:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d1e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f848 expref: 39 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361516.401930:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771357 00000001:00080000:1.0:1788361516.401982:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771358 00000001:00080000:1.0:1788361516.402948:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771359 00010000:00010000:1.0:1788361516.403010:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.403025:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f817 expref: 43 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.403033:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f83a expref: 43 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.403040:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615cb5 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f81e expref: 43 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.403047:0:35348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 6/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.403224:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615cb5 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f81e expref: 43 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.403240:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615cb5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f81e expref: 43 pid: 35345 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361516.403253:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859c8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144232192:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361516.403400:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f83a expref: 43 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.403409:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f83a expref: 43 pid: 35346 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361516.403418:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859caa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144232320:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361516.403447:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f817 expref: 43 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.403455:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f817 expref: 43 pid: 37122 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361516.403463:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144232448:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361516.403496:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190180 going to sleep for 11 seconds 00000100:00100000:0.0:1788361516.405938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361516.406685:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130787328 00000100:00100000:3.0:1788361516.406694:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130787328 00010000:00010000:3.0:1788361516.406730:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615cb5 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f81e expref: 44 pid: 35345 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361516.406763:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:3.0:1788361516.406773:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130787328:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361516.406787:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361516.406817:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615cb5 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f81e expref: 44 pid: 35345 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.406831:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615cb5 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f81e expref: 44 pid: 35345 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.406861:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361516.406867:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.406876:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.406882:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361516.406940:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130787328:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 168us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361516.406947:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00010000:00010000:1.0:1788361516.407902:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615cb5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f81e expref: 43 pid: 35345 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361516.407935:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859c8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144232192:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361516.408077:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.408187:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859caa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144232320:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361516.408196:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144232448:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361516.408219:0:35348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361516.408317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361516.408598:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130787456 00000100:00100000:3.0:1788361516.408603:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130787456 00010000:00010000:3.0:1788361516.408625:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f83a expref: 43 pid: 35346 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361516.408656:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130787584 00000100:00100000:3.0:1788361516.408659:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130787584 00010000:00010000:3.0:1788361516.408674:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f817 expref: 44 pid: 37122 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361516.408700:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:3.0:1788361516.408709:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130787456:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361516.408731:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361516.408737:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f83a expref: 44 pid: 35346 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.408748:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f83a expref: 44 pid: 35346 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.408765:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615cfb lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f83a expref: 44 pid: 35346 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361516.408878:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1788361516.408890:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8984bb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+44:2350:x1875232130787584:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361516.408911:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361516.408916:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f817 expref: 44 pid: 37122 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.408927:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f817 expref: 44 pid: 37122 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.408939:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615ca7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f817 expref: 44 pid: 37122 timeout: 1006 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.408951:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:2.0:1788361516.408955:0:38408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.408963:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.408978:0:38408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.409002:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361516.409036:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8984bb5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+43:2350:x1875232130787584:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 150us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361516.409043:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00010000:00010000:0.0:1788361516.409289:0:35348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.409308:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361516.409439:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771360 00000001:00080000:0.0:1788361516.409895:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771361 00000100:00100000:0.0:1788361516.410002:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89923c3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144232576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788361516.410120:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361516.410142:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361516.410155:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144232576 00000100:00100000:2.0:1788361516.410160:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144232576 00000100:00100000:2.0:1788361516.410202:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788361516.410210:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144232576:12345-0@lo:1000:mdt_rdpg00_000.0 00010000:00010000:3.0:1788361516.410219:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361516.410222:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361516.410256:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130787456:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1546us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361516.410264:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:2.0:1788361516.410281:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144232576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361516.410287:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788361516.410824:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89923c3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144232576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788361516.411463:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771362 00000100:00100000:0.0:1788361516.412761:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89923c3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144232704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788361516.412868:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361516.412957:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1788361516.413056:0:37379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144232704 00000100:00100000:1.0:1788361516.413063:0:37379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144232704 00000100:00100000:1.0:1788361516.413126:0:37379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788361516.413135:0:37379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144232704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788361516.413307:0:37379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:35348:x1875232144232704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 173us (439us total) trans 30064771196 rc 0/0 00000100:00100000:1.0:1788361516.413314:0:37379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788361516.413324:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89923c3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144232704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788361516.413390:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771363 00010000:00010000:0.0:1788361516.413428:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.413438:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.413445:0:35348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.413452:0:35348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361516.413456:0:35348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.415206:0:35348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.415236:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361516.415239:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788361516.415245:0:35348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.415252:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615d33 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361516.415728:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x22:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788361516.415801:0:35348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].11, 64 off9064 00000001:00080000:0.0:1788361516.415810:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771364 00010000:00010000:0.0:1788361516.415867:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361516.415870:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788361516.415878:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d1e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f848 expref: 45 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361516.415998:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+44:35785:x1875232130787200:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 14509us (16160us total) trans 30064771365 rc 0/0 00000100:00100000:0.0:1788361516.416008:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000020:00080000:0.0:1788361516.416013:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788361516.423266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361516.423357:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130787712 00000100:00100000:2.0:1788361516.423428:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130787712 00000100:00100000:3.0:1788361516.423518:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 331 00000100:00100000:3.0:1788361516.423531:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+44:35785:x1875232130787712:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361516.423555:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361516.423576:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615d3a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f84f expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.423632:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615d3a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f84f expref: 45 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.423647:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615d3a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f84f expref: 45 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.423687:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:3.0:1788361516.423690:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361516.423693:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80031800, rc 0) 00000100:00100000:3.0:1788361516.423748:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+45:35785:x1875232130787712:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 221us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361516.423755:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 331 00000100:00100000:2.0:1788361516.426780:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.426944:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130787968 00000100:00100000:1.0:1788361516.426955:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130787968 00000100:00100000:1.0:1788361516.427052:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:1.0:1788361516.427061:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88353c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+45:35785:x1875232130787968:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:1.0:1788361516.427328:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88353c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+46:35785:x1875232130787968:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 267us (554us total) trans 30064771366 rc 0/0 00000100:00100000:1.0:1788361516.427335:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000040:00080000:2.0:1788361516.448411:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361516.448422:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361516.448933:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 9 00000040:00080000:2.0:1788361516.448942:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361516.449044:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361516.473569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.473675:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130788096 00000100:00100000:1.0:1788361516.473684:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130788096 00000100:00100000:1.0:1788361516.473733:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 332 00000100:00100000:1.0:1788361516.473861:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+46:35792:x1875232130788096:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:1.0:1788361516.473886:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361516.473904:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615d41 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f856 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.473967:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d48 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.473990:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d48 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474001:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d48 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474013:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615d4f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474018:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615d4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474022:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615d4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474165:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d56 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474174:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d56 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474181:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d56 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361516.474219:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00000004:00200000:1.0:1788361516.474223:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361516.474238:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d56 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474247:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d56 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474252:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d48 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474256:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d48 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474260:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d48 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474264:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361516.474266:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d48 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474271:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d48 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474281:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:1.0:1788361516.474284:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361516.474288:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d48 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474293:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d48 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474485:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615d4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474492:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615d4f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474498:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615d4f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474503:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361516.474506:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615d4f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474512:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615d4f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474520:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xa92decdb (ffff9a8984a32700) 00010000:00010000:1.0:1788361516.474522:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361516.474525:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615d4f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474539:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615d4f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474574:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615d41 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f856 expref: 48 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474585:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623800/0xf6a94c97d6615d56 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f856 expref: 47 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.474603:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff9a8a90b43000) 00010000:00010000:1.0:1788361516.474605:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361516.474608:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623800, rc 0) 00000100:00100000:1.0:1788361516.474663:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+47:35792:x1875232130788096:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 815us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361516.474670:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 332 00000100:00100000:3.0:1788361516.478916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.479030:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130788352 00000100:00100000:1.0:1788361516.479040:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130788352 00000100:00100000:2.0:1788361516.479199:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 333 00000100:00100000:2.0:1788361516.479212:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:35792:x1875232130788352:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:2.0:1788361516.479234:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361516.479456:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615d5d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f85d expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.479574:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615d64 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.479588:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615d64 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.479600:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615d64 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361516.479611:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00010000:00010000:2.0:1788361516.479739:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6615d5d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f85d expref: 50 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.479826:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615d64 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f85d expref: 49 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.479836:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff9a8a90b43000) 00010000:00010000:2.0:1788361516.479839:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361516.479842:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8600, rc 0) 00000100:00100000:2.0:1788361516.479910:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+49:35792:x1875232130788352:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 703us (1004us total) trans 30064771367 rc 0/0 00000100:00100000:2.0:1788361516.479918:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 333 00000100:00100000:2.0:1788361516.485923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361516.485957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361516.486314:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130788736 00000100:00100000:0.0:1788361516.486324:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130788736 00000100:00100000:0.0:1788361516.486381:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1788361516.486389:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+49:2351:x1875232130788736:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361516.486421:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361516.486444:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6615d64 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f85d expref: 49 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.486462:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff9a8a90b43000) 00010000:00010000:0.0:1788361516.486467:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361516.486524:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992067800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+48:2351:x1875232130788736:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 134us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361516.486531:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1788361516.486539:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130788608 00000100:00100000:3.0:1788361516.486546:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130788608 00000100:00100000:3.0:1788361516.486590:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 334 00000100:00100000:3.0:1788361516.486599:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+48:35792:x1875232130788608:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361516.486620:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361516.486636:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615d72 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f864 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.486721:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615d79 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.486926:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615d79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.486940:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615d79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361516.486954:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x21:0x0]: returning size 15728640 00010000:00010000:3.0:1788361516.487072:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615d72 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x21:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f864 expref: 51 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.487347:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615d79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f864 expref: 50 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.487355:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff9a8a90b43000) 00010000:00010000:3.0:1788361516.487358:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788361516.487360:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80031c00, rc 0) 00000100:00100000:3.0:1788361516.487399:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+50:35792:x1875232130788608:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 801us (1484us total) trans 30064771368 rc 0/0 00000100:00100000:3.0:1788361516.487407:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 334 00000100:00100000:2.0:1788361516.525386:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361516.525484:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130788864 00000100:00100000:0.0:1788361516.525493:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130788864 00000100:00100000:0.0:1788361516.525717:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361516.525725:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+50:35792:x1875232130788864:12345-192.168.203.60@tcp:103:lfs.500 00010000:00010000:0.0:1788361516.525737:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361516.525758:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615d79 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x21:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f864 expref: 50 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.525779:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x21:0x0].0x0 (ffff9a8a90b43000) 00010000:00010000:0.0:1788361516.525782:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361516.525888:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+49:35792:x1875232130788864:12345-192.168.203.60@tcp:103:lfs.500 Request processed in 163us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361516.525895:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1788361516.527414:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361516.527493:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130789120 00000100:00100000:2.0:1788361516.527502:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130789120 00000100:00100000:2.0:1788361516.528068:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:2.0:1788361516.528076:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+49:35792:x1875232130789120:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:2.0:1788361516.528584:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+50:35792:x1875232130789120:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 506us (1173us total) trans 30064771369 rc 0/0 00000100:00100000:2.0:1788361516.528592:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:1.0:1788361516.550765:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361516.550992:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130789376 00000100:00100000:2.0:1788361516.551003:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130789376 00000100:00100000:2.0:1788361516.551169:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1788361516.551181:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+50:35792:x1875232130789376:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:2.0:1788361516.551529:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+51:35792:x1875232130789376:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 349us (780us total) trans 30064771370 rc 0/0 00000100:00100000:2.0:1788361516.551538:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:0.0:1788361516.604634:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.604742:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130789632 00000100:00100000:1.0:1788361516.604753:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130789632 00000100:00100000:1.0:1788361516.604874:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 335 00000100:00100000:1.0:1788361516.604885:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+51:35802:x1875232130789632:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361516.604920:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361516.604940:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f86b expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361516.605053:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 512 00010000:00010000:1.0:1788361516.605202:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f86b expref: 53 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.605217:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:1.0:1788361516.605220:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361516.605225:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615d87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f86b expref: 53 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.605258:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623000, rc 0) 00000100:00100000:1.0:1788361516.605332:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+52:35802:x1875232130789632:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 448us (707us total) trans 30064771371 rc 301/301 00000100:00100000:1.0:1788361516.605340:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 335 00000100:00100000:3.0:1788361516.607682:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361516.607808:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130789760 00000100:00100000:2.0:1788361516.607817:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130789760 00000100:00100000:2.0:1788361516.607878:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 336 00000100:00100000:2.0:1788361516.607888:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+52:35802:x1875232130789760:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361516.608053:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615d95 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608070:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615d95 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608081:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615d95 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608213:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615d9c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608239:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615d9c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608247:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615d9c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608334:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608343:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608350:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361516.608494:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608507:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615d95 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608514:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615d95 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608521:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615d95 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608527:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361516.608531:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615d95 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608538:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615d95 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608558:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:2.0:1788361516.608561:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361516.608566:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615d95 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608572:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615d95 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608584:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615d9c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608590:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615d9c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608595:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615d9c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608600:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361516.608603:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615d9c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608609:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615d9c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608616:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361516.608618:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361516.608621:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615d9c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608627:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6615d9c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608652:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608658:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608664:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608669:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361516.608672:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608679:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608686:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:2.0:1788361516.608689:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361516.608692:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.608698:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615da3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361516.608841:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+52:35802:x1875232130789760:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 953us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361516.608859:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 336 00000100:00100000:2.0:1788361516.611975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361516.612062:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130790016 00000100:00100000:0.0:1788361516.612071:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130790016 00000100:00100000:0.0:1788361516.612297:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:0.0:1788361516.612316:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+52:35802:x1875232130790016:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361516.612585:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+53:35802:x1875232130790016:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 269us (682us total) trans 30064771372 rc 0/0 00000100:00100000:0.0:1788361516.612593:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:0.0:1788361516.675044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361516.675277:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130790272 00000100:00100000:3.0:1788361516.675287:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130790272 00000100:00100000:3.0:1788361516.675374:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 337 00000100:00100000:3.0:1788361516.675384:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+53:35812:x1875232130790272:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361516.675416:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361516.675434:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615daa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f872 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.675549:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030800/0xf6a94c97d6615db1 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.675673:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030800/0xf6a94c97d6615db1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.675745:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030800/0xf6a94c97d6615db1 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361516.675777:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x1f:0x0]: returning size 512 00010000:00010000:3.0:1788361516.675910:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615daa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f872 expref: 56 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.675931:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030800/0xf6a94c97d6615db1 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f872 expref: 55 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.675939:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:3.0:1788361516.675942:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788361516.675946:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80030800, rc 0) 00000100:00100000:3.0:1788361516.676061:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:35812:x1875232130790272:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 677us (1024us total) trans 30064771373 rc 0/0 00000100:00100000:3.0:1788361516.676068:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 337 00000100:00100000:0.0:1788361516.704452:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144232832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361516.704749:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361516.705597:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144232832 00000100:00100000:3.0:1788361516.705606:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144232832 00000100:00100000:3.0:1788361516.705665:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788361516.705675:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144232832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361516.705700:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 178847744 pending 25559040 free 3819962368 avail 3817865216 00000100:00100000:3.0:1788361516.705810:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144232832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361516.705818:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788361516.705968:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144232832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361516.723020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.723134:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130790528 00000100:00100000:1.0:1788361516.723144:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130790528 00000100:00100000:1.0:1788361516.723205:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 338 00000100:00100000:1.0:1788361516.723215:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:35818:x1875232130790528:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:1.0:1788361516.723237:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361516.723254:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615dbf lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f879 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723332:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615dc6 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723348:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615dc6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723359:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615dc6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723372:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615dcd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723379:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615dcd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723386:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615dcd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723521:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615dd4 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723531:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615dd4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723538:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615dd4 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361516.723547:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 15728640 00010000:00010000:1.0:1788361516.723636:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615dc6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723644:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615dc6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723651:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615dc6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723657:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361516.723661:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615dc6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723669:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615dc6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723680:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:1.0:1788361516.723683:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361516.723688:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615dc6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723705:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615dc6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723719:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615dcd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723726:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615dcd lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723733:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615dcd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723739:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361516.723742:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615dcd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723747:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615dcd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723754:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff9a8984a32700) 00010000:00010000:1.0:1788361516.723756:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361516.723758:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615dcd lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723763:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615dcd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723807:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615dbf lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f879 expref: 58 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723835:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615dd4 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f879 expref: 57 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.723854:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:1.0:1788361516.723857:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361516.723859:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623e00, rc 0) 00000100:00100000:1.0:1788361516.723923:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+57:35818:x1875232130790528:12345-192.168.203.60@tcp:101:dd.500 Request processed in 709us (911us total) trans 30064771374 rc 0/0 00000100:00100000:1.0:1788361516.723930:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 338 00000100:00100000:2.0:1788361516.727536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361516.727641:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130790784 00000100:00100000:0.0:1788361516.727653:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130790784 00000100:00100000:0.0:1788361516.727708:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 339 00000100:00100000:0.0:1788361516.727718:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+57:35818:x1875232130790784:12345-192.168.203.60@tcp:36:dd.500 00010000:00010000:0.0:1788361516.727775:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361516.727802:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615dd4 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f879 expref: 57 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.727835:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:0.0:1788361516.727840:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361516.728055:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.728069:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361516.728079:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361516.728204:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771375 00000004:00010000:0.0:1788361516.728236:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ebaa1194 reply state 00000000aa977ed7 transno 30064771376 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361516.728246:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361516.728391:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+59:35818:x1875232130790784:12345-192.168.203.60@tcp:36:dd.500 Request processed in 674us (863us total) trans 30064771376 rc 0/0 00000100:00100000:0.0:1788361516.728399:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 339 00000020:00080000:0.0:1788361516.728404:0:35346:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788361516.731062:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.731076:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.731081:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.731135:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361516.731140:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.731149:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.731233:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:2.0:1788361516.731237:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361516.731243:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.731248:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615de2 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361516.899634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361516.899791:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130791040 00000100:00100000:1.0:1788361516.899801:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130791040 00000100:00100000:1.0:1788361516.899878:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1788361516.899888:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+58:35818:x1875232130791040:12345-192.168.203.60@tcp:103:dd.500 00010000:00010000:1.0:1788361516.899904:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361516.899929:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615d3a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f84f expref: 58 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361516.899961:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:1.0:1788361516.899973:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361516.900038:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+57:35818:x1875232130791040:12345-192.168.203.60@tcp:103:dd.500 Request processed in 152us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361516.900045:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:0.0:1788361516.902866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361516.902968:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130791168 00000100:00100000:3.0:1788361516.902977:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130791168 00000100:00100000:3.0:1788361516.903069:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 340 00000100:00100000:3.0:1788361516.903079:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+57:35818:x1875232130791168:12345-192.168.203.60@tcp:58:dd.500 00010000:00010000:3.0:1788361516.903248:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.903275:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361516.903286:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361516.903705:0:37551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].9, 136 off9416 00000100:00100000:3.0:1788361516.903792:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+57:35818:x1875232130791168:12345-192.168.203.60@tcp:58:dd.500 Request processed in 714us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361516.903800:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 340 00000100:00100000:3.0:1788361516.906438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361516.906714:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130791296 00000100:00100000:2.0:1788361516.906724:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130791296 00000100:00100000:2.0:1788361516.906797:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 341 00000100:00100000:2.0:1788361516.906807:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+57:35818:x1875232130791296:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:2.0:1788361516.906827:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361516.906870:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615df0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f880 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.906922:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.906933:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615df0 lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f880 expref: 58 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.906950:0:35347:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.906964:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615df0 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f880 expref: 58 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.906977:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:2.0:1788361516.906980:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361516.906984:0:35347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615df0 lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f880 expref: 58 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361516.906992:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8000, rc 0) 00000100:00100000:2.0:1788361516.907058:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+58:35818:x1875232130791296:12345-192.168.203.60@tcp:101:dd.500 Request processed in 253us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361516.907066:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 341 00010000:00010000:3.0:1788361517.473043:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361517.473211:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361517.473218:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361517.473255:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 10 00000040:00080000:0.0:1788361517.473262:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361517.473371:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89923c0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144232960:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361517.473469:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788361517.476546:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89923c0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144232960:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788361517.477640:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.477775:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130791424 00000100:00100000:2.0:1788361517.477784:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130791424 00000100:00100000:2.0:1788361517.477863:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 342 00000100:00100000:2.0:1788361517.477875:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+58:35819:x1875232130791424:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788361517.477923:0:35346:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788361517.478016:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+58:35819:x1875232130791424:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 144us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361517.478024:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 342 00000100:00080000:0.0:1788361517.478109:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361517.480343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.480429:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130791552 00000100:00100000:2.0:1788361517.480437:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130791552 00000100:00100000:2.0:1788361517.480493:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 343 00000100:00100000:2.0:1788361517.480502:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+58:35819:x1875232130791552:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788361517.480564:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615df7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480580:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615df7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480591:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615df7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480606:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615dfe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480614:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615dfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480620:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615dfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480640:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480647:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480668:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361517.480704:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 0 00000004:00200000:2.0:1788361517.480708:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361517.480720:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480731:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615df7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480736:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615df7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480742:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615df7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480747:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361517.480751:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615df7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480758:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615df7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480769:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361517.480772:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361517.480777:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615df7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480783:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615df7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480806:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615dfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480812:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615dfe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480818:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615dfe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480823:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361517.480825:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615dfe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480831:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615dfe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480869:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xcbfe478c (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361517.480872:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361517.480875:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615dfe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480881:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615dfe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xcbfe478c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480895:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480900:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480906:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480917:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361517.480921:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480927:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480935:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:2.0:1788361517.480938:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361517.480940:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.480946:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e05 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361517.481262:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+58:35819:x1875232130791552:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 760us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361517.481271:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 343 00000100:00100000:3.0:1788361517.485053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.485241:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130791808 00000100:00100000:1.0:1788361517.485252:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130791808 00000100:00100000:1.0:1788361517.485322:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 344 00000100:00100000:1.0:1788361517.485352:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+58:35819:x1875232130791808:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361517.485383:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361517.485403:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f887 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.485866:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e13 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.485883:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e13 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.485895:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e13 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361517.485907:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x20:0x0]: returning size 0 00010000:00010000:1.0:1788361517.486003:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e13 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.486011:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e13 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.486017:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e13 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.486022:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361517.486026:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e13 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.486033:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e13 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.486045:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:1.0:1788361517.486055:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361517.486061:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e13 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.486066:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e13 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.486414:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e0c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f887 expref: 60 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.486427:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:1.0:1788361517.486429:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361517.486433:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f887 expref: 60 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.486443:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623000, rc 0) 00000100:00100000:1.0:1788361517.486666:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+59:35819:x1875232130791808:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1316us (1620us total) trans 30064771377 rc 301/301 00000100:00100000:1.0:1788361517.486674:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 344 00000100:00100000:0.0:1788361517.490567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.490637:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130791936 00000100:00100000:1.0:1788361517.490647:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130791936 00000100:00100000:1.0:1788361517.490708:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 345 00000100:00100000:1.0:1788361517.490719:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+59:35819:x1875232130791936:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788361517.490827:0:35345:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x20:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788361517.490944:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+59:35819:x1875232130791936:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 226us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361517.490952:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 345 00000100:00100000:3.0:1788361517.495520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.495673:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130792192 00000100:00100000:2.0:1788361517.495684:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130792192 00000100:00100000:2.0:1788361517.495747:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 346 00000100:00100000:2.0:1788361517.495758:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+59:35819:x1875232130792192:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361517.495779:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361517.495783:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361517.495810:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615cdf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f833 expref: 59 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.495831:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:2.0:1788361517.495857:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361517.495874:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e21 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f88e expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361517.497657:0:37551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xc9:0x0], index 1: 0 00010000:00010000:2.0:1788361517.497870:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615e28 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.497885:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615e28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.497898:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615e28 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.497959:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e21 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f88e expref: 61 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.497977:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615e28 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f88e expref: 60 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.497985:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361517.497988:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361517.497991:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:2.0:1788361517.498053:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+60:35819:x1875232130792192:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2298us (2542us total) trans 30064771378 rc 0/0 00000100:00100000:2.0:1788361517.498061:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 346 00000100:00100000:3.0:1788361517.500711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.500800:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130792448 00000100:00100000:1.0:1788361517.500823:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130792448 00000100:00100000:1.0:1788361517.500886:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 347 00000100:00100000:1.0:1788361517.500896:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a881fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+60:35819:x1875232130792448:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788361517.500951:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361517.500976:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6615e28 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f88e expref: 60 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.500995:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:1.0:1788361517.501005:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361517.501024:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e36 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501037:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e36 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501047:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e36 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501061:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e3d lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xe22f9b4d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501068:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e3d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xe22f9b4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501074:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e3d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xe22f9b4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501171:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e36 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501178:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e36 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501191:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e36 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501197:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361517.501200:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e36 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501208:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e36 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501216:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:1.0:1788361517.501219:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361517.501222:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e36 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501228:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e36 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501480:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e3d lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xe22f9b4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501487:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e3d lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xe22f9b4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501493:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e3d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xe22f9b4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501498:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361517.501501:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e3d lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xe22f9b4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501519:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e3d lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x1f:0x0].0xe22f9b4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501529:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0xe22f9b4d (ffff9a8984a32700) 00010000:00010000:1.0:1788361517.501531:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361517.501534:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e3d lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xe22f9b4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.501540:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e3d lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x1f:0x0].0xe22f9b4d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361517.501671:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a881fa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+59:35819:x1875232130792448:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 775us (966us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788361517.501678:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 347 00000100:00100000:0.0:1788361517.506655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.506721:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130792576 00000100:00100000:2.0:1788361517.506730:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130792576 00000100:00100000:2.0:1788361517.506795:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 348 00000100:00100000:2.0:1788361517.506805:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+59:35819:x1875232130792576:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361517.506849:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361517.506872:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615e44 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f895 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.506907:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.506920:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.506931:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.507019:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615e44 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f895 expref: 61 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.507037:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f895 expref: 60 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.507045:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788361517.507047:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361517.507051:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:2.0:1788361517.507139:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+60:35819:x1875232130792576:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 336us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361517.507147:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 348 00000100:00100000:3.0:1788361517.509961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.510015:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130792832 00000100:00100000:2.0:1788361517.510026:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130792832 00000100:00100000:2.0:1788361517.510202:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 349 00000100:00100000:2.0:1788361517.510215:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+60:35819:x1875232130792832:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361517.510319:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.510336:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.510348:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361517.510694:0:37551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].12, 88 off9152 00000004:00080000:2.0:1788361517.510704:0:37551:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 907525618090ns, next at 908525615701ns, rc = 0 00000004:00010000:2.0:1788361517.510793:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001a536275 reply state 000000005e9b5964 transno 30064771379 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361517.510802:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361517.510965:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+62:35819:x1875232130792832:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 752us (1011us total) trans 30064771379 rc 0/0 00000100:00100000:2.0:1788361517.510974:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 349 00010000:00010000:1.0:1788361517.515818:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.515835:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.515852:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.515859:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361517.515864:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.515873:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.515910:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788361517.515913:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788361517.515918:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.515924:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e52 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361517.518369:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.518768:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130792960 00000100:00100000:1.0:1788361517.518778:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130792960 00000100:00100000:1.0:1788361517.518836:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 350 00000100:00100000:1.0:1788361517.518855:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+61:35819:x1875232130792960:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361517.518878:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361517.518897:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e59 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f89c expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.518953:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e59 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f89c expref: 62 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.518966:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e59 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f89c expref: 62 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.518983:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788361517.518986:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361517.518989:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622c00, rc 0) 00000100:00100000:1.0:1788361517.519443:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+62:35819:x1875232130792960:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 588us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361517.519464:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 350 00000100:00100000:2.0:1788361517.522629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.523038:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130793088 00000100:00100000:1.0:1788361517.523048:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130793088 00000100:00100000:1.0:1788361517.523278:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:1.0:1788361517.523287:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+34:2349:x1875232130793088:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788361517.523564:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:2349:x1875232130793088:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 277us (942us total) trans 30064771197 rc 0/0 00000100:00100000:1.0:1788361517.523572:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00080000:0.0:1788361517.525100:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361517.526597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.526693:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130793344 00000100:00100000:2.0:1788361517.526703:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130793344 00000100:00100000:2.0:1788361517.526897:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:2.0:1788361517.526909:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+62:35819:x1875232130793344:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788361517.527165:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+63:35819:x1875232130793344:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 257us (575us total) trans 30064771380 rc 0/0 00000100:00100000:2.0:1788361517.527173:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1788361517.530178:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.530331:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130793600 00000100:00100000:0.0:1788361517.530341:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130793600 00000100:00100000:0.0:1788361517.530446:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 351 00000100:00100000:0.0:1788361517.530457:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+63:35819:x1875232130793600:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788361517.530566:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+63:35819:x1875232130793600:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 110us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361517.530593:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 351 00000100:00100000:3.0:1788361517.540312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.540433:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130793728 00000100:00100000:2.0:1788361517.540444:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130793728 00000100:00100000:2.0:1788361517.540569:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 352 00000100:00100000:2.0:1788361517.540579:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+63:35819:x1875232130793728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361517.540598:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361517.540617:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615e60 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8a3 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.540679:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e67 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.540692:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.540703:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361517.540734:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361517.540750:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e67 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.540774:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6615e60 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8a3 expref: 65 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.540791:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e67 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8a3 expref: 64 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.540799:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788361517.540802:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788361517.540806:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8400, rc 0) 00000100:00100000:2.0:1788361517.540881:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+64:35819:x1875232130793728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 304us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361517.540898:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 352 00000100:00100000:2.0:1788361517.547363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.547542:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130793856 00000100:00100000:1.0:1788361517.547551:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130793856 00000100:00100000:1.0:1788361517.547652:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:1.0:1788361517.547663:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+35:2350:x1875232130793856:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361517.547681:0:35983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361517.547703:0:35983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615e6e lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8aa expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361517.547728:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983b2e, blocks: 0x1 00010000:00010000:1.0:1788361517.547747:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=907s v=(0 0) 00010000:00010000:1.0:1788361517.547752:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361517.547761:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615e6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8aa expref: 36 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.547783:0:35983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615e6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8aa expref: 36 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.547817:0:35983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623000, rc 0) 00000100:00100000:1.0:1788361517.548067:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+36:2350:x1875232130793856:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 404us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361517.548075:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:3.0:1788361517.552171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.552260:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130794112 00000100:00100000:2.0:1788361517.552269:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130794112 00000100:00100000:2.0:1788361517.552323:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 353 00000100:00100000:2.0:1788361517.552332:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+64:35819:x1875232130794112:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788361517.552422:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+64:35819:x1875232130794112:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361517.552429:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 353 00000100:00100000:2.0:1788361517.557189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.557270:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130794240 00000100:00100000:1.0:1788361517.557279:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130794240 00000100:00100000:1.0:1788361517.557374:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788361517.557383:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+36:35819:x1875232130794240:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361517.557400:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361517.557415:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8b1 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.557444:0:35982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615e6e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8aa expref: 37 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.557453:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361517.557457:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361517.557462:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 37 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.557502:0:35982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615e6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8aa expref: 37 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361517.557514:0:35982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615e6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8aa expref: 37 pid: 35983 timeout: 1007 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361517.557542:0:35982:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:35982:1875232144233088:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361517.557639:0:35982:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83190480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361517.571684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.571769:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130794368 00000100:00100000:1.0:1788361517.571801:0:35982:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:35982:1875232144233088:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361517.571831:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 37 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361517.571856:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130794368 00010000:00010000:1.0:1788361517.571867:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623600, rc 0) 00010000:00010000:2.0:1788361517.571896:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615e6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8aa expref: 38 pid: 35983 timeout: 1007 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361517.571929:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+38:35819:x1875232130794240:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 14545us (14746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361517.571943:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:2.0:1788361517.571986:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:2.0:1788361517.571995:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+37:2350:x1875232130794368:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361517.572009:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361517.572032:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615e6e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8aa expref: 37 pid: 35983 timeout: 1007 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.572044:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615e6e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8aa expref: 37 pid: 35983 timeout: 1007 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.572066:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615e6e lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8aa expref: 37 pid: 35983 timeout: 1007 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.572129:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361517.572133:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361517.572141:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 36 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.572151:0:35332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 36 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.572182:0:35332:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 36 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361517.572196:0:35332:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35332:1875232144233216:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361517.572246:0:35332:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361517.580601:0:35332:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921c0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:35332:1875232144233216:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361517.580627:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361517.580692:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+36:2350:x1875232130794368:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 8697us (9024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361517.580703:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1788361517.598809:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.598896:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130794496 00000100:00100000:1.0:1788361517.598905:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130794496 00002000:00100000:1.0:1788361517.598951:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (0->1048575) req@ffff9a89921ae680 x1875232130794496/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.598958:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ae680 with x1875232130794496 ext(0->1048575) 00002000:00010000:1.0:1788361517.598963:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ae680 00000100:00100000:1.0:1788361517.598992:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 194 00000100:00100000:1.0:1788361517.599001:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:2349:x1875232130794496:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361517.612764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361517.613078:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130794624 00000100:00100000:3.0:1788361517.613209:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130794624 00002000:00100000:2.0:1788361517.613328:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (1048576->2097151) req@ffff9a89921c0380 x1875232130794624/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361517.613340:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c0380 with x1875232130794624 ext(1048576->2097151) 00002000:00010000:2.0:1788361517.613347:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c0380 00000100:00100000:3.0:1788361517.613428:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:3.0:1788361517.613441:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+38:2350:x1875232130794624:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361517.623697:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+40:2349:x1875232130794496:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 24687us (24887us total) trans 30064771198 rc 0/0 00000100:00100000:1.0:1788361517.623710:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 194 00002000:00100000:1.0:1788361517.623721:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc9:0x0] (0->1048575) req@ffff9a89921ae680 x1875232130794496/t30064771198(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.623739:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ae680 with x1875232130794496 ext(0->1048575) 00002000:00010000:1.0:1788361517.623744:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ae680 00000100:00100000:3.0:1788361517.625618:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+40:2350:x1875232130794624:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 12172us (12855us total) trans 30064771199 rc 0/0 00000100:00100000:3.0:1788361517.625631:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 195 00002000:00100000:3.0:1788361517.625640:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (1048576->2097151) req@ffff9a89921c0380 x1875232130794624/t30064771199(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361517.625650:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c0380 with x1875232130794624 ext(1048576->2097151) 00002000:00010000:3.0:1788361517.625655:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c0380 00000100:00100000:0.0:1788361517.632966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361517.633255:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130794752 00000100:00100000:3.0:1788361517.633264:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130794752 00002000:00100000:3.0:1788361517.633303:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (2097152->3145727) req@ffff9a89923c0000 x1875232130794752/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361517.633315:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c0000 with x1875232130794752 ext(2097152->3145727) 00002000:00010000:3.0:1788361517.633321:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c0000 00000100:00100000:3.0:1788361517.633345:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 196 00000100:00100000:3.0:1788361517.633354:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+40:2349:x1875232130794752:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361517.643743:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+42:2349:x1875232130794752:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 10379us (10775us total) trans 30064771200 rc 0/0 00000100:00100000:0.0:1788361517.643756:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 196 00002000:00100000:0.0:1788361517.643769:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (2097152->3145727) req@ffff9a89923c0000 x1875232130794752/t30064771200(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.643791:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c0000 with x1875232130794752 ext(2097152->3145727) 00002000:00010000:0.0:1788361517.643798:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c0000 00000100:00100000:0.0:1788361517.647412:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.647503:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130794880 00000100:00100000:2.0:1788361517.647514:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130794880 00002000:00100000:2.0:1788361517.647568:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (3145728->4194303) req@ffff9a89923c1180 x1875232130794880/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361517.647580:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c1180 with x1875232130794880 ext(3145728->4194303) 00002000:00010000:2.0:1788361517.647586:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c1180 00000100:00100000:2.0:1788361517.647619:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:2.0:1788361517.647629:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+42:2350:x1875232130794880:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361517.654936:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+44:2350:x1875232130794880:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7298us (7521us total) trans 30064771201 rc 0/0 00000100:00100000:0.0:1788361517.654950:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 197 00002000:00100000:0.0:1788361517.654962:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (3145728->4194303) req@ffff9a89923c1180 x1875232130794880/t30064771201(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.654972:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c1180 with x1875232130794880 ext(3145728->4194303) 00002000:00010000:0.0:1788361517.654979:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c1180 00000100:00100000:3.0:1788361517.659963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.660161:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130795008 00000100:00100000:2.0:1788361517.660171:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130795008 00002000:00100000:2.0:1788361517.660218:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (4194304->5242879) req@ffff9a89921aed80 x1875232130795008/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361517.660229:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921aed80 with x1875232130795008 ext(4194304->5242879) 00002000:00010000:2.0:1788361517.660234:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921aed80 00000100:00100000:2.0:1788361517.660267:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 198 00000100:00100000:2.0:1788361517.660276:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130795008:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361517.666605:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+46:2349:x1875232130795008:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6320us (6640us total) trans 30064771202 rc 0/0 00000100:00100000:3.0:1788361517.666617:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 198 00002000:00100000:3.0:1788361517.666629:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (4194304->5242879) req@ffff9a89921aed80 x1875232130795008/t30064771202(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361517.666640:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921aed80 with x1875232130795008 ext(4194304->5242879) 00002000:00010000:3.0:1788361517.666646:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921aed80 00000100:00100000:2.0:1788361517.669055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.670781:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130795136 00000100:00100000:0.0:1788361517.670794:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130795136 00002000:00100000:0.0:1788361517.670856:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (5242880->6291455) req@ffff9a89921c0e00 x1875232130795136/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.670863:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c0e00 with x1875232130795136 ext(5242880->6291455) 00002000:00010000:0.0:1788361517.670879:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c0e00 00000100:00100000:0.0:1788361517.671071:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:0.0:1788361517.671078:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+46:2351:x1875232130795136:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361517.677243:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+48:2351:x1875232130795136:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 6155us (8186us total) trans 30064771203 rc 0/0 00000100:00100000:0.0:1788361517.677257:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 199 00002000:00100000:0.0:1788361517.677269:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (5242880->6291455) req@ffff9a89921c0e00 x1875232130795136/t30064771203(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.677278:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c0e00 with x1875232130795136 ext(5242880->6291455) 00002000:00010000:0.0:1788361517.677284:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c0e00 00000100:00100000:2.0:1788361517.681883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.681989:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130795264 00000100:00100000:0.0:1788361517.681999:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130795264 00002000:00100000:0.0:1788361517.682048:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (6291456->7340031) req@ffff9a89921c2680 x1875232130795264/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.682058:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c2680 with x1875232130795264 ext(6291456->7340031) 00002000:00010000:0.0:1788361517.682064:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c2680 00000100:00100000:0.0:1788361517.682131:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:0.0:1788361517.682141:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+48:2352:x1875232130795264:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361517.691599:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+50:2352:x1875232130795264:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 9450us (9717us total) trans 30064771204 rc 0/0 00000100:00100000:0.0:1788361517.691611:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 200 00002000:00100000:0.0:1788361517.691623:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (6291456->7340031) req@ffff9a89921c2680 x1875232130795264/t30064771204(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.691649:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c2680 with x1875232130795264 ext(6291456->7340031) 00002000:00010000:0.0:1788361517.691655:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c2680 00000100:00100000:3.0:1788361517.702615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.702689:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130795392 00000100:00100000:2.0:1788361517.702700:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130795392 00002000:00100000:2.0:1788361517.702751:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (7340032->8388607) req@ffff9a89921ace00 x1875232130795392/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361517.702761:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ace00 with x1875232130795392 ext(7340032->8388607) 00002000:00010000:2.0:1788361517.702767:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ace00 00000100:00100000:2.0:1788361517.702879:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:2.0:1788361517.702890:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+50:2351:x1875232130795392:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361517.710138:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+52:2351:x1875232130795392:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7239us (7521us total) trans 30064771205 rc 0/0 00000100:00100000:0.0:1788361517.710152:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 201 00002000:00100000:0.0:1788361517.710164:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (7340032->8388607) req@ffff9a89921ace00 x1875232130795392/t30064771205(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.710176:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ace00 with x1875232130795392 ext(7340032->8388607) 00002000:00010000:0.0:1788361517.710183:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ace00 00000100:00100000:3.0:1788361517.719753:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.719918:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130795520 00000100:00100000:0.0:1788361517.719927:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130795520 00002000:00100000:0.0:1788361517.719972:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (8388608->9437183) req@ffff9a89921ac380 x1875232130795520/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.719983:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ac380 with x1875232130795520 ext(8388608->9437183) 00002000:00010000:0.0:1788361517.719989:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ac380 00000100:00100000:0.0:1788361517.720069:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 202 00000100:00100000:0.0:1788361517.720078:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+52:2352:x1875232130795520:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361517.729248:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+54:2352:x1875232130795520:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 9161us (9495us total) trans 30064771206 rc 0/0 00000100:00100000:0.0:1788361517.729262:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 202 00002000:00100000:0.0:1788361517.729275:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (8388608->9437183) req@ffff9a89921ac380 x1875232130795520/t30064771206(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.729302:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ac380 with x1875232130795520 ext(8388608->9437183) 00002000:00010000:0.0:1788361517.729308:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ac380 00000100:00100000:2.0:1788361517.732522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.732827:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130795648 00000100:00100000:0.0:1788361517.732847:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130795648 00002000:00100000:0.0:1788361517.732895:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (9437184->10485759) req@ffff9a89921c1500 x1875232130795648/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.732907:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c1500 with x1875232130795648 ext(9437184->10485759) 00002000:00010000:0.0:1788361517.732912:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c1500 00000100:00100000:0.0:1788361517.732992:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:0.0:1788361517.733003:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:2351:x1875232130795648:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361517.740965:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+56:2351:x1875232130795648:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7953us (8440us total) trans 30064771207 rc 0/0 00000100:00100000:0.0:1788361517.740977:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 203 00002000:00100000:0.0:1788361517.740989:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (9437184->10485759) req@ffff9a89921c1500 x1875232130795648/t30064771207(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.740999:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c1500 with x1875232130795648 ext(9437184->10485759) 00002000:00010000:0.0:1788361517.741006:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c1500 00000100:00100000:3.0:1788361517.748415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.748908:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130795776 00000100:00100000:0.0:1788361517.748919:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130795776 00002000:00100000:0.0:1788361517.748966:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (10485760->11534335) req@ffff9a89921ad880 x1875232130795776/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.748978:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ad880 with x1875232130795776 ext(10485760->11534335) 00002000:00010000:0.0:1788361517.748983:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ad880 00000100:00100000:0.0:1788361517.749029:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:0.0:1788361517.749039:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+56:2352:x1875232130795776:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361517.760004:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+58:2352:x1875232130795776:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 10957us (11589us total) trans 30064771208 rc 0/0 00000100:00100000:0.0:1788361517.760017:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 204 00002000:00100000:0.0:1788361517.760030:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (10485760->11534335) req@ffff9a89921ad880 x1875232130795776/t30064771208(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.760040:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921ad880 with x1875232130795776 ext(10485760->11534335) 00002000:00010000:0.0:1788361517.760047:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921ad880 00000100:00100000:3.0:1788361517.764646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.765069:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130795904 00000100:00100000:0.0:1788361517.765081:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130795904 00002000:00100000:0.0:1788361517.765284:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (11534336->12582911) req@ffff9a89853df100 x1875232130795904/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.765296:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853df100 with x1875232130795904 ext(11534336->12582911) 00002000:00010000:0.0:1788361517.765302:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89853df100 00000100:00100000:0.0:1788361517.765530:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:0.0:1788361517.765540:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+58:2350:x1875232130795904:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788361517.775165:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+60:2350:x1875232130795904:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 9615us (10517us total) trans 30064771209 rc 0/0 00000100:00100000:0.0:1788361517.775178:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 205 00002000:00100000:0.0:1788361517.775191:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (11534336->12582911) req@ffff9a89853df100 x1875232130795904/t30064771209(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.775201:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853df100 with x1875232130795904 ext(11534336->12582911) 00002000:00010000:0.0:1788361517.775220:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89853df100 00000100:00100000:2.0:1788361517.781385:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.781467:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130796032 00000100:00100000:0.0:1788361517.781486:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130796032 00002000:00100000:0.0:1788361517.781532:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (12582912->13631487) req@ffff9a89921c2d80 x1875232130796032/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.781550:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c2d80 with x1875232130796032 ext(12582912->13631487) 00002000:00010000:0.0:1788361517.781557:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c2d80 00000100:00100000:0.0:1788361517.781588:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 206 00000100:00100000:0.0:1788361517.781597:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+60:2349:x1875232130796032:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361517.789943:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+62:2349:x1875232130796032:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8131us (8352us total) trans 30064771210 rc 0/0 00000100:00100000:1.0:1788361517.789958:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 206 00002000:00100000:1.0:1788361517.789971:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (12582912->13631487) req@ffff9a89921c2d80 x1875232130796032/t30064771210(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.789980:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c2d80 with x1875232130796032 ext(12582912->13631487) 00002000:00010000:1.0:1788361517.789986:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c2d80 00000100:00100000:2.0:1788361517.794190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.794292:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130796160 00000100:00100000:0.0:1788361517.794300:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130796160 00002000:00100000:0.0:1788361517.794339:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (13631488->14680063) req@ffff9a89921c0a80 x1875232130796160/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361517.794357:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c0a80 with x1875232130796160 ext(13631488->14680063) 00002000:00010000:0.0:1788361517.794363:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c0a80 00000100:00100000:0.0:1788361517.794399:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:0.0:1788361517.794408:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+62:2350:x1875232130796160:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361517.804018:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+64:2350:x1875232130796160:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 9602us (9828us total) trans 30064771211 rc 0/0 00000100:00100000:1.0:1788361517.804032:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 207 00002000:00100000:1.0:1788361517.804044:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (13631488->14680063) req@ffff9a89921c0a80 x1875232130796160/t30064771211(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.804059:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c0a80 with x1875232130796160 ext(13631488->14680063) 00002000:00010000:1.0:1788361517.804065:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c0a80 00000100:00100000:0.0:1788361517.810685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.810782:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130796288 00000100:00100000:2.0:1788361517.810793:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130796288 00002000:00100000:2.0:1788361517.810853:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (14680064->15728639) req@ffff9a89923c1c00 x1875232130796288/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361517.810864:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c1c00 with x1875232130796288 ext(14680064->15728639) 00002000:00010000:2.0:1788361517.810870:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c1c00 00000100:00100000:2.0:1788361517.810949:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:2.0:1788361517.810959:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+64:2349:x1875232130796288:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788361517.816473:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+66:2349:x1875232130796288:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 5504us (5786us total) trans 30064771212 rc 0/0 00000100:00100000:2.0:1788361517.816487:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 208 00002000:00100000:2.0:1788361517.816500:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (14680064->15728639) req@ffff9a89923c1c00 x1875232130796288/t30064771212(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361517.816511:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c1c00 with x1875232130796288 ext(14680064->15728639) 00002000:00010000:2.0:1788361517.816517:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c1c00 00000100:00100000:3.0:1788361517.820993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.821112:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130796416 00000100:00100000:1.0:1788361517.821162:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130796416 00002000:00100000:1.0:1788361517.821208:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (15728640->16777215) req@ffff9a89853ddf80 x1875232130796416/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.821220:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853ddf80 with x1875232130796416 ext(15728640->16777215) 00002000:00010000:1.0:1788361517.821226:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89853ddf80 00000100:00100000:1.0:1788361517.821350:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:1.0:1788361517.821371:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+66:2350:x1875232130796416:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361517.835530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.835873:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130796544 00000100:00100000:1.0:1788361517.835882:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130796544 00002000:00100000:1.0:1788361517.835925:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (16777216->17825791) req@ffff9a89853dc380 x1875232130796544/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.835936:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dc380 with x1875232130796544 ext(16777216->17825791) 00002000:00010000:1.0:1788361517.835941:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89853dc380 00000100:00100000:1.0:1788361517.835970:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 210 00000100:00100000:1.0:1788361517.835979:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+68:2349:x1875232130796544:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361517.838278:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+70:2350:x1875232130796416:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 16900us (17286us total) trans 30064771213 rc 0/0 00000100:00100000:1.0:1788361517.838290:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 209 00002000:00100000:1.0:1788361517.838300:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xc9:0x0] (15728640->16777215) req@ffff9a89853ddf80 x1875232130796416/t30064771213(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.838309:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853ddf80 with x1875232130796416 ext(15728640->16777215) 00002000:00010000:1.0:1788361517.838314:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89853ddf80 00000100:00100000:1.0:1788361517.843629:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+70:2349:x1875232130796544:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 7642us (8100us total) trans 30064771214 rc 0/0 00000100:00100000:1.0:1788361517.843641:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 210 00002000:00100000:1.0:1788361517.843653:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (16777216->17825791) req@ffff9a89853dc380 x1875232130796544/t30064771214(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.843663:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dc380 with x1875232130796544 ext(16777216->17825791) 00002000:00010000:1.0:1788361517.843669:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89853dc380 00000100:00100000:3.0:1788361517.846073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361517.846232:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130796672 00000100:00100000:2.0:1788361517.846242:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130796672 00002000:00100000:2.0:1788361517.846287:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (17825792->18874367) req@ffff9a89853dd180 x1875232130796672/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361517.846319:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dd180 with x1875232130796672 ext(17825792->18874367) 00002000:00010000:2.0:1788361517.846325:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89853dd180 00000100:00100000:2.0:1788361517.846363:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:2.0:1788361517.846372:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+70:2351:x1875232130796672:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361517.857279:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+72:2351:x1875232130796672:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 10899us (11204us total) trans 30064771215 rc 0/0 00000100:00100000:1.0:1788361517.857293:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 211 00002000:00100000:1.0:1788361517.857305:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (17825792->18874367) req@ffff9a89853dd180 x1875232130796672/t30064771215(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.857316:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89853dd180 with x1875232130796672 ext(17825792->18874367) 00002000:00010000:1.0:1788361517.857322:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89853dd180 00000100:00100000:0.0:1788361517.859608:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361517.859705:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130796800 00000100:00100000:3.0:1788361517.859713:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130796800 00002000:00100000:3.0:1788361517.859908:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (18874368->19922943) req@ffff9a89923c0380 x1875232130796800/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361517.859918:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c0380 with x1875232130796800 ext(18874368->19922943) 00002000:00010000:3.0:1788361517.859923:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c0380 00000100:00100000:3.0:1788361517.859950:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 212 00000100:00100000:3.0:1788361517.859958:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+72:2352:x1875232130796800:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361517.865519:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+74:2352:x1875232130796800:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 5549us (5907us total) trans 30064771216 rc 0/0 00000100:00100000:1.0:1788361517.865532:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 212 00002000:00100000:1.0:1788361517.865545:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (18874368->19922943) req@ffff9a89923c0380 x1875232130796800/t30064771216(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.865556:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c0380 with x1875232130796800 ext(18874368->19922943) 00002000:00010000:1.0:1788361517.865562:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c0380 00000100:00100000:3.0:1788361517.876492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361517.876618:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130796928 00000100:00100000:1.0:1788361517.876627:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130796928 00002000:00100000:1.0:1788361517.876673:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (19922944->20971519) req@ffff9a8a8ae71180 x1875232130796928/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/0 e 0 to 0 dl 1788361528 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.876685:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae71180 with x1875232130796928 ext(19922944->20971519) 00002000:00010000:1.0:1788361517.876691:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae71180 00000100:00100000:1.0:1788361517.876829:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:1.0:1788361517.876853:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+74:2350:x1875232130796928:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788361517.885125:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+76:2350:x1875232130796928:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 8278us (8632us total) trans 30064771217 rc 0/0 00000100:00100000:1.0:1788361517.885152:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 213 00002000:00100000:1.0:1788361517.885164:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (19922944->20971519) req@ffff9a8a8ae71180 x1875232130796928/t30064771217(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:578/0 lens 488/448 e 0 to 0 dl 1788361528 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361517.885174:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8ae71180 with x1875232130796928 ext(19922944->20971519) 00002000:00010000:1.0:1788361517.885180:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8ae71180 00000100:00100000:2.0:1788361517.889013:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.889440:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130797056 00000100:00100000:0.0:1788361517.889450:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130797056 00000100:00100000:0.0:1788361517.889507:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 354 00000100:00100000:0.0:1788361517.889516:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+64:35819:x1875232130797056:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788361517.926597:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771376 is committed 00000020:00080000:3.0:1788361517.926621:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a843bdc00 refcount 2 committed 0 result 0 batchid 25769803903 00000020:00080000:3.0:1788361517.926627:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a898afe8200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a843bda80 00000020:00080000:3.0:1788361517.926630:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a898afe8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8986b12000 00000004:00080000:3.0:1788361517.926653:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1788361517.926672:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803902 batchid updated 00000001:00080000:3.0:1788361517.926679:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771377 is committed 00000001:00080000:3.0:1788361517.926702:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771380 is committed 00000004:00080000:3.0:1788361517.926707:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:3.0:1788361517.926728:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000100:00100000:3.0:1788361517.926927:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144233344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788361517.926987:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361517.927054:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144233472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361517.927077:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361517.927143:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144233344 00000100:00100000:3.0:1788361517.927151:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144233344 00000020:00080000:2.0:1788361517.927242:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803903 committed batchid 25769803902 00000020:00080000:2.0:1788361517.927410:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803902 00000100:00100000:3.0:1788361517.927481:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144233472 00000100:00100000:3.0:1788361517.927485:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144233472 00000100:00100000:3.0:1788361517.927510:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788361517.927519:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144233344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788361517.927544:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788361517.927556:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144233472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788361517.927702:0:35982:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb size from disk: 15728640 -> 15728640 00000100:00100000:3.0:1788361517.927703:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144233344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 183us (714us total) trans 30064771218 rc 0/0 00002000:00010000:1.0:1788361517.927709:0:35982:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb mtime from disk: 1788361516 -> 1788361516 00002000:00010000:1.0:1788361517.927714:0:35982:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1788361517.927717:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00002000:00010000:1.0:1788361517.927719:0:35982:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb ctime from disk: 1788361516 -> 1788361516 00002000:00010000:1.0:1788361517.927723:0:35982:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:3.0:1788361517.927762:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a8ae70a80/2, rc 0, transno 30064771218 00000100:00100000:1.0:1788361517.927766:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144233472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (686us total) trans 30064771165 rc 0/0 00000100:00100000:3.0:1788361517.927777:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144233344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788361517.927777:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000004:00080000:3.0:1788361517.927803:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a8ae70380/2, rc 0, transno 30064771165 00000100:00100000:3.0:1788361517.927808:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144233472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788361517.927873:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144233600:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788361517.927883:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf16c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144233728:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788361517.927908:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361517.927934:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361517.927960:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144233600 00000100:00100000:3.0:1788361517.927964:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144233600 00000100:00100000:3.0:1788361517.927981:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144233728 00000100:00100000:3.0:1788361517.927984:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144233728 00000100:00100000:3.0:1788361517.927995:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788361517.928000:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1875232144233600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788361517.928014:0:35983:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:200 count 1 00002000:00010000:3.0:1788361517.928041:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc8:0x0] initial LVB size: 15728640, mtime: 0x6a983b2c, atime: 0x0, ctime: 0x6a983b2c, blocks: 0x1807 00010000:00010000:3.0:1788361517.928049:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884006fe/0xf6a94c97d6615e7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361517.928063:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=907s v=(0 0) 00010000:00010000:3.0:1788361517.928067:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361517.928073:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000884006fe/0xf6a94c97d6615e7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361517.928154:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000884006fe/0xf6a94c97d6615e7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361517.928246:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788361517.928255:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3311:x1875232144233728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788361517.928328:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb size from disk: 0 -> 20971520 00002000:00010000:2.0:1788361517.928332:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb mtime from disk: 0 -> 1788361518 00002000:00010000:2.0:1788361517.928334:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361517.928336:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb ctime from disk: 1788361518 -> 1788361518 00002000:00010000:2.0:1788361517.928337:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361517.928381:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3311:x1875232144233728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (448us total) trans 30064771219 rc 0/0 00000100:00100000:2.0:1788361517.928388:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000004:00080000:1.0:1788361517.928457:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8abf16c700/2, rc 0, transno 30064771219 00000100:00100000:1.0:1788361517.928462:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf16c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144233728:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788361517.928551:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000884006fe/0xf6a94c97d6615e7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361517.928561:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000884006fe/0xf6a94c97d6615e7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361517.928615:0:35983:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788361517.929240:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3314:x1875232144233600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1238us (1332us total) trans 30064771220 rc 0/0 00000100:00100000:3.0:1788361517.929248:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788361517.929395:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+30:35819:x1875232130797056:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 39878us (40389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361517.929410:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 354 00000004:00080000:1.0:1788361517.929491:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8abf16ea00/2, rc 0, transno 30064771220 00000100:00100000:1.0:1788361517.929496:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf16ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144233600:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788361517.929852:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361517.929860:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000884006fe/0xf6a94c97d6615e7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.929870:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361517.929874:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000884006fe/0xf6a94c97d6615e7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.929895:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000884006fe/0xf6a94c97d6615e7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.929912:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000884006fe/0xf6a94c97d6615e7c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.929919:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000884006fe/0xf6a94c97d6615e7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361517.929939:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361517.929941:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361517.929943:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361517.931060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361517.931146:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130797184 00000100:00100000:0.0:1788361517.931154:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130797184 00000100:00100000:0.0:1788361517.931260:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:0.0:1788361517.931269:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+76:2350:x1875232130797184:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788361517.999325:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771209 is committed 00000001:00080000:2.0:1788361517.999384:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771217 is committed 00000001:00080000:2.0:1788361517.999413:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771196 is committed 00000001:00080000:2.0:1788361517.999438:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771219 is committed 00000001:00080000:2.0:1788361517.999463:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771220 is committed 00000100:00100000:1.0:1788361517.999666:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130797184:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 68393us (68604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361517.999692:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:3.0:1788361518.021896:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361518.022134:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130797440 00000100:00100000:2.0:1788361518.022145:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130797440 00000100:00100000:2.0:1788361518.022205:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 355 00000100:00100000:2.0:1788361518.022214:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+30:35819:x1875232130797440:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361518.022263:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361518.022289:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6615e67 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8a3 expref: 30 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361518.022325:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788361518.022330:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361518.022358:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361518.022371:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361518.022381:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361518.022546:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000053e2f5bd reply state 000000007bd83dfd transno 30064771381 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361518.022556:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361518.022663:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+31:35819:x1875232130797440:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 449us (775us total) trans 30064771381 rc 0/0 00000100:00100000:2.0:1788361518.022671:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 355 00000100:00100000:3.0:1788361518.024316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.024393:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130797568 00000100:00100000:1.0:1788361518.024401:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130797568 00000100:00100000:1.0:1788361518.024447:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:1.0:1788361518.024456:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130797568:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788361518.024691:0:35982:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb size from disk: 20971520 -> 20971520 00002000:00010000:1.0:1788361518.024695:0:35982:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb mtime from disk: 1788361518 -> 1788361517 00002000:00010000:1.0:1788361518.024698:0:35982:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb atime from disk: 0 -> 1788361517 00010000:00010000:0.0:1788361518.024698:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361518.024704:0:35982:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb ctime from disk: 1788361518 -> 1788361517 00002000:00010000:1.0:1788361518.024709:0:35982:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xc9:0x0] updating lvb blocks from disk: 1 -> 40967 00010000:00010000:0.0:1788361518.024716:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.024726:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.024733:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361518.024738:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.024757:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361518.024768:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130797568:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 311us (455us total) trans 30064771221 rc 0/0 00010000:00010000:0.0:1788361518.024774:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0bd00) 00000100:00100000:1.0:1788361518.024779:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00010000:00010000:0.0:1788361518.024781:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361518.024787:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.024793:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6615e83 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361518.028205:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.028292:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130797824 00000100:00100000:1.0:1788361518.028301:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130797824 00000100:00100000:1.0:1788361518.028463:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 356 00000100:00100000:1.0:1788361518.028474:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+30:35819:x1875232130797824:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788361518.028538:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.028685:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f895 expref: 30 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.028694:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.028743:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f895 expref: 30 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.028756:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f895 expref: 30 pid: 35347 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361518.028769:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144233856:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361518.028866:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86ae3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788361518.032302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361518.032374:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130797952 00000100:00100000:0.0:1788361518.032398:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130797952 00010000:00010000:0.0:1788361518.032435:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f895 expref: 31 pid: 35347 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361518.032481:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1788361518.032491:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130797952:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361518.032505:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361518.032512:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f895 expref: 31 pid: 35347 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.032523:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f895 expref: 31 pid: 35347 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.032544:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:0.0:1788361518.032549:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.032559:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.032566:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.032584:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361518.032637:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130797952:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 147us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361518.032645:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00010000:00010000:1.0:1788361518.033238:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6615e4b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x23:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f895 expref: 30 pid: 35347 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361518.033250:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144233856:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361518.033265:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.033272:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.033275:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.033299:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.033307:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.033313:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.033328:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361518.033332:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.033339:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.033348:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788361518.033351:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788361518.033354:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.033361:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623000/0xf6a94c97d6615e8a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361518.033414:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:35819:x1875232130797824:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 4942us (5217us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788361518.033428:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 356 00000100:00100000:2.0:1788361518.036162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361518.036292:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130798080 00000100:00100000:3.0:1788361518.036301:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130798080 00000100:00100000:3.0:1788361518.036347:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:3.0:1788361518.036356:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130798080:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788361518.036405:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361518.036424:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 11 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361518.036433:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xc9:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788361518.036437:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788361518.036441:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 4/1,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361518.036474:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 11 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361518.036488:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 11 pid: 35982 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361518.036503:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf16e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144233984:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361518.036578:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361518.041628:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf16e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144233984:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361518.041659:0:35983:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 3/1,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361518.069296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361518.070634:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130798208 00000100:00100000:0.0:1788361518.070646:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130798208 00010000:00010000:0.0:1788361518.070693:0:38408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 12 pid: 35982 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361518.070793:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:0.0:1788361518.070803:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+12:2349:x1875232130798208:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361518.070817:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361518.070850:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 12 pid: 35982 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.070865:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 12 pid: 35982 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.070890:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000822cc314/0xf6a94c97d6615e75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b1 expref: 12 pid: 35982 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.070906:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361518.070911:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361518.070917:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.070927:0:38408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.070988:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361518.071048:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130798208:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 246us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361518.071065:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00010000:00010000:1.0:1788361518.071131:0:35983:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.071141:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.071165:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.071174:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.071187:0:35983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.071194:0:35983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361518.071197:0:35983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.071206:0:35983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.071218:0:35983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.071226:0:35983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce9cf7da/0xf6a94c97d6615e91 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361518.071299:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130798080:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 34944us (35144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361518.071307:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:2.0:1788361518.073421:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361518.073546:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130798464 00000100:00100000:0.0:1788361518.073554:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130798464 00000100:00100000:0.0:1788361518.073599:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 357 00000100:00100000:0.0:1788361518.073608:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:35819:x1875232130798464:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788361518.073682:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615e98 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.073699:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615e98 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.073709:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615e98 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.073916:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.073928:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e59 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f89c expref: 30 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.073936:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.073967:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e59 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f89c expref: 30 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.073997:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e59 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f89c expref: 30 pid: 37122 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361518.074011:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89923c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144234112:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361518.074755:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a865d4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361518.076802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361518.076895:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130798592 00000100:00100000:3.0:1788361518.076903:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130798592 00010000:00010000:3.0:1788361518.076939:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e59 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f89c expref: 31 pid: 37122 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361518.076981:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:3.0:1788361518.076990:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8984bb6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:2350:x1875232130798592:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361518.077019:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361518.077031:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e59 lrc: 5/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f89c expref: 31 pid: 37122 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361518.077043:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e59 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f89c expref: 31 pid: 37122 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361518.077052:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89923c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144234112:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361518.077063:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615e59 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f89c expref: 31 pid: 37122 timeout: 1008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.077074:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361518.077077:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:3.0:1788361518.077081:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361518.077278:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361518.077286:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.077314:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361518.077315:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361518.077321:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361518.077368:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8984bb6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+30:2350:x1875232130798592:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 379us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361518.077375:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000001:00080000:0.0:1788361518.077901:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771382 00000001:00080000:0.0:1788361518.078048:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771383 00000001:00080000:0.0:1788361518.078126:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771384 00000100:00100000:0.0:1788361518.078208:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89923c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144234240:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788361518.078248:0:35346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361518.078287:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a981fb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361518.078299:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144234240 00000100:00100000:2.0:1788361518.078304:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144234240 00000100:00100000:2.0:1788361518.078365:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788361518.078374:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35346:x1875232144234240:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788361518.078448:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35346:x1875232144234240:12345-0@lo:1000:mdt00_001.0 Request processed in 76us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361518.078456:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788361518.078852:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361518.078881:0:35346:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771220 gen 2 00000004:00080000:0.0:1788361518.078887:0:35346:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771196 committed transno 30064771220 00000004:00080000:0.0:1788361518.078901:0:35346:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a8ae70a80, transno 30064771218 00000004:00080000:0.0:1788361518.078919:0:35346:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8abf16c700, transno 30064771219 00000004:00080000:0.0:1788361518.078922:0:35346:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8abf16ea00, transno 30064771220 00000100:00100000:0.0:1788361518.078939:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89923c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144234240:0@lo:1000:mdt00_001.0 00000004:00080000:3.0:1788361518.079819:0:35369:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000001:00080000:0.0:1788361518.080624:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771385 00000100:00100000:0.0:1788361518.080698:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89923c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144234368:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788361518.080753:0:35346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361518.080831:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a865d4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361518.080880:0:37379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144234368 00000100:00100000:1.0:1788361518.080887:0:37379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144234368 00000100:00100000:1.0:1788361518.080974:0:37379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788361518.080983:0:37379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:35346:x1875232144234368:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788361518.081351:0:37379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:35346:x1875232144234368:12345-0@lo:1000:mdt00_001.0 Request processed in 369us (597us total) trans 30064771222 rc 0/0 00000100:00100000:1.0:1788361518.081368:0:37379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788361518.081430:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89923c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144234368:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788361518.081461:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081483:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081490:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081496:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361518.081501:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081508:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081523:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:0.0:1788361518.081526:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361518.081530:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081536:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615e9f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x23:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081564:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081577:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081583:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081588:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361518.081591:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081598:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081607:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:0.0:1788361518.081609:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361518.081616:0:35346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615df0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f880 expref: 33 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081626:0:35346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615df0 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f880 expref: 33 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081635:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615df0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f880 expref: 33 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.081659:0:35346:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8000/0xf6a94c97d6615df0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f880 expref: 33 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361518.081670:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89923c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144234496:192.168.203.60@tcp:105: 00000100:00100000:0.0:1788361518.081749:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a880ca240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361518.084977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.085149:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130798720 00000100:00100000:1.0:1788361518.085278:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130798720 00000100:00100000:0.0:1788361518.085315:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89923c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144234496:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361518.085339:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00010000:00010000:0.0:1788361518.085343:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361518.085352:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:35818:x1875232130798720:12345-192.168.203.60@tcp:49:dd.500 00010000:00010000:0.0:1788361518.085356:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615de9 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085386:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615ea6 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085400:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615ea6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085411:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615ea6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085420:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615ea6 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085426:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615ea6 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085433:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615ea6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085439:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361518.085443:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615ea6 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085450:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615ea6 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085479:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:0.0:1788361518.085482:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361518.085487:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615ea6 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085493:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615ea6 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085503:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615e98 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085509:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615e98 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085514:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615e98 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361518.085521:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:35818:x1875232130798720:12345-192.168.203.60@tcp:49:dd.500 Request processed in 170us (542us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361518.085523:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361518.085528:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615e98 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361518.085535:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00010000:00010000:0.0:1788361518.085539:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615e98 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085549:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:0.0:1788361518.085552:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361518.085556:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615e98 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361518.085562:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615e98 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x20:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361518.087468:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:35819:x1875232130798464:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 13854us (14047us total) trans 30064771386 rc 0/0 00000100:00100000:0.0:1788361518.087478:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 357 00000020:00080000:0.0:1788361518.087483:0:35346:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788361518.091262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.094404:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130798848 00000100:00100000:1.0:1788361518.094417:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130798848 00000100:00100000:1.0:1788361518.094486:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:1.0:1788361518.094496:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:35818:x1875232130798848:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:1.0:1788361518.094514:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361518.094534:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615ead lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8b8 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361518.094560:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc9:0x0] initial LVB size: 20971520, mtime: 0x6a983b2d, atime: 0x6a983b2d, ctime: 0x6a983b2d, blocks: 0xa007 00010000:00010000:1.0:1788361518.094584:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=908s v=(0 0) 00010000:00010000:1.0:1788361518.094588:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361518.094598:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615ead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b8 expref: 11 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.094614:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003db09d36/0xf6a94c97d6615ead lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 20971520->22020095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8b8 expref: 11 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.094646:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623000, rc 0) 00000100:00100000:1.0:1788361518.094709:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+11:35818:x1875232130798848:12345-192.168.203.60@tcp:101:dd.500 Request processed in 214us (3457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361518.094716:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:2.0:1788361518.113238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.113323:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130798976 00000100:00100000:1.0:1788361518.113336:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130798976 00002000:00100000:1.0:1788361518.113387:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (20971520->22020095) req@ffff9a8ab710df80 x1875232130798976/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/0 e 0 to 0 dl 1788361529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.113398:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710df80 with x1875232130798976 ext(20971520->22020095) 00002000:00010000:1.0:1788361518.113403:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710df80 00000100:00100000:1.0:1788361518.113441:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:1.0:1788361518.113451:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130798976:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:1.0:1788361518.129794:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130798976:12345-192.168.203.60@tcp:4:dd.500 Request processed in 16333us (16553us total) trans 30064771223 rc 0/0 00000100:00100000:1.0:1788361518.129808:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 214 00002000:00100000:1.0:1788361518.129822:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (20971520->22020095) req@ffff9a8ab710df80 x1875232130798976/t30064771223(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/448 e 0 to 0 dl 1788361529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.129963:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710df80 with x1875232130798976 ext(20971520->22020095) 00002000:00010000:1.0:1788361518.129971:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710df80 00000100:00100000:2.0:1788361518.132254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.132343:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130799104 00000100:00100000:1.0:1788361518.132353:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130799104 00002000:00100000:1.0:1788361518.132397:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (22020096->23068671) req@ffff9a8ab710f100 x1875232130799104/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/0 e 0 to 0 dl 1788361529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.132429:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710f100 with x1875232130799104 ext(22020096->23068671) 00002000:00010000:1.0:1788361518.132434:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710f100 00000100:00100000:1.0:1788361518.132469:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:1.0:1788361518.132478:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130799104:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:1.0:1788361518.140932:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2351:x1875232130799104:12345-192.168.203.60@tcp:4:dd.500 Request processed in 8445us (8676us total) trans 30064771224 rc 0/0 00000100:00100000:1.0:1788361518.140945:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 215 00002000:00100000:1.0:1788361518.140957:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (22020096->23068671) req@ffff9a8ab710f100 x1875232130799104/t30064771224(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/448 e 0 to 0 dl 1788361529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.140968:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710f100 with x1875232130799104 ext(22020096->23068671) 00002000:00010000:1.0:1788361518.140975:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710f100 00000100:00100000:2.0:1788361518.153705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.154773:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130799232 00000100:00100000:1.0:1788361518.154784:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130799232 00002000:00100000:1.0:1788361518.154845:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (23068672->24117247) req@ffff9a8ab710f480 x1875232130799232/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/0 e 0 to 0 dl 1788361529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.154856:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710f480 with x1875232130799232 ext(23068672->24117247) 00002000:00010000:1.0:1788361518.154861:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710f480 00000100:00100000:1.0:1788361518.154884:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:1.0:1788361518.154893:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+15:2352:x1875232130799232:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:1.0:1788361518.164443:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+17:2352:x1875232130799232:12345-192.168.203.60@tcp:4:dd.500 Request processed in 9541us (10738us total) trans 30064771225 rc 0/0 00000100:00100000:1.0:1788361518.164457:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 216 00002000:00100000:1.0:1788361518.164480:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (23068672->24117247) req@ffff9a8ab710f480 x1875232130799232/t30064771225(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/448 e 0 to 0 dl 1788361529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.164491:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710f480 with x1875232130799232 ext(23068672->24117247) 00002000:00010000:1.0:1788361518.164497:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710f480 00000100:00100000:0.0:1788361518.169846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.170039:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130799360 00000100:00100000:1.0:1788361518.170049:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130799360 00002000:00100000:1.0:1788361518.170133:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (24117248->25165823) req@ffff9a89923c2a00 x1875232130799360/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/0 e 0 to 0 dl 1788361529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.170156:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c2a00 with x1875232130799360 ext(24117248->25165823) 00002000:00010000:1.0:1788361518.170162:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c2a00 00000100:00100000:1.0:1788361518.170187:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 217 00000100:00100000:1.0:1788361518.170196:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130799360:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:3.0:1788361518.170631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.170756:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130799616 00000100:00100000:1.0:1788361518.170761:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130799616 00000100:00100000:1.0:1788361518.170807:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:1.0:1788361518.170815:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88352850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:35819:x1875232130799616:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788361518.173352:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x23:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788361518.173486:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771387 00010000:00010000:1.0:1788361518.173698:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.173716:0:35348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.173740:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.173760:0:35348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.173767:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.173773:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.174387:0:35348:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361518.174445:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361518.174453:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361518.174461:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361518.174466:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361518.174475:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361518.174489:0:35335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x23:0x0].0x0 (ffff9a8984a32b00) 00010000:00010000:2.0:1788361518.174492:0:35335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361518.174496:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361518.174503:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615eb4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x23:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361518.174530:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361518.174532:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361518.174534:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361518.174583:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88352850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:35819:x1875232130799616:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 3765us (3949us total) trans 30064771388 rc 0/0 00000100:00100000:1.0:1788361518.174593:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000020:00080000:1.0:1788361518.174599:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788361518.185278:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+19:2351:x1875232130799360:12345-192.168.203.60@tcp:4:dd.500 Request processed in 15074us (15442us total) trans 30064771226 rc 0/0 00000100:00100000:1.0:1788361518.185291:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 217 00002000:00100000:1.0:1788361518.185303:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (24117248->25165823) req@ffff9a89923c2a00 x1875232130799360/t30064771226(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/448 e 0 to 0 dl 1788361529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.185313:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c2a00 with x1875232130799360 ext(24117248->25165823) 00002000:00010000:1.0:1788361518.185320:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c2a00 00000100:00100000:0.0:1788361518.188460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.188608:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130799744 00000100:00100000:1.0:1788361518.188617:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130799744 00002000:00100000:1.0:1788361518.188661:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (25165824->26214399) req@ffff9a89923c0700 x1875232130799744/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/0 e 0 to 0 dl 1788361529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.188672:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c0700 with x1875232130799744 ext(25165824->26214399) 00002000:00010000:1.0:1788361518.188690:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c0700 00000100:00100000:1.0:1788361518.188760:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:1.0:1788361518.188771:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+19:2352:x1875232130799744:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:1.0:1788361518.194751:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+21:2352:x1875232130799744:12345-192.168.203.60@tcp:4:dd.500 Request processed in 5972us (6289us total) trans 30064771227 rc 0/0 00000100:00100000:1.0:1788361518.194764:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 218 00002000:00100000:1.0:1788361518.194783:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (25165824->26214399) req@ffff9a89923c0700 x1875232130799744/t30064771227(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/448 e 0 to 0 dl 1788361529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.194795:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c0700 with x1875232130799744 ext(25165824->26214399) 00002000:00010000:1.0:1788361518.194801:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c0700 00000100:00100000:0.0:1788361518.196540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.196599:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130799872 00000100:00100000:1.0:1788361518.196607:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130799872 00002000:00100000:1.0:1788361518.196640:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (26214400->27262975) req@ffff9a89923c1f80 x1875232130799872/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/0 e 0 to 0 dl 1788361529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.196650:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c1f80 with x1875232130799872 ext(26214400->27262975) 00002000:00010000:1.0:1788361518.196654:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c1f80 00000100:00100000:1.0:1788361518.196711:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:1.0:1788361518.196720:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+21:2351:x1875232130799872:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:0.0:1788361518.202299:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+23:2351:x1875232130799872:12345-192.168.203.60@tcp:4:dd.500 Request processed in 5570us (5754us total) trans 30064771228 rc 0/0 00000100:00100000:0.0:1788361518.202313:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 219 00002000:00100000:0.0:1788361518.202325:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (26214400->27262975) req@ffff9a89923c1f80 x1875232130799872/t30064771228(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/448 e 0 to 0 dl 1788361529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788361518.202336:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c1f80 with x1875232130799872 ext(26214400->27262975) 00002000:00010000:0.0:1788361518.202342:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89923c1f80 00000100:00100000:1.0:1788361518.207062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361518.207158:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130800000 00000100:00100000:2.0:1788361518.207167:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130800000 00002000:00100000:2.0:1788361518.207210:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (27262976->28311551) req@ffff9a89859cb480 x1875232130800000/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/0 e 0 to 0 dl 1788361529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:2.0:1788361518.207223:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859cb480 with x1875232130800000 ext(27262976->28311551) 00002000:00010000:2.0:1788361518.207228:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859cb480 00000100:00100000:2.0:1788361518.207262:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00100000:2.0:1788361518.207273:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+23:2352:x1875232130800000:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:1.0:1788361518.211765:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+25:2352:x1875232130800000:12345-192.168.203.60@tcp:4:dd.500 Request processed in 4486us (4705us total) trans 30064771229 rc 0/0 00000100:00100000:1.0:1788361518.211778:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 220 00002000:00100000:1.0:1788361518.211789:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (27262976->28311551) req@ffff9a89859cb480 x1875232130800000/t30064771229(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/448 e 0 to 0 dl 1788361529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.211813:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859cb480 with x1875232130800000 ext(27262976->28311551) 00002000:00010000:1.0:1788361518.211819:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859cb480 00000100:00100000:2.0:1788361518.215724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361518.215789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361518.215875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361518.215932:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130800128 00000100:00100000:3.0:1788361518.215941:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130800128 00000100:00100000:3.0:1788361518.215989:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:3.0:1788361518.216010:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130800128:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361518.216071:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130800128:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 62us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361518.216078:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:1.0:1788361518.216233:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130800384 00000100:00100000:1.0:1788361518.216237:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130800384 00000100:00100000:1.0:1788361518.216333:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:0.0:1788361518.216340:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130800256 00000100:00100000:1.0:1788361518.216343:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130800384:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361518.216347:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130800256 00000100:00100000:1.0:1788361518.216558:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130800384:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 217us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361518.216566:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00080000:2.0:1788361518.216949:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361518.216954:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361518.217012:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:0.0:1788361518.217022:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:2351:x1875232130800256:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361518.217149:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:2351:x1875232130800256:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 128us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361518.217156:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:3.0:1788361518.220437:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.220625:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130800512 00000100:00100000:1.0:1788361518.220633:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130800512 00002000:00100000:1.0:1788361518.220675:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (28311552->29360127) req@ffff9a8abf16c700 x1875232130800512/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/0 e 0 to 0 dl 1788361529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.220686:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16c700 with x1875232130800512 ext(28311552->29360127) 00002000:00010000:1.0:1788361518.220692:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16c700 00000100:00100000:1.0:1788361518.220721:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00100000:1.0:1788361518.220730:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+25:2352:x1875232130800512:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:1.0:1788361518.229702:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+27:2352:x1875232130800512:12345-192.168.203.60@tcp:4:dd.500 Request processed in 8967us (9266us total) trans 30064771230 rc 0/0 00000100:00100000:1.0:1788361518.229713:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 221 00002000:00100000:1.0:1788361518.229722:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc9:0x0] (28311552->29360127) req@ffff9a8abf16c700 x1875232130800512/t30064771230(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/448 e 0 to 0 dl 1788361529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.229730:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16c700 with x1875232130800512 ext(28311552->29360127) 00002000:00010000:1.0:1788361518.229742:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16c700 00000100:00100000:3.0:1788361518.234080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361518.234164:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130800640 00000100:00100000:0.0:1788361518.234175:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130800640 00002000:00100000:0.0:1788361518.234220:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (29360128->30408703) req@ffff9a8abf16ea00 x1875232130800640/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/0 e 0 to 0 dl 1788361529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:0.0:1788361518.234248:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16ea00 with x1875232130800640 ext(29360128->30408703) 00002000:00010000:0.0:1788361518.234254:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16ea00 00000100:00100000:0.0:1788361518.234531:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 222 00000100:00100000:0.0:1788361518.234542:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+27:2352:x1875232130800640:12345-192.168.203.60@tcp:4:dd.500 00000100:00100000:1.0:1788361518.243746:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+29:2352:x1875232130800640:12345-192.168.203.60@tcp:4:dd.500 Request processed in 9199us (9666us total) trans 30064771231 rc 0/0 00000100:00100000:1.0:1788361518.243759:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 222 00002000:00100000:1.0:1788361518.243772:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xc9:0x0] (29360128->30408703) req@ffff9a8abf16ea00 x1875232130800640/t30064771231(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/448 e 0 to 0 dl 1788361529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:1.0:1788361518.243782:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16ea00 with x1875232130800640 ext(29360128->30408703) 00002000:00010000:1.0:1788361518.243789:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16ea00 00000100:00100000:2.0:1788361518.247820:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.247918:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130801024 00000100:00100000:1.0:1788361518.247927:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130801024 00000100:00100000:1.0:1788361518.247977:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1788361518.247988:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:35818:x1875232130801024:12345-192.168.203.60@tcp:35:dd.500 00000100:00100000:2.0:1788361518.248312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361518.248368:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130800768 00000100:00100000:3.0:1788361518.248372:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130800768 00002000:00100000:3.0:1788361518.248408:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (30408704->31457279) req@ffff9a8ab710c700 x1875232130800768/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/0 e 0 to 0 dl 1788361529 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788361518.248418:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710c700 with x1875232130800768 ext(30408704->31457279) 00002000:00010000:3.0:1788361518.248424:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710c700 00000100:00100000:3.0:1788361518.248448:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:3.0:1788361518.248455:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:2351:x1875232130800768:12345-192.168.203.60@tcp:4:dd.500 00000001:00080000:1.0:1788361518.249079:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771389 00000001:00080000:1.0:1788361518.249200:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771390 00000100:00100000:1.0:1788361518.249274:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+38:35818:x1875232130801024:12345-192.168.203.60@tcp:35:dd.500 Request processed in 1287us (1461us total) trans 30064771391 rc 0/0 00000100:00100000:1.0:1788361518.249282:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000020:00080000:1.0:1788361518.249286:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788361518.264560:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:2351:x1875232130800768:12345-192.168.203.60@tcp:4:dd.500 Request processed in 16096us (16239us total) trans 30064771232 rc 0/0 00000100:00100000:3.0:1788361518.264574:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 223 00002000:00100000:3.0:1788361518.264586:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xc9:0x0] (30408704->31457279) req@ffff9a8ab710c700 x1875232130800768/t30064771232(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:579/0 lens 488/448 e 0 to 0 dl 1788361529 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.500' uid:500 gid:500 projid:0 00002000:00100000:3.0:1788361518.264596:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710c700 with x1875232130800768 ext(30408704->31457279) 00002000:00010000:3.0:1788361518.264602:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710c700 00000100:00100000:2.0:1788361518.319645:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361518.319831:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130801152 00000100:00100000:1.0:1788361518.320255:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130801152 00000100:00100000:1.0:1788361518.320312:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 358 00000100:00100000:1.0:1788361518.320322:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:35830:x1875232130801152:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:1.0:1788361518.320406:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ebb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.320426:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ebb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.320448:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ebb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.320463:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615ec2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.320470:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615ec2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.320476:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615ec2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321196:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321206:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321215:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361518.321251:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321263:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ebb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321270:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ebb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321276:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ebb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321295:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361518.321299:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ebb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321307:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ebb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321318:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x0 (ffff9a8a83c0bc00) 00010000:00010000:1.0:1788361518.321321:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361518.321326:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ebb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321332:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ebb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x1f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321344:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615ec2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321350:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615ec2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321356:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615ec2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321361:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361518.321363:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615ec2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321369:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615ec2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321387:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x1f:0x0].0x4f74ecdb (ffff9a8984a32f00) 00010000:00010000:1.0:1788361518.321390:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361518.321393:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615ec2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321399:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615ec2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x1f:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321418:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321425:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321431:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321436:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987623e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361518.321438:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321444:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321452:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x20:0x0].0x0 (ffff9a8a890faf00) 00010000:00010000:1.0:1788361518.321454:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361518.321457:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361518.321462:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615ec9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361518.321658:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:35830:x1875232130801152:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1335us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361518.321666:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 358 00010000:00010000:3.0:1788361518.496717:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361519.136298:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361519.136308:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361519.136930:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 10 00000040:00080000:1.0:1788361519.136939:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000001:00080000:3.0:1788361519.357161:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771164 is committed 00000001:00080000:3.0:1788361519.357198:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771165 is committed 00010000:00010000:2.0:1788361519.520206:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361520.544235:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361521.185429:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361521.185439:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361521.185474:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 10 00000040:00080000:0.0:1788361521.185482:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361521.260007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361521.260126:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130801280 00000100:00100000:0.0:1788361521.260136:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130801280 00000100:00080000:2.0:1788361521.260282:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361521.260345:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 359 00000100:00100000:0.0:1788361521.260357:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+38:35760:x1875232130801280:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788361521.260459:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+38:35760:x1875232130801280:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 104us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361521.260467:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 359 00000100:00100000:0.0:1788361521.264700:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361521.264765:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130801536 00000100:00100000:1.0:1788361521.264775:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130801536 00000100:00100000:1.0:1788361521.264841:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:1.0:1788361521.264852:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:35760:x1875232130801536:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788361521.265480:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+39:35760:x1875232130801536:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 628us (790us total) trans 30064771392 rc 0/0 00000100:00100000:1.0:1788361521.265489:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:1.0:1788361521.312354:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361521.312380:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144235008:0@lo:400:kworker.0 00000100:00100000:1.0:1788361521.312447:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361521.312504:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144234624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361521.312524:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361521.312538:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361521.312544:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144235136:0@lo:400:kworker.0 00000100:00100000:1.0:1788361521.312563:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361521.312589:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144235008 00000100:00100000:1.0:1788361521.312596:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144235008 00000100:00100000:2.0:1788361521.312628:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144234880:0@lo:400:kworker.0 00000100:00100000:2.0:1788361521.312666:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361521.312670:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788361521.312694:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788361521.312696:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144235008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361521.312703:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144234752:0@lo:400:kworker.0 00000100:00100000:2.0:1788361521.312735:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361521.312766:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144235008:12345-0@lo:400:kworker.0 Request processed in 73us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361521.312768:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144235264:0@lo:400:kworker.0 00000100:00100000:1.0:1788361521.312780:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788361521.312798:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144234880 00000100:00100000:2.0:1788361521.312803:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361521.312804:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144234880 00000100:00100000:2.0:1788361521.312867:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144234752 00000100:00100000:3.0:1788361521.312989:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144235136 00000100:00100000:3.0:1788361521.312994:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144235136 00000100:00100000:3.0:1788361521.313021:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144235264 00000100:00100000:3.0:1788361521.313024:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144235264 00000100:00100000:3.0:1788361521.313046:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788361521.313053:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144235136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361521.313126:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144235136:12345-0@lo:400:kworker.0 Request processed in 72us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361521.313132:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788361521.313148:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788361521.313154:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144235264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361521.313181:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144235264:12345-0@lo:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361521.313186:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788361521.313206:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361521.313210:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361521.313230:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144235392:0@lo:400:kworker.0 00000100:00100000:3.0:1788361521.313256:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361521.313269:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144234624 00000100:00100000:0.0:1788361521.313276:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144234624 00000100:00100000:3.0:1788361521.313295:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144235264:0@lo:400:kworker.0 00000100:00100000:0.0:1788361521.313308:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788361521.313318:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144234624:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361521.313343:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144235392 00002000:00000024:0.0:1788361521.313347:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 272564224 pending 17039360 free 3751804928 avail 3749707776 00000100:00100000:3.0:1788361521.313348:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144235392 00000100:00100000:3.0:1788361521.313384:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788361521.313396:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144235392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361521.313396:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144234624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361521.313410:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788361521.313444:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144235392:12345-0@lo:400:kworker.0 Request processed in 52us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361521.313452:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788361521.313472:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361521.313477:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144235136:0@lo:400:kworker.0 00000100:00100000:0.0:1788361521.313496:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144235008:0@lo:400:kworker.0 00000100:00100000:3.0:1788361521.313503:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144235392:0@lo:400:kworker.0 00000100:00100000:0.0:1788361521.313518:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144234624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361521.314050:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788361521.314059:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144234880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361521.314128:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144234880:12345-0@lo:400:kworker.0 Request processed in 70us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361521.314134:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788361521.314181:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144234752 00000100:00100000:1.0:1788361521.314344:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788361521.314354:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144234752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361521.314387:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144234752:12345-0@lo:400:kworker.0 Request processed in 35us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361521.314394:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1788361521.315628:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361521.315672:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144234752:0@lo:400:kworker.0 00000100:00100000:3.0:1788361521.315688:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771165 gen 2 00000004:00080000:3.0:1788361521.315693:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a8ae70380, transno 30064771165 00000100:00100000:3.0:1788361521.315771:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf16f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144234880:0@lo:400:kworker.0 00000100:00100000:2.0:1788361521.429672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361521.429777:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130801664 00000100:00100000:3.0:1788361521.429787:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130801664 00000100:00100000:3.0:1788361521.429893:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 360 00000100:00100000:3.0:1788361521.429905:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:36269:x1875232130801664:12345-192.168.203.60@tcp:101:lsof.0 00000100:00080000:0.0:1788361521.429917:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788361521.429928:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361521.429948:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ed0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8bf expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361521.430015:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361521.430029:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361521.430044:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361521.430361:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1788361521.430366:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 16 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361521.430452:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361521.430479:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ed0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8bf expref: 7 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361521.430519:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8bf expref: 6 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361521.430529:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361521.430532:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361521.430536:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80030200, rc 0) 00000100:00100000:3.0:1788361521.430601:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:36269:x1875232130801664:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 699us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361521.430609:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 360 00010000:00010000:3.0:1788361521.568426:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361521.824601:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361521.824632:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144235520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361521.824700:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361521.824838:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144235520 00000100:00100000:1.0:1788361521.824847:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144235520 00000100:00100000:1.0:1788361521.824899:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788361521.824910:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144235520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361521.824945:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 153288704 pending 0 free 3804233728 avail 3802136576 00000100:00100000:1.0:1788361521.825042:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144235520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361521.825050:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788361521.827509:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89859b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144235520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788361522.592539:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361523.336535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361523.336578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361523.336609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361523.336636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361523.336656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361523.336720:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130802048 00000100:00100000:1.0:1788361523.336729:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130802048 00000100:00100000:1.0:1788361523.336810:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130802176 00000100:00100000:1.0:1788361523.336814:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130802176 00000100:00100000:1.0:1788361523.336840:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:1.0:1788361523.336851:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130802048:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361523.336917:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:2350:x1875232130802048:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 68us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361523.336925:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:1.0:1788361523.336941:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:1.0:1788361523.336948:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+31:2350:x1875232130802176:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361523.336975:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+31:2350:x1875232130802176:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361523.336981:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:0.0:1788361523.337050:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130802304 00000100:00100000:0.0:1788361523.337055:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130802304 00000100:00100000:0.0:1788361523.337125:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130801920 00000100:00100000:0.0:1788361523.337128:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130801920 00000100:00100000:0.0:1788361523.337153:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:0.0:1788361523.337160:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130802304:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361523.337191:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130802304:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 32us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361523.337197:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:0.0:1788361523.337210:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1788361523.337217:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2350:x1875232130801920:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361523.337244:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2350:x1875232130801920:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361523.337250:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00080000:2.0:1788361523.337410:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361523.337415:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361523.337418:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361523.337749:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130801792 00000100:00100000:3.0:1788361523.337754:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130801792 00000100:00100000:3.0:1788361523.337791:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:3.0:1788361523.337808:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130801792:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361523.337851:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130801792:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 53us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361523.337858:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:2.0:1788361523.339595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361523.339696:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130802432 00000100:00100000:1.0:1788361523.339704:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130802432 00002000:00100000:1.0:1788361523.339746:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc5:0x0] (0->11) req@ffff9a89859b2680 x1875232130802432/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:584/0 lens 504/0 e 0 to 0 dl 1788361534 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361523.339758:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b2680 with x1875232130802432 ext(0->11) 00002000:00010000:1.0:1788361523.339764:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859b2680 00000100:00100000:1.0:1788361523.339852:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:1.0:1788361523.339862:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+31:2350:x1875232130802432:12345-192.168.203.60@tcp:4:cat.0 00000100:00100000:1.0:1788361523.340353:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+33:2350:x1875232130802432:12345-192.168.203.60@tcp:4:cat.0 Request processed in 491us (763us total) trans 30064771233 rc 0/0 00000100:00100000:1.0:1788361523.340362:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 224 00002000:00100000:1.0:1788361523.340369:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xc5:0x0] (0->11) req@ffff9a89859b2680 x1875232130802432/t30064771233(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:584/0 lens 504/448 e 0 to 0 dl 1788361534 ref 1 fl Complete:/600/0 rc 0/0 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361523.340388:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b2680 with x1875232130802432 ext(0->11) 00002000:00010000:1.0:1788361523.340392:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89859b2680 00000001:00080000:3.0:1788361523.413243:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771386 is committed 00000020:00080000:3.0:1788361523.413255:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a856f0f00 refcount 2 committed 0 result 0 batchid 25769803904 00000020:00080000:3.0:1788361523.413260:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a898afe8600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a856f09c0 00000020:00080000:3.0:1788361523.413264:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a898afe8300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8ac1becc00 00000001:00080000:3.0:1788361523.413299:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771392 is committed 00000020:00080000:3.0:1788361523.413326:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803903 batchid updated 00000020:00080000:2.0:1788361523.413450:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803904 committed batchid 25769803903 00000020:00080000:2.0:1788361523.413609:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803903 00000001:00080000:2.0:1788361523.451826:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771228 is committed 00000001:00080000:2.0:1788361523.451859:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771233 is committed 00000001:00080000:2.0:1788361523.451933:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771222 is committed 00010000:00010000:2.0:1788361523.616256:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361523.657603:0:38801:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10c: Test RO-PCC with user quota on loop PCC device ========================================================== 11:05:23 (1788361523) 00000100:00100000:0.0:1788361524.620061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361524.620183:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130802688 00000100:00100000:3.0:1788361524.620194:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130802688 00000100:00100000:3.0:1788361524.620259:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 361 00000100:00100000:3.0:1788361524.620269:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:36553:x1875232130802688:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361524.620311:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361524.620334:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615ede lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8c6 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.620419:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ee5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.620435:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.620450:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.620467:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615eec lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.620474:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615eec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.620480:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615eec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.623581:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615ef3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.623610:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.623621:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361524.623634:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788361524.624684:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ee5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624696:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ee5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624704:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624710:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80031c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361524.624715:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ee5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624721:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ee5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624735:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:3.0:1788361524.624738:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361524.624742:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ee5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624748:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615ee5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624762:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615eec lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624774:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615eec lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624779:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615eec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624784:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361524.624787:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615eec lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624807:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615eec lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624815:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a890fae00) 00010000:00010000:3.0:1788361524.624818:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361524.624821:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615eec lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.624827:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615eec lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.625660:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615ede lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8c6 expref: 30 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.625681:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8c6 expref: 29 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.625689:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:3.0:1788361524.625692:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361524.625700:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80030a00, rc 0) 00000100:00100000:3.0:1788361524.625837:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:36553:x1875232130802688:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 5567us (5787us total) trans 30064771393 rc 0/0 00000100:00100000:3.0:1788361524.625847:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 361 00000100:00100000:2.0:1788361524.631599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361524.631781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361524.631926:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130802944 00000100:00100000:0.0:1788361524.631936:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130802944 00000100:00100000:0.0:1788361524.631988:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 362 00000100:00100000:0.0:1788361524.631999:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:36553:x1875232130802944:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788361524.632146:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:36553:x1875232130802944:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 148us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361524.632153:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 362 00000100:00100000:3.0:1788361524.632844:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130802816 00000100:00100000:3.0:1788361524.632852:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130802816 00000100:00100000:3.0:1788361524.632894:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:3.0:1788361524.632902:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:2351:x1875232130802816:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361524.632914:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361524.632939:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615ef3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8c6 expref: 29 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.632957:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:3.0:1788361524.632962:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361524.632988:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+28:2351:x1875232130802816:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 87us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361524.632996:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00010000:00010000:3.0:1788361524.640318:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361524.752000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361524.752036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361524.752160:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130803072 00000100:00100000:0.0:1788361524.752170:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130803072 00000100:00100000:0.0:1788361524.752224:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130803328 00000100:00100000:0.0:1788361524.752227:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130803328 00000100:00100000:0.0:1788361524.752254:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 363 00000100:00100000:0.0:1788361524.752262:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:2352:x1875232130803072:12345-192.168.203.60@tcp:41:mkdir.0 00000100:00100000:3.0:1788361524.752327:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 364 00000100:00100000:3.0:1788361524.752339:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:36568:x1875232130803328:12345-192.168.203.60@tcp:36:mkdir.0 00010000:00010000:3.0:1788361524.752412:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361524.752440:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615c29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f7ed expref: 29 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.752460:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361524.752465:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00000024:0.0:1788361524.752535:0:35347:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1788361524.752599:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+28:2352:x1875232130803072:12345-192.168.203.60@tcp:41:mkdir.0 Request processed in 337us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361524.752606:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 363 00010000:00010000:3.0:1788361524.752837:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.752851:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8bf expref: 5 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.754164:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.754215:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8bf expref: 5 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.754232:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8bf expref: 5 pid: 35345 timeout: 1014 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361524.754248:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89921c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144235648:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361524.754345:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8562cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361524.757842:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89921c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144235648:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361524.757871:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361524.757876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.758016:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130803456 00000100:00100000:1.0:1788361524.758024:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130803456 00010000:00010000:1.0:1788361524.758066:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8bf expref: 6 pid: 35345 timeout: 1014 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361524.758135:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:1.0:1788361524.758154:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130803456:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361524.758169:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361524.758176:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8bf expref: 6 pid: 35345 timeout: 1014 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.758187:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8bf expref: 6 pid: 35345 timeout: 1014 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.758208:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615ed7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8bf expref: 6 pid: 35345 timeout: 1014 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.758231:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:1.0:1788361524.758235:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.758244:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.758251:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.758286:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361524.758296:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.758305:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.758989:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.759012:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.759021:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361524.759857:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130803456:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1698us (2045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361524.759868:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000004:00200000:3.0:1788361524.763074:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 512 00010000:00010000:3.0:1788361524.763235:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.763245:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.763253:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.763259:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361524.763263:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.763271:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.763286:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361524.763289:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361524.763293:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361524.763299:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f01 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361524.763331:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a7d8da6 reply state 00000000a628b5fb transno 30064771394 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361524.763339:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361524.763427:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:36568:x1875232130803328:12345-192.168.203.60@tcp:36:mkdir.0 Request processed in 11088us (11386us total) trans 30064771394 rc 0/0 00000100:00100000:3.0:1788361524.763436:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 364 00010000:00010000:1.0:1788361524.765818:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.765833:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.765841:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.765847:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80031800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361524.765851:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.765859:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.765943:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff9a8a890fae00) 00010000:00010000:1.0:1788361524.765947:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361524.765951:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.765957:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615f08 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361524.775006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.775144:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130803584 00000100:00100000:1.0:1788361524.775154:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130803584 00000100:00100000:1.0:1788361524.775227:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 365 00000100:00100000:1.0:1788361524.775237:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+28:36569:x1875232130803584:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361524.775261:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361524.775283:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615f0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8cd expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.775341:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615f16 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.775351:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.775360:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361524.775428:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1788361524.775432:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 17 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361524.775456:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615f16 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.775481:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615f0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8cd expref: 30 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.775504:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615f16 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8cd expref: 29 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.775513:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:1.0:1788361524.775516:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361524.775520:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623600, rc 0) 00000100:00100000:1.0:1788361524.775714:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+29:36569:x1875232130803584:12345-192.168.203.60@tcp:101:dd.0 Request processed in 478us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361524.775729:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 365 00000100:00100000:2.0:1788361524.781553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361524.781618:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130803712 00000100:00100000:0.0:1788361524.781628:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130803712 00000100:00100000:0.0:1788361524.781686:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 366 00000100:00100000:0.0:1788361524.781696:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:36569:x1875232130803712:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361524.781716:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361524.781735:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615f1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8d4 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.781812:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615f24 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.781826:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615f24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.781855:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615f24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.781870:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615f2b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.781878:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.781885:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782006:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615f32 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782024:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615f32 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782032:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615f32 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361524.782065:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 512 00000004:00200000:0.0:1788361524.782068:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361524.782106:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615f32 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782115:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615f24 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782120:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615f24 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782131:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615f24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782135:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361524.782138:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615f24 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782143:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615f24 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782152:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:0.0:1788361524.782154:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361524.782158:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615f24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782163:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e000/0xf6a94c97d6615f24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782175:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615f2b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782182:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615f2b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782187:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615f2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782192:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361524.782195:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615f2b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782212:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615f2b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782227:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3ac66456 (ffff9a8a90b43500) 00010000:00010000:0.0:1788361524.782229:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361524.782231:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615f2b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782235:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e200/0xf6a94c97d6615f2b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3ac66456 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782257:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615f1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8d4 expref: 31 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782266:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e400/0xf6a94c97d6615f32 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8d4 expref: 30 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.782271:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361524.782273:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788361524.782274:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e400, rc 0) 00000100:00100000:0.0:1788361524.782330:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+30:36569:x1875232130803712:12345-192.168.203.60@tcp:101:dd.0 Request processed in 636us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361524.782337:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 366 00000100:00100000:2.0:1788361524.787888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361524.787966:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130803968 00000100:00100000:3.0:1788361524.787975:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130803968 00000100:00100000:1.0:1788361524.788444:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 367 00000100:00100000:1.0:1788361524.788457:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:36569:x1875232130803968:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361524.788478:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361524.788497:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615f39 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8db expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.788631:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615f40 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.788647:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615f40 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.788657:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615f40 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.788672:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.788678:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.788684:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361524.789894:0:37122:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xca:0x0], index 0: 0 00010000:00010000:1.0:1788361524.790398:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615f4e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790413:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615f4e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790432:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615f4e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790470:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615f40 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790476:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615f40 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790483:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615f40 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790490:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361524.790495:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615f40 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790502:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615f40 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790514:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361524.790518:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361524.790522:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615f40 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790528:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615f40 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361524.790542:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001638855b reply state 00000000d542d4e0 transno 30064771395 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361524.790550:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361524.790589:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622c00/0xf6a94c97d6615f39 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8db expref: 33 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790604:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615f4e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8db expref: 32 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.790612:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:1.0:1788361524.790614:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361524.790616:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623a00, rc 0) 00000100:00100000:1.0:1788361524.793974:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+33:36569:x1875232130803968:12345-192.168.203.60@tcp:101:dd.0 Request processed in 5509us (6083us total) trans 30064771395 rc 0/0 00000100:00100000:1.0:1788361524.793989:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 367 00010000:00010000:0.0:1788361524.800009:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.800023:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.800043:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.800047:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8987622600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361524.800050:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.800056:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.800071:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361524.800074:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361524.800078:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361524.800149:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615f47 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361524.809442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.809929:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130804096 00000100:00100000:1.0:1788361524.809938:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130804096 00000100:00100000:1.0:1788361524.809984:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:1.0:1788361524.809991:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+7:36569:x1875232130804096:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361524.810009:0:35983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361524.810024:0:35983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6615f5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8e2 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361524.810044:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361524.810062:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xca:0x0].0x0 since=914s v=(0 0) 00010000:00010000:1.0:1788361524.810066:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361524.810073:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6615f5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8e2 expref: 8 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.810123:0:35983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002595d520/0xf6a94c97d6615f5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8e2 expref: 8 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361524.810152:0:35983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622c00, rc 0) 00000100:00100000:0.0:1788361524.813796:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88445850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+8:36569:x1875232130804096:12345-192.168.203.60@tcp:101:dd.0 Request processed in 3784us (4341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361524.813810:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:2.0:1788361524.838735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.838837:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130804224 00000100:00100000:1.0:1788361524.838847:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130804224 00002000:00100000:1.0:1788361524.838895:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff9a89859b1500 x1875232130804224/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.838906:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b1500 with x1875232130804224 ext(0->1048575) 00002000:00010000:1.0:1788361524.838911:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b1500 00000100:00100000:1.0:1788361524.838948:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:1.0:1788361524.838957:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+8:2351:x1875232130804224:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361524.862785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361524.862880:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130804352 00000100:00100000:3.0:1788361524.862890:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130804352 00002000:00100000:3.0:1788361524.862933:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff9a89923c3b80 x1875232130804352/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361524.862945:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c3b80 with x1875232130804352 ext(1048576->2097151) 00002000:00010000:3.0:1788361524.862951:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89923c3b80 00000100:00100000:3.0:1788361524.862986:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 226 00000100:00100000:3.0:1788361524.862997:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130804352:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361524.864335:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+12:2351:x1875232130804224:12345-192.168.203.60@tcp:4:dd.0 Request processed in 25375us (25606us total) trans 30064771166 rc 0/0 00000100:00100000:1.0:1788361524.864345:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 225 00002000:00100000:1.0:1788361524.864354:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff9a89859b1500 x1875232130804224/t30064771166(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.864362:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b1500 with x1875232130804224 ext(0->1048575) 00002000:00010000:1.0:1788361524.864367:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b1500 00000100:00100000:1.0:1788361524.875288:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2352:x1875232130804352:12345-192.168.203.60@tcp:4:dd.0 Request processed in 12284us (12503us total) trans 30064771167 rc 0/0 00000100:00100000:1.0:1788361524.875301:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 226 00002000:00100000:1.0:1788361524.875314:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff9a89923c3b80 x1875232130804352/t30064771167(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.875323:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89923c3b80 with x1875232130804352 ext(1048576->2097151) 00002000:00010000:1.0:1788361524.875340:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89923c3b80 00000100:00100000:3.0:1788361524.887396:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.887455:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130804480 00000100:00100000:1.0:1788361524.887464:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130804480 00002000:00100000:1.0:1788361524.887508:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff9a89921c2300 x1875232130804480/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.887519:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c2300 with x1875232130804480 ext(2097152->3145727) 00002000:00010000:1.0:1788361524.887524:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89921c2300 00000100:00100000:1.0:1788361524.887556:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:1.0:1788361524.887565:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130804480:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361524.894362:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130804480:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6789us (6967us total) trans 30064771168 rc 0/0 00000100:00100000:1.0:1788361524.894375:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 227 00002000:00100000:1.0:1788361524.894387:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff9a89921c2300 x1875232130804480/t30064771168(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.894397:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c2300 with x1875232130804480 ext(2097152->3145727) 00002000:00010000:1.0:1788361524.894403:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89921c2300 00000100:00100000:0.0:1788361524.894531:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.894639:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130804608 00000100:00100000:1.0:1788361524.894646:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130804608 00002000:00100000:1.0:1788361524.894675:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff9a89921aea00 x1875232130804608/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.894683:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921aea00 with x1875232130804608 ext(3145728->4194303) 00002000:00010000:1.0:1788361524.894686:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89921aea00 00000100:00100000:1.0:1788361524.894814:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00100000:1.0:1788361524.894826:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130804608:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361524.901275:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+16:2350:x1875232130804608:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6442us (6736us total) trans 30064771169 rc 0/0 00000100:00100000:1.0:1788361524.901289:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 228 00002000:00100000:1.0:1788361524.901307:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff9a89921aea00 x1875232130804608/t30064771169(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.901318:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921aea00 with x1875232130804608 ext(3145728->4194303) 00002000:00010000:1.0:1788361524.901325:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89921aea00 00000100:00100000:3.0:1788361524.906539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.907158:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130804736 00000100:00100000:1.0:1788361524.907167:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130804736 00002000:00100000:1.0:1788361524.907215:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff9a89921c1f80 x1875232130804736/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.907225:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c1f80 with x1875232130804736 ext(4194304->5242879) 00002000:00010000:1.0:1788361524.907231:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89921c1f80 00000100:00100000:0.0:1788361524.908068:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:0.0:1788361524.908081:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+16:2349:x1875232130804736:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361524.917492:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+18:2349:x1875232130804736:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9401us (10949us total) trans 30064771170 rc 0/0 00000100:00100000:1.0:1788361524.917505:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 229 00002000:00100000:1.0:1788361524.917517:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff9a89921c1f80 x1875232130804736/t30064771170(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.917529:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c1f80 with x1875232130804736 ext(4194304->5242879) 00002000:00010000:1.0:1788361524.917535:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89921c1f80 00000100:00100000:0.0:1788361524.924037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.924135:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130804864 00000100:00100000:1.0:1788361524.924146:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130804864 00002000:00100000:1.0:1788361524.924193:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff9a89921aca80 x1875232130804864/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.924223:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921aca80 with x1875232130804864 ext(5242880->6291455) 00002000:00010000:1.0:1788361524.924229:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89921aca80 00000100:00100000:1.0:1788361524.924262:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 230 00000100:00100000:1.0:1788361524.924272:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+18:2349:x1875232130804864:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361524.930288:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:2349:x1875232130804864:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6008us (6250us total) trans 30064771171 rc 0/0 00000100:00100000:1.0:1788361524.930304:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 230 00002000:00100000:1.0:1788361524.930318:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff9a89921aca80 x1875232130804864/t30064771171(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.930329:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921aca80 with x1875232130804864 ext(5242880->6291455) 00002000:00010000:1.0:1788361524.930335:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89921aca80 00000100:00100000:0.0:1788361524.935282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.935400:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130804992 00000100:00100000:1.0:1788361524.935410:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130804992 00002000:00100000:1.0:1788361524.935455:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff9a8ab710ce00 x1875232130804992/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.935466:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710ce00 with x1875232130804992 ext(6291456->7340031) 00002000:00010000:1.0:1788361524.935471:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab710ce00 00000100:00100000:1.0:1788361524.935500:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:1.0:1788361524.935509:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+20:2350:x1875232130804992:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361524.942339:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+22:2350:x1875232130804992:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6821us (7055us total) trans 30064771172 rc 0/0 00000100:00100000:1.0:1788361524.942352:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 231 00002000:00100000:1.0:1788361524.942377:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff9a8ab710ce00 x1875232130804992/t30064771172(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.942386:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710ce00 with x1875232130804992 ext(6291456->7340031) 00002000:00010000:1.0:1788361524.942392:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab710ce00 00000100:00100000:2.0:1788361524.948537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.948706:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130805120 00000100:00100000:1.0:1788361524.948717:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130805120 00002000:00100000:1.0:1788361524.948843:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff9a89859b1c00 x1875232130805120/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.948854:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b1c00 with x1875232130805120 ext(7340032->8388607) 00002000:00010000:1.0:1788361524.948860:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b1c00 00000100:00100000:1.0:1788361524.948896:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 232 00000100:00100000:1.0:1788361524.948905:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+22:2352:x1875232130805120:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361524.955662:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+24:2352:x1875232130805120:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6750us (7125us total) trans 30064771173 rc 0/0 00000100:00100000:1.0:1788361524.955673:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 232 00002000:00100000:1.0:1788361524.955684:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff9a89859b1c00 x1875232130805120/t30064771173(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.955692:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b1c00 with x1875232130805120 ext(7340032->8388607) 00002000:00010000:1.0:1788361524.955697:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b1c00 00000100:00100000:2.0:1788361524.962133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.962599:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130805248 00000100:00100000:1.0:1788361524.962608:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130805248 00002000:00100000:1.0:1788361524.962803:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff9a89859b1f80 x1875232130805248/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.962816:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b1f80 with x1875232130805248 ext(8388608->9437183) 00002000:00010000:1.0:1788361524.962835:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b1f80 00000100:00100000:1.0:1788361524.962870:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:1.0:1788361524.962880:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+24:2351:x1875232130805248:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361524.969476:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+26:2351:x1875232130805248:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6587us (7382us total) trans 30064771174 rc 0/0 00000100:00100000:1.0:1788361524.969489:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 233 00002000:00100000:1.0:1788361524.969503:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff9a89859b1f80 x1875232130805248/t30064771174(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.969513:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b1f80 with x1875232130805248 ext(8388608->9437183) 00002000:00010000:1.0:1788361524.969520:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b1f80 00000100:00100000:2.0:1788361524.974322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.974399:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130805376 00000100:00100000:1.0:1788361524.974410:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130805376 00002000:00100000:1.0:1788361524.974464:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff9a89859b2a00 x1875232130805376/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.974668:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b2a00 with x1875232130805376 ext(9437184->10485759) 00002000:00010000:1.0:1788361524.974675:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b2a00 00000100:00100000:1.0:1788361524.974711:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 234 00000100:00100000:1.0:1788361524.974721:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:2352:x1875232130805376:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361524.982266:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+28:2352:x1875232130805376:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7538us (7954us total) trans 30064771175 rc 0/0 00000100:00100000:1.0:1788361524.982280:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 234 00002000:00100000:1.0:1788361524.982291:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff9a89859b2a00 x1875232130805376/t30064771175(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.982318:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b2a00 with x1875232130805376 ext(9437184->10485759) 00002000:00010000:1.0:1788361524.982324:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b2a00 00000100:00100000:2.0:1788361524.989185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361524.989408:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130805504 00000100:00100000:1.0:1788361524.989419:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130805504 00002000:00100000:1.0:1788361524.989474:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff9a89859b0e00 x1875232130805504/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/0 e 0 to 0 dl 1788361535 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361524.989487:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b0e00 with x1875232130805504 ext(10485760->11534335) 00002000:00010000:1.0:1788361524.989492:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b0e00 00000100:00100000:1.0:1788361524.989527:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:1.0:1788361524.989537:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+28:2351:x1875232130805504:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.001576:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+30:2351:x1875232130805504:12345-192.168.203.60@tcp:4:dd.0 Request processed in 12027us (12389us total) trans 30064771176 rc 0/0 00000100:00100000:1.0:1788361525.001590:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 235 00002000:00100000:1.0:1788361525.001602:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff9a89859b0e00 x1875232130805504/t30064771176(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:585/0 lens 488/448 e 0 to 0 dl 1788361535 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.001613:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b0e00 with x1875232130805504 ext(10485760->11534335) 00002000:00010000:1.0:1788361525.001620:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b0e00 00000100:00100000:0.0:1788361525.007924:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.008254:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130805632 00000100:00100000:1.0:1788361525.008263:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130805632 00002000:00100000:1.0:1788361525.008328:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff9a8ab710c380 x1875232130805632/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.008339:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710c380 with x1875232130805632 ext(11534336->12582911) 00002000:00010000:1.0:1788361525.008345:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab710c380 00000100:00100000:1.0:1788361525.008388:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 236 00000100:00100000:1.0:1788361525.008399:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+30:2350:x1875232130805632:12345-192.168.203.60@tcp:4:dd.0 00000100:00080000:2.0:1788361525.009607:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361525.019010:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+32:2350:x1875232130805632:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10600us (11083us total) trans 30064771177 rc 0/0 00000100:00100000:1.0:1788361525.019025:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 236 00002000:00100000:1.0:1788361525.019040:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff9a8ab710c380 x1875232130805632/t30064771177(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.019051:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710c380 with x1875232130805632 ext(11534336->12582911) 00002000:00010000:1.0:1788361525.019067:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab710c380 00000100:00100000:2.0:1788361525.023820:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.023913:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130805760 00000100:00100000:1.0:1788361525.023923:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130805760 00002000:00100000:1.0:1788361525.023968:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff9a8ac0875f80 x1875232130805760/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.023979:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0875f80 with x1875232130805760 ext(12582912->13631487) 00002000:00010000:1.0:1788361525.023986:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0875f80 00000100:00100000:1.0:1788361525.024024:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:1.0:1788361525.024033:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:2349:x1875232130805760:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361525.032672:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.032929:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130805888 00000100:00100000:1.0:1788361525.032940:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130805888 00002000:00100000:1.0:1788361525.032990:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff9a8ab710ca80 x1875232130805888/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.033001:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710ca80 with x1875232130805888 ext(13631488->14680063) 00002000:00010000:1.0:1788361525.033008:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab710ca80 00000100:00100000:1.0:1788361525.033047:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 238 00000100:00100000:1.0:1788361525.033068:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+34:2351:x1875232130805888:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.034779:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+36:2349:x1875232130805760:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10739us (10959us total) trans 30064771178 rc 0/0 00000100:00100000:1.0:1788361525.035104:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 237 00002000:00100000:1.0:1788361525.035118:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff9a8ac0875f80 x1875232130805760/t30064771178(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.035129:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0875f80 with x1875232130805760 ext(12582912->13631487) 00002000:00010000:1.0:1788361525.035135:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0875f80 00000100:00100000:2.0:1788361525.041620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.042394:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130806016 00000100:00100000:1.0:1788361525.042404:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130806016 00002000:00100000:1.0:1788361525.042451:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff9a8ac0877800 x1875232130806016/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.042462:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0877800 with x1875232130806016 ext(14680064->15728639) 00002000:00010000:1.0:1788361525.042467:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0877800 00000100:00100000:1.0:1788361525.042501:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:1.0:1788361525.042512:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+36:2351:x1875232130806016:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361525.042598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.042632:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130806272 00000100:00100000:0.0:1788361525.042638:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130806272 00000100:00080000:2.0:1788361525.042684:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361525.042693:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:0.0:1788361525.042703:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+32:36569:x1875232130806272:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:2.0:1788361525.043613:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:2351:x1875232130805888:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10544us (10946us total) trans 30064771179 rc 0/0 00000100:00100000:2.0:1788361525.043624:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 238 00002000:00100000:2.0:1788361525.043633:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff9a8ab710ca80 x1875232130805888/t30064771179(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.043642:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710ca80 with x1875232130805888 ext(13631488->14680063) 00002000:00010000:2.0:1788361525.043647:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab710ca80 00000100:00100000:0.0:1788361525.043663:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:36569:x1875232130806272:12345-192.168.203.60@tcp:35:dd.0 Request processed in 959us (1065us total) trans 30064771396 rc 0/0 00000100:00100000:0.0:1788361525.043683:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:0.0:1788361525.052323:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+38:2351:x1875232130806016:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9803us (10703us total) trans 30064771180 rc 0/0 00000100:00100000:0.0:1788361525.052337:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 239 00002000:00100000:0.0:1788361525.052349:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff9a8ac0877800 x1875232130806016/t30064771180(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361525.052360:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0877800 with x1875232130806016 ext(14680064->15728639) 00002000:00010000:0.0:1788361525.052366:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0877800 00000100:00100000:1.0:1788361525.052644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.053969:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130806528 00000100:00100000:3.0:1788361525.053981:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130806528 00000100:00100000:0.0:1788361525.054229:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 368 00000100:00100000:0.0:1788361525.054240:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+33:36570:x1875232130806528:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361525.054262:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361525.054293:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615f63 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8e9 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.054417:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f6a lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.054431:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f6a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.054474:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f6a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.054491:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.054499:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.054506:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361525.054950:0:37551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xca:0x0], index 1: 0 00010000:00010000:0.0:1788361525.055297:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615f78 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055307:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615f78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055316:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615f78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055349:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f6a lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055356:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f6a lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055363:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f6a lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055369:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573e600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361525.055381:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f6a lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055389:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f6a lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055401:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361525.055404:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361525.055408:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f6a lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055415:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f6a lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361525.055428:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da7e8235 reply state 000000003cf9aa4a transno 30064771397 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361525.055488:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361525.055518:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f600/0xf6a94c97d6615f63 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8e9 expref: 36 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055534:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615f78 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8e9 expref: 35 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.055542:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:0.0:1788361525.055545:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361525.055547:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573e800, rc 0) 00000100:00100000:0.0:1788361525.055667:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+36:36570:x1875232130806528:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1428us (3023us total) trans 30064771397 rc 0/0 00000100:00100000:0.0:1788361525.055675:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 368 00010000:00010000:3.0:1788361525.057675:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.057691:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.057713:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.057720:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8573fa00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361525.057725:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.057733:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.057749:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff9a8a90b43500) 00010000:00010000:3.0:1788361525.057752:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361525.057756:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.057763:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573fa00/0xf6a94c97d6615f71 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361525.062984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.063070:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130806656 00000100:00100000:0.0:1788361525.063079:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130806656 00000100:00100000:0.0:1788361525.063252:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:0.0:1788361525.063263:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:36570:x1875232130806656:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361525.063280:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361525.063314:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615f86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8f0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361525.063343:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361525.063364:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xca:0x0].0x0 since=915s v=(0 0) 00010000:00010000:0.0:1788361525.063369:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xca:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361525.063379:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615f86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8f0 expref: 11 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.063397:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061b95aee/0xf6a94c97d6615f86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8f0 expref: 11 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.063412:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f600, rc 0) 00000100:00080000:2.0:1788361525.063877:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361525.063982:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:36570:x1875232130806656:12345-192.168.203.60@tcp:101:dd.0 Request processed in 719us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361525.063990:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:2.0:1788361525.080634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.081899:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130806784 00000100:00100000:0.0:1788361525.082009:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130806784 00002000:00100000:0.0:1788361525.082059:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff9a8a9086f480 x1875232130806784/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361525.082071:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086f480 with x1875232130806784 ext(0->1048575) 00002000:00010000:0.0:1788361525.082101:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086f480 00000100:00100000:0.0:1788361525.082170:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 240 00000100:00100000:0.0:1788361525.082180:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130806784:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.090353:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130806784:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8164us (9718us total) trans 30064771234 rc 0/0 00000100:00100000:1.0:1788361525.090368:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 240 00002000:00100000:1.0:1788361525.090380:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff9a8a9086f480 x1875232130806784/t30064771234(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.090390:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086f480 with x1875232130806784 ext(0->1048575) 00002000:00010000:1.0:1788361525.090406:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086f480 00000100:00100000:0.0:1788361525.091754:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.091826:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130806912 00000100:00100000:3.0:1788361525.091835:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130806912 00002000:00100000:3.0:1788361525.091887:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff9a8abf16f100 x1875232130806912/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.091898:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16f100 with x1875232130806912 ext(1048576->2097151) 00002000:00010000:3.0:1788361525.091903:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16f100 00000100:00100000:3.0:1788361525.091943:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 241 00000100:00100000:3.0:1788361525.091954:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130806912:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361525.103801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.104166:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130807040 00000100:00100000:1.0:1788361525.104179:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130807040 00002000:00100000:1.0:1788361525.104240:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff9a8abf16c000 x1875232130807040/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.104254:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16c000 with x1875232130807040 ext(2097152->3145727) 00002000:00010000:1.0:1788361525.104261:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16c000 00000100:00100000:1.0:1788361525.104340:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 242 00000100:00100000:1.0:1788361525.104351:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2351:x1875232130807040:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361525.105005:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+17:2350:x1875232130806912:12345-192.168.203.60@tcp:4:dd.0 Request processed in 13049us (13252us total) trans 30064771235 rc 0/0 00000100:00100000:3.0:1788361525.105033:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 241 00002000:00100000:3.0:1788361525.105042:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff9a8abf16f100 x1875232130806912/t30064771235(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.105065:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16f100 with x1875232130806912 ext(1048576->2097151) 00002000:00010000:3.0:1788361525.105071:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16f100 00000100:00100000:1.0:1788361525.115574:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130807040:12345-192.168.203.60@tcp:4:dd.0 Request processed in 11217us (11789us total) trans 30064771236 rc 0/0 00000100:00100000:0.0:1788361525.115574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.115588:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 242 00002000:00100000:1.0:1788361525.115605:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff9a8abf16c000 x1875232130807040/t30064771236(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.115615:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16c000 with x1875232130807040 ext(2097152->3145727) 00002000:00010000:1.0:1788361525.115623:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16c000 00000100:00100000:3.0:1788361525.115783:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130807168 00000100:00100000:3.0:1788361525.115804:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130807168 00002000:00100000:3.0:1788361525.115848:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff9a8abf16f480 x1875232130807168/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.115856:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16f480 with x1875232130807168 ext(3145728->4194303) 00002000:00010000:3.0:1788361525.115860:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16f480 00000100:00100000:3.0:1788361525.115896:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 243 00000100:00100000:3.0:1788361525.115905:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+18:2352:x1875232130807168:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361525.126947:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+19:2352:x1875232130807168:12345-192.168.203.60@tcp:4:dd.0 Request processed in 11033us (11374us total) trans 30064771237 rc 0/0 00000100:00100000:2.0:1788361525.126961:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 243 00002000:00100000:2.0:1788361525.126974:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff9a8abf16f480 x1875232130807168/t30064771237(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.126985:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16f480 with x1875232130807168 ext(3145728->4194303) 00002000:00010000:2.0:1788361525.126992:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16f480 00000100:00100000:0.0:1788361525.130655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.130753:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130807296 00000100:00100000:1.0:1788361525.130763:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130807296 00002000:00100000:1.0:1788361525.130824:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff9a8abf16df80 x1875232130807296/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.130836:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16df80 with x1875232130807296 ext(4194304->5242879) 00002000:00010000:1.0:1788361525.130841:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16df80 00000100:00100000:1.0:1788361525.130874:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 244 00000100:00100000:1.0:1788361525.130884:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+19:2351:x1875232130807296:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.137808:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+21:2351:x1875232130807296:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6915us (7151us total) trans 30064771238 rc 0/0 00000100:00100000:1.0:1788361525.137822:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 244 00002000:00100000:1.0:1788361525.137834:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff9a8abf16df80 x1875232130807296/t30064771238(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.137844:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16df80 with x1875232130807296 ext(4194304->5242879) 00002000:00010000:1.0:1788361525.137850:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16df80 00000100:00100000:0.0:1788361525.144404:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361525.144666:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130807424 00000100:00100000:2.0:1788361525.144690:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130807424 00002000:00100000:2.0:1788361525.144741:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff9a8abf16e680 x1875232130807424/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.144752:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16e680 with x1875232130807424 ext(5242880->6291455) 00002000:00010000:2.0:1788361525.144759:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16e680 00000100:00100000:2.0:1788361525.144858:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 245 00000100:00100000:2.0:1788361525.144869:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+21:2352:x1875232130807424:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361525.151874:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+23:2352:x1875232130807424:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6995us (7468us total) trans 30064771239 rc 0/0 00000100:00100000:3.0:1788361525.151889:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 245 00002000:00100000:3.0:1788361525.151902:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff9a8abf16e680 x1875232130807424/t30064771239(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.151913:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf16e680 with x1875232130807424 ext(5242880->6291455) 00002000:00010000:3.0:1788361525.151920:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abf16e680 00000100:00100000:2.0:1788361525.155673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.155771:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130807552 00000100:00100000:1.0:1788361525.155781:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130807552 00002000:00100000:1.0:1788361525.155838:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff9a8a9086c000 x1875232130807552/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.155849:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086c000 with x1875232130807552 ext(6291456->7340031) 00002000:00010000:1.0:1788361525.155855:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086c000 00000100:00100000:1.0:1788361525.155926:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 246 00000100:00100000:1.0:1788361525.155936:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+23:2351:x1875232130807552:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.163508:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+25:2351:x1875232130807552:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7563us (7833us total) trans 30064771240 rc 0/0 00000100:00100000:1.0:1788361525.163528:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 246 00002000:00100000:1.0:1788361525.163542:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff9a8a9086c000 x1875232130807552/t30064771240(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.163552:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086c000 with x1875232130807552 ext(6291456->7340031) 00002000:00010000:1.0:1788361525.163559:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086c000 00000100:00100000:2.0:1788361525.168003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.168265:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130807680 00000100:00100000:1.0:1788361525.168287:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130807680 00002000:00100000:1.0:1788361525.168334:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff9a8a9086dc00 x1875232130807680/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.168346:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086dc00 with x1875232130807680 ext(7340032->8388607) 00002000:00010000:1.0:1788361525.168351:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086dc00 00000100:00100000:1.0:1788361525.168385:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 247 00000100:00100000:1.0:1788361525.168394:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:2352:x1875232130807680:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.174804:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+27:2352:x1875232130807680:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6385us (6784us total) trans 30064771241 rc 0/0 00000100:00100000:1.0:1788361525.174819:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 247 00002000:00100000:1.0:1788361525.174833:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff9a8a9086dc00 x1875232130807680/t30064771241(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.174844:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086dc00 with x1875232130807680 ext(7340032->8388607) 00002000:00010000:1.0:1788361525.174850:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086dc00 00000100:00100000:2.0:1788361525.182439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.182534:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130807808 00000100:00100000:3.0:1788361525.182546:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130807808 00002000:00100000:3.0:1788361525.182592:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (8388608->9437183) req@ffff9a8a9086fb80 x1875232130807808/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.182611:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086fb80 with x1875232130807808 ext(8388608->9437183) 00002000:00010000:3.0:1788361525.182616:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086fb80 00000100:00100000:3.0:1788361525.182656:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 248 00000100:00100000:3.0:1788361525.182662:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:2349:x1875232130807808:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361525.190544:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130807808:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7871us (8106us total) trans 30064771242 rc 0/0 00000100:00100000:3.0:1788361525.190558:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 248 00002000:00100000:3.0:1788361525.190571:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (8388608->9437183) req@ffff9a8a9086fb80 x1875232130807808/t30064771242(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.190581:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086fb80 with x1875232130807808 ext(8388608->9437183) 00002000:00010000:3.0:1788361525.190586:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086fb80 00000100:00100000:2.0:1788361525.194934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.195449:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130807936 00000100:00100000:1.0:1788361525.195460:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130807936 00002000:00100000:1.0:1788361525.195510:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (9437184->10485759) req@ffff9a8a9086f800 x1875232130807936/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.195522:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086f800 with x1875232130807936 ext(9437184->10485759) 00002000:00010000:1.0:1788361525.195527:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086f800 00000100:00100000:1.0:1788361525.195563:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 249 00000100:00100000:1.0:1788361525.195574:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130807936:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.205853:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130807936:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10268us (10914us total) trans 30064771243 rc 0/0 00000100:00100000:1.0:1788361525.205875:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 249 00002000:00100000:1.0:1788361525.205889:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (9437184->10485759) req@ffff9a8a9086f800 x1875232130807936/t30064771243(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.205899:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086f800 with x1875232130807936 ext(9437184->10485759) 00002000:00010000:1.0:1788361525.205906:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086f800 00000100:00100000:2.0:1788361525.210842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.210917:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130808064 00000100:00100000:1.0:1788361525.210927:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130808064 00002000:00100000:1.0:1788361525.210978:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (10485760->11534335) req@ffff9a8a9086e300 x1875232130808064/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.210990:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086e300 with x1875232130808064 ext(10485760->11534335) 00002000:00010000:1.0:1788361525.210996:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086e300 00000100:00100000:1.0:1788361525.211110:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 250 00000100:00100000:1.0:1788361525.211121:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+31:2349:x1875232130808064:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361525.218874:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.219221:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130808192 00000100:00100000:3.0:1788361525.219230:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130808192 00002000:00100000:3.0:1788361525.219279:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (11534336->12582911) req@ffff9a898af34a80 x1875232130808192/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.219290:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af34a80 with x1875232130808192 ext(11534336->12582911) 00002000:00010000:3.0:1788361525.219296:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af34a80 00000100:00100000:3.0:1788361525.219337:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 251 00000100:00100000:3.0:1788361525.219348:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+33:2349:x1875232130808192:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.220504:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:2349:x1875232130808064:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9371us (9657us total) trans 30064771244 rc 0/0 00000100:00100000:1.0:1788361525.220515:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 250 00002000:00100000:1.0:1788361525.220525:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (10485760->11534335) req@ffff9a8a9086e300 x1875232130808064/t30064771244(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.220534:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9086e300 with x1875232130808064 ext(10485760->11534335) 00002000:00010000:1.0:1788361525.220539:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9086e300 00000100:00100000:2.0:1788361525.229812:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:2349:x1875232130808192:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10456us (10937us total) trans 30064771245 rc 0/0 00000100:00100000:2.0:1788361525.229825:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 251 00002000:00100000:2.0:1788361525.229838:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (11534336->12582911) req@ffff9a898af34a80 x1875232130808192/t30064771245(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.229849:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af34a80 with x1875232130808192 ext(11534336->12582911) 00002000:00010000:2.0:1788361525.229855:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af34a80 00000100:00100000:2.0:1788361525.232388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.232480:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130808320 00000100:00100000:1.0:1788361525.232491:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130808320 00002000:00100000:1.0:1788361525.232614:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (12582912->13631487) req@ffff9a898af36a00 x1875232130808320/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.232638:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af36a00 with x1875232130808320 ext(12582912->13631487) 00002000:00010000:1.0:1788361525.232644:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af36a00 00000100:00100000:1.0:1788361525.232670:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 252 00000100:00100000:1.0:1788361525.232680:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+35:2350:x1875232130808320:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.240983:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+37:2350:x1875232130808320:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8294us (8593us total) trans 30064771246 rc 0/0 00000100:00100000:1.0:1788361525.240997:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 252 00002000:00100000:1.0:1788361525.241009:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (12582912->13631487) req@ffff9a898af36a00 x1875232130808320/t30064771246(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.241019:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af36a00 with x1875232130808320 ext(12582912->13631487) 00002000:00010000:1.0:1788361525.241025:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af36a00 00000100:00100000:2.0:1788361525.250310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.250403:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130808448 00000100:00100000:0.0:1788361525.250412:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130808448 00002000:00100000:0.0:1788361525.250455:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (13631488->14680063) req@ffff9a898af34700 x1875232130808448/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361525.250465:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af34700 with x1875232130808448 ext(13631488->14680063) 00002000:00010000:0.0:1788361525.250470:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af34700 00000100:00100000:0.0:1788361525.250562:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 253 00000100:00100000:0.0:1788361525.250572:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+37:2351:x1875232130808448:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.258235:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+39:2351:x1875232130808448:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7653us (7922us total) trans 30064771247 rc 0/0 00000100:00100000:1.0:1788361525.258250:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 253 00002000:00100000:1.0:1788361525.258263:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (13631488->14680063) req@ffff9a898af34700 x1875232130808448/t30064771247(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.258273:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af34700 with x1875232130808448 ext(13631488->14680063) 00002000:00010000:1.0:1788361525.258280:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af34700 00000100:00100000:2.0:1788361525.268271:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.268809:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130808576 00000100:00100000:0.0:1788361525.268819:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130808576 00002000:00100000:0.0:1788361525.268868:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (14680064->15728639) req@ffff9a898af37100 x1875232130808576/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361525.268878:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af37100 with x1875232130808576 ext(14680064->15728639) 00002000:00010000:0.0:1788361525.268884:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af37100 00000100:00100000:2.0:1788361525.269303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.269358:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130808832 00000100:00100000:1.0:1788361525.269364:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130808832 00000100:00100000:0.0:1788361525.269441:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 254 00000100:00100000:0.0:1788361525.269452:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130808576:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361525.269475:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:1.0:1788361525.269490:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:36570:x1875232130808832:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:1.0:1788361525.270189:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:36570:x1875232130808832:12345-192.168.203.60@tcp:35:dd.0 Request processed in 700us (884us total) trans 30064771398 rc 0/0 00000100:00100000:1.0:1788361525.270199:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:3.0:1788361525.275404:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+41:2349:x1875232130808576:12345-192.168.203.60@tcp:4:dd.0 Request processed in 5942us (7132us total) trans 30064771248 rc 0/0 00000100:00100000:3.0:1788361525.275419:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 254 00002000:00100000:3.0:1788361525.275443:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (14680064->15728639) req@ffff9a898af37100 x1875232130808576/t30064771248(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/448 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.275455:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898af37100 with x1875232130808576 ext(14680064->15728639) 00002000:00010000:3.0:1788361525.275462:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898af37100 00000040:00080000:2.0:1788361525.280328:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361525.280352:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361525.281030:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 10 00000040:00080000:2.0:1788361525.281042:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361525.292075:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.292195:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130808960 00000100:00100000:0.0:1788361525.292206:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130808960 00000100:00100000:0.0:1788361525.292268:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 369 00000100:00100000:0.0:1788361525.292289:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+36:36571:x1875232130808960:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:0.0:1788361525.292324:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361525.292344:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f8d lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8f7 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.292383:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615f94 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.292398:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615f94 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.292411:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615f94 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.292508:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e600/0xf6a94c97d6615f8d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8f7 expref: 38 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.292525:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573f400/0xf6a94c97d6615f94 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8f7 expref: 37 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.292533:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:0.0:1788361525.292535:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361525.292538:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8573f400, rc 0) 00000100:00100000:0.0:1788361525.292602:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+37:36571:x1875232130808960:12345-192.168.203.60@tcp:101:chown.0 Request processed in 325us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361525.292626:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 369 00000100:00100000:0.0:1788361525.296020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.296319:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130809216 00000100:00100000:3.0:1788361525.296331:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130809216 00000100:00100000:3.0:1788361525.296385:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 370 00000100:00100000:3.0:1788361525.296393:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+37:36571:x1875232130809216:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:3.0:1788361525.296447:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361525.296472:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615f4e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8db expref: 37 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.296493:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:3.0:1788361525.296497:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361525.296523:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.296535:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.296545:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361525.297517:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].13, 88 off9168 00000004:00080000:3.0:1788361525.297535:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 915312448581ns, next at 916312444594ns, rc = 0 00000004:00010000:3.0:1788361525.297629:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fef596ed reply state 000000001ddf82cd transno 30064771399 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361525.297653:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361525.297980:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+38:36571:x1875232130809216:12345-192.168.203.60@tcp:36:chown.0 Request processed in 1584us (1968us total) trans 30064771399 rc 0/0 00000100:00100000:3.0:1788361525.297990:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 370 00010000:00010000:0.0:1788361525.299624:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.299640:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.299649:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.299656:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361525.299660:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.299671:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.299698:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:0.0:1788361525.299702:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788361525.299707:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.299720:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615f9b lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x25:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361525.300226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.300400:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130809344 00000100:00100000:1.0:1788361525.300411:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130809344 00000100:00100000:1.0:1788361525.300492:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 371 00000100:00100000:1.0:1788361525.300502:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+37:36571:x1875232130809344:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:1.0:1788361525.300525:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361525.300543:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615fa2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f8fe expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.300602:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615fa2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8fe expref: 38 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.300617:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615fa2 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8fe expref: 38 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.300636:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:1.0:1788361525.300639:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361525.300642:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987623e00, rc 0) 00000100:00100000:1.0:1788361525.300758:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+38:36571:x1875232130809344:12345-192.168.203.60@tcp:101:chown.0 Request processed in 258us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361525.300765:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 371 00000100:00100000:2.0:1788361525.304026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.304130:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130809472 00000100:00100000:1.0:1788361525.304140:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130809472 00000100:00100000:1.0:1788361525.304205:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:1.0:1788361525.304239:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+38:2351:x1875232130809472:12345-192.168.203.60@tcp:2:chown.0 00002000:00010000:1.0:1788361525.304475:0:35982:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:1.0:1788361525.304483:0:35982:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb mtime from disk: 0 -> 1788361525 00002000:00010000:1.0:1788361525.304486:0:35982:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361525.304488:0:35982:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb ctime from disk: 0 -> 1788361525 00002000:00010000:1.0:1788361525.304490:0:35982:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788361525.304563:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:2351:x1875232130809472:12345-192.168.203.60@tcp:2:chown.0 Request processed in 327us (546us total) trans 30064771181 rc 0/0 00000100:00100000:1.0:1788361525.304570:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:2.0:1788361525.324349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.324546:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130809600 00000100:00100000:3.0:1788361525.324557:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130809600 00000100:00100000:3.0:1788361525.324618:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 372 00000100:00100000:3.0:1788361525.324628:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+38:36572:x1875232130809600:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:3.0:1788361525.324649:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361525.324668:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fa9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f905 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.324701:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615fb0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.324714:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615fb0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.324725:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615fb0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.324835:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fa9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f905 expref: 40 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.324856:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031c00/0xf6a94c97d6615fb0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f905 expref: 39 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.324864:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361525.324874:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361525.324878:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80031c00, rc 0) 00000100:00100000:3.0:1788361525.325006:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:36572:x1875232130809600:12345-192.168.203.60@tcp:101:chown.0 Request processed in 380us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361525.325013:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 372 00000100:00100000:0.0:1788361525.334321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.334589:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130809856 00000100:00100000:3.0:1788361525.334600:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130809856 00000100:00100000:3.0:1788361525.334652:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 373 00000100:00100000:3.0:1788361525.334660:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+39:36572:x1875232130809856:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:3.0:1788361525.334709:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361525.334733:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8573e800/0xf6a94c97d6615f78 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8e9 expref: 39 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.334751:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361525.334756:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361525.334782:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.334807:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.334815:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361525.335630:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].13, 88 off9240 00000004:00080000:3.0:1788361525.335641:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 915350554998ns, next at 916350552605ns, rc = 0 00000004:00010000:3.0:1788361525.335729:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000292d19e3 reply state 000000004a128d62 transno 30064771400 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361525.335749:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361525.335860:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+40:36572:x1875232130809856:12345-192.168.203.60@tcp:36:chown.0 Request processed in 1199us (1546us total) trans 30064771400 rc 0/0 00000100:00100000:3.0:1788361525.335868:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 373 00000100:00100000:2.0:1788361525.337938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.338013:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130809984 00000100:00100000:1.0:1788361525.338022:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130809984 00000100:00100000:1.0:1788361525.338078:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 374 00000100:00100000:1.0:1788361525.338120:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+40:36572:x1875232130809984:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:1.0:1788361525.338143:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361525.338163:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615fbe lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f90c expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.338224:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615fbe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f90c expref: 41 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.338238:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615fbe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f90c expref: 41 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.338258:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:1.0:1788361525.338261:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361525.338264:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622400, rc 0) 00000100:00100000:1.0:1788361525.338386:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+41:36572:x1875232130809984:12345-192.168.203.60@tcp:101:chown.0 Request processed in 299us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361525.338403:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 374 00010000:00010000:3.0:1788361525.339979:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.339993:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.340001:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.340007:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361525.340011:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.340019:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.340034:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361525.340037:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788361525.340041:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.340047:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fb7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x26:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361525.340319:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.340438:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130810112 00000100:00100000:3.0:1788361525.340447:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130810112 00000100:00100000:3.0:1788361525.340543:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:3.0:1788361525.340551:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+41:2350:x1875232130810112:12345-192.168.203.60@tcp:2:chown.0 00002000:00010000:3.0:1788361525.340735:0:36286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:3.0:1788361525.340739:0:36286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb mtime from disk: 0 -> 1788361525 00002000:00010000:3.0:1788361525.340741:0:36286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788361525.340743:0:36286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb ctime from disk: 0 -> 1788361526 00002000:00010000:3.0:1788361525.340745:0:36286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788361525.340855:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+42:2350:x1875232130810112:12345-192.168.203.60@tcp:2:chown.0 Request processed in 303us (538us total) trans 30064771249 rc 0/0 00000100:00100000:3.0:1788361525.340863:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:0.0:1788361525.382808:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.382923:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130810240 00000100:00100000:3.0:1788361525.382935:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130810240 00000100:00100000:3.0:1788361525.383122:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 375 00000100:00100000:3.0:1788361525.383133:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+40:36578:x1875232130810240:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361525.383154:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361525.383173:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f913 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.383240:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615fcc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.383254:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615fcc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.383318:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615fcc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361525.383376:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 512 00000004:00200000:3.0:1788361525.383387:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361525.383415:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615fcc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.383440:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6615fc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f913 expref: 42 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.383458:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030a00/0xf6a94c97d6615fcc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f913 expref: 41 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.383466:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361525.383469:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361525.383472:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80030a00, rc 0) 00000100:00100000:3.0:1788361525.383530:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+41:36578:x1875232130810240:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 398us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361525.383537:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 375 00000100:00100000:2.0:1788361525.385114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.385144:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130810368 00000100:00100000:3.0:1788361525.385152:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130810368 00000100:00100000:3.0:1788361525.385245:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 376 00000100:00100000:3.0:1788361525.385256:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+41:36578:x1875232130810368:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361525.385557:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361525.385571:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615fd3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f91a expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385614:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615fda lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385623:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615fda lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385643:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615fda lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385654:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615fe1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385659:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615fe1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385663:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615fe1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385737:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615fe8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385742:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615fe8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385746:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615fe8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361525.385764:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00000004:00200000:3.0:1788361525.385767:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361525.385778:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615fe8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385797:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615fe8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385814:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615fda lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385830:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615fda lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385837:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615fda lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385843:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361525.385847:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615fda lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385855:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615fda lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385864:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361525.385866:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361525.385869:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615fda lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385873:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6615fda lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385882:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615fe1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385886:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615fe1 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385889:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615fe1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385892:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361525.385898:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615fe1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385902:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615fe1 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385906:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff9a8a890fa300) 00010000:00010000:3.0:1788361525.385908:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361525.385909:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615fe1 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385914:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d6615fe1 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385943:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d6615fd3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f91a expref: 43 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385957:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615fe8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f91a expref: 42 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.385964:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:3.0:1788361525.385967:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361525.385969:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcbe00, rc 0) 00000100:00100000:3.0:1788361525.386014:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+42:36578:x1875232130810368:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 761us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361525.386021:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 376 00000100:00100000:0.0:1788361525.388252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.388301:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130810624 00000100:00100000:1.0:1788361525.388311:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130810624 00000100:00100000:1.0:1788361525.388361:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 377 00000100:00100000:1.0:1788361525.388370:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+42:36578:x1875232130810624:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:1.0:1788361525.388399:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361525.388426:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615fef lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f921 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.388520:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ff6 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.388532:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ff6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.388543:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ff6 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361525.388554:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00010000:00010000:1.0:1788361525.388822:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623a00/0xf6a94c97d6615fef lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f921 expref: 45 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.388841:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ff6 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f921 expref: 44 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.388849:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:1.0:1788361525.388852:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361525.388856:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8987622600, rc 0) 00000100:00100000:1.0:1788361525.388918:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+44:36578:x1875232130810624:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 550us (671us total) trans 30064771401 rc 0/0 00000100:00100000:1.0:1788361525.388925:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 377 00000100:00100000:0.0:1788361525.390889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.390938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.390986:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130811008 00000100:00100000:2.0:1788361525.390986:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130810752 00000100:00100000:3.0:1788361525.390993:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130811008 00000100:00100000:2.0:1788361525.390993:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130810752 00000100:00100000:2.0:1788361525.391052:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1788361525.391076:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 378 00000100:00100000:3.0:1788361525.391103:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+45:36578:x1875232130811008:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361525.391144:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788361525.391145:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+45:2351:x1875232130810752:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361525.391147:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1788361525.391157:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361525.391167:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623e00/0xf6a94c97d6615fa2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8fe expref: 45 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361525.391171:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622600/0xf6a94c97d6615ff6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f921 expref: 45 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361525.391184:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:2.0:1788361525.391188:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361525.391237:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d6615fe8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f91a expref: 43 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391248:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:3.0:1788361525.391251:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361525.391257:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+42:2351:x1875232130810752:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 198us (318us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361525.391262:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6616004 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f928 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361525.391276:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00010000:00010000:3.0:1788361525.391309:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661600b lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391322:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661600b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391331:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661600b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391345:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661600b lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391351:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661600b lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391357:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661600b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391373:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361525.391377:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661600b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391385:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661600b lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391394:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:3.0:1788361525.391397:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361525.391400:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661600b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391406:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d661600b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391428:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6616012 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391436:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6616012 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391443:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6616012 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391632:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6616012 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f928 expref: 44 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391640:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:3.0:1788361525.391643:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788361525.391652:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca400/0xf6a94c97d6616004 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f928 expref: 44 pid: 35346 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391677:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcac00/0xf6a94c97d6616012 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x25:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f928 expref: 43 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.391708:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:3.0:1788361525.391711:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788361525.391713:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a89bcac00, rc 0) 00000100:00100000:3.0:1788361525.391749:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+43:36578:x1875232130811008:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 666us (863us total) trans 30064771402 rc 0/0 00000100:00100000:3.0:1788361525.391756:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 378 00000100:00100000:0.0:1788361525.405926:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.406498:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130811136 00000100:00100000:1.0:1788361525.406508:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130811136 00002000:00100000:1.0:1788361525.406555:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff9a898764b100 x1875232130811136/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.406566:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898764b100 with x1875232130811136 ext(0->1048575) 00002000:00010000:1.0:1788361525.406572:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898764b100 00000100:00100000:1.0:1788361525.406636:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 255 00000100:00100000:1.0:1788361525.406646:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+39:2350:x1875232130811136:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361525.417420:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+39:2350:x1875232130811136:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 10764us (11494us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361525.417436:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 255 00002000:00100000:1.0:1788361525.417449:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (0->1048575) req@ffff9a898764b100 x1875232130811136/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.417461:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898764b100 with x1875232130811136 ext(0->1048575) 00002000:00010000:1.0:1788361525.417467:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898764b100 00000100:00100000:2.0:1788361525.429968:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.430034:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130811264 00000100:00100000:1.0:1788361525.430046:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130811264 00002000:00100000:1.0:1788361525.430115:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff9a89858ad180 x1875232130811264/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.430126:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858ad180 with x1875232130811264 ext(1048576->2097151) 00002000:00010000:1.0:1788361525.430132:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89858ad180 00000100:00100000:3.0:1788361525.430293:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 256 00000100:00100000:3.0:1788361525.430400:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2352:x1875232130811264:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361525.442047:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2352:x1875232130811264:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 11734us (12077us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361525.442071:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 256 00002000:00100000:1.0:1788361525.442112:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (1048576->2097151) req@ffff9a89858ad180 x1875232130811264/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.442123:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858ad180 with x1875232130811264 ext(1048576->2097151) 00002000:00010000:1.0:1788361525.442130:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89858ad180 00000100:00100000:0.0:1788361525.463637:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.463727:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.463889:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130811392 00000100:00100000:3.0:1788361525.463900:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130811392 00002000:00100000:3.0:1788361525.463946:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff9a898764b480 x1875232130811392/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.463957:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898764b480 with x1875232130811392 ext(2097152->3145727) 00002000:00010000:3.0:1788361525.463963:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898764b480 00000100:00100000:3.0:1788361525.463993:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130811520 00000100:00100000:3.0:1788361525.463997:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130811520 00002000:00100000:3.0:1788361525.464011:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff9a8987648000 x1875232130811520/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.464018:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987648000 with x1875232130811520 ext(3145728->4194303) 00002000:00010000:3.0:1788361525.464022:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987648000 00000100:00100000:3.0:1788361525.464046:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 257 00000100:00100000:3.0:1788361525.464073:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+40:2350:x1875232130811392:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361525.464149:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 258 00000100:00100000:2.0:1788361525.464275:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+41:2350:x1875232130811520:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361525.485150:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+41:2350:x1875232130811392:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 21069us (21512us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361525.485163:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 257 00002000:00100000:2.0:1788361525.485187:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (2097152->3145727) req@ffff9a898764b480 x1875232130811392/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.485197:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898764b480 with x1875232130811392 ext(2097152->3145727) 00002000:00010000:2.0:1788361525.485204:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898764b480 00000100:00100000:1.0:1788361525.491884:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+39:2350:x1875232130811520:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 27716us (28147us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361525.491897:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 258 00002000:00100000:1.0:1788361525.491908:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (3145728->4194303) req@ffff9a8987648000 x1875232130811520/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.491918:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987648000 with x1875232130811520 ext(3145728->4194303) 00002000:00010000:1.0:1788361525.491925:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987648000 00000100:00100000:0.0:1788361525.520905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.520943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.520973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.521006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.521121:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130811776 00000100:00100000:1.0:1788361525.521131:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130811776 00002000:00100000:1.0:1788361525.521178:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff9a8987648380 x1875232130811776/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.521189:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987648380 with x1875232130811776 ext(5242880->6291455) 00002000:00010000:1.0:1788361525.521195:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987648380 00000100:00100000:1.0:1788361525.521222:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130812032 00000100:00100000:1.0:1788361525.521225:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130812032 00002000:00100000:1.0:1788361525.521239:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff9a8987648e00 x1875232130812032/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.521247:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987648e00 with x1875232130812032 ext(7340032->8388607) 00002000:00010000:1.0:1788361525.521264:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987648e00 00000100:00100000:1.0:1788361525.521274:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130811648 00000100:00100000:1.0:1788361525.521278:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130811648 00002000:00100000:1.0:1788361525.521293:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff9a898764ad80 x1875232130811648/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1788361525.521310:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130811904 00000100:00100000:0.0:1788361525.521314:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130811904 00002000:00100000:1.0:1788361525.521315:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898764ad80 with x1875232130811648 ext(4194304->5242879) 00002000:00010000:1.0:1788361525.521318:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898764ad80 00000100:00100000:1.0:1788361525.521333:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 259 00002000:00100000:0.0:1788361525.521333:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff9a8987649180 x1875232130811904/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361525.521341:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987649180 with x1875232130811904 ext(6291456->7340031) 00000100:00100000:1.0:1788361525.521343:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+42:2349:x1875232130811776:12345-192.168.203.60@tcp:3:lfs.0 00002000:00010000:0.0:1788361525.521344:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987649180 00000100:00100000:2.0:1788361525.521351:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 260 00000100:00100000:2.0:1788361525.521365:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+42:2349:x1875232130812032:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:0.0:1788361525.523228:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 261 00000100:00100000:0.0:1788361525.523243:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130811648:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361525.530753:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130811776:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 9401us (9848us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361525.530767:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 259 00002000:00100000:3.0:1788361525.530779:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (5242880->6291455) req@ffff9a8987648380 x1875232130811776/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.530800:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987648380 with x1875232130811776 ext(5242880->6291455) 00002000:00010000:3.0:1788361525.530807:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987648380 00000100:00100000:3.0:1788361525.530841:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 262 00000100:00100000:3.0:1788361525.530853:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130811904:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361525.546567:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130812032:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 25196us (25613us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361525.546580:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 260 00002000:00100000:3.0:1788361525.546593:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (7340032->8388607) req@ffff9a8987648e00 x1875232130812032/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.546604:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987648e00 with x1875232130812032 ext(7340032->8388607) 00002000:00010000:3.0:1788361525.546610:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987648e00 00000100:00100000:0.0:1788361525.557005:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+41:2349:x1875232130811648:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 33757us (36020us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361525.557017:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 261 00002000:00100000:0.0:1788361525.557029:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xca:0x0] (4194304->5242879) req@ffff9a898764ad80 x1875232130811648/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361525.557039:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898764ad80 with x1875232130811648 ext(4194304->5242879) 00002000:00010000:0.0:1788361525.557045:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898764ad80 00000100:00100000:3.0:1788361525.566206:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130811904:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 35348us (45189us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361525.566221:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 262 00002000:00100000:3.0:1788361525.566234:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (6291456->7340031) req@ffff9a8987649180 x1875232130811904/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.566246:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987649180 with x1875232130811904 ext(6291456->7340031) 00002000:00010000:3.0:1788361525.566267:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987649180 00000100:00100000:0.0:1788361525.625035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.625181:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130812160 00000100:00100000:3.0:1788361525.625191:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130812160 00002000:00100000:3.0:1788361525.625242:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff9a8987648a80 x1875232130812160/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.625253:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987648a80 with x1875232130812160 ext(8388608->9437183) 00002000:00010000:3.0:1788361525.625259:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987648a80 00000100:00100000:3.0:1788361525.625294:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 263 00000100:00100000:3.0:1788361525.625304:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:2351:x1875232130812160:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361525.628406:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.628447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.628485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.628517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.628547:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130812416 00000100:00100000:1.0:1788361525.628557:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130812416 00002000:00100000:1.0:1788361525.628608:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff9a89859c8e00 x1875232130812416/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.628626:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c8e00 with x1875232130812416 ext(10485760->11534335) 00000100:00100000:3.0:1788361525.628627:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130812672 00000100:00100000:3.0:1788361525.628634:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130812672 00002000:00010000:1.0:1788361525.628636:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859c8e00 00000100:00100000:1.0:1788361525.628654:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130812928 00000100:00100000:1.0:1788361525.628658:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130812928 00002000:00100000:3.0:1788361525.628659:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff9a89859caa00 x1875232130812672/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.628670:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859caa00 with x1875232130812672 ext(12582912->13631487) 00002000:00010000:3.0:1788361525.628675:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859caa00 00002000:00100000:1.0:1788361525.628678:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff9a8ab7140e00 x1875232130812928/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361525.628688:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130812544 00000100:00100000:3.0:1788361525.628693:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130812544 00002000:00100000:1.0:1788361525.628700:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7140e00 with x1875232130812928 ext(14680064->15728639) 00002000:00010000:1.0:1788361525.628705:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7140e00 00002000:00100000:3.0:1788361525.628713:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff9a8ab7140380 x1875232130812544/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.628726:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7140380 with x1875232130812544 ext(11534336->12582911) 00002000:00010000:3.0:1788361525.628730:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7140380 00000100:00100000:1.0:1788361525.628740:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 264 00000100:00100000:3.0:1788361525.628748:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 265 00000100:00100000:1.0:1788361525.628753:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+44:2351:x1875232130812416:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361525.628764:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+44:2351:x1875232130812672:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361525.629533:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.629629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.629919:0:38206:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788361525.629928:0:38206:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1788361525.629976:0:35988:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1788361525.629986:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130812800 00000100:00100000:2.0:1788361525.629991:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130812800 00002000:00100000:2.0:1788361525.630020:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff9a8ab7140700 x1875232130812800/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.630029:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7140700 with x1875232130812800 ext(13631488->14680063) 00002000:00010000:2.0:1788361525.630034:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7140700 00000100:00100000:2.0:1788361525.630046:0:35988:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1788361525.630050:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130812288 00000100:00100000:2.0:1788361525.630053:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130812288 00002000:00100000:2.0:1788361525.630065:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff9a8ab7143480 x1875232130812288/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.630073:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7143480 with x1875232130812288 ext(9437184->10485759) 00002000:00010000:2.0:1788361525.630075:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7143480 00000100:00100000:0.0:1788361525.635375:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 266 00000100:00100000:0.0:1788361525.635388:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+48:2351:x1875232130812928:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361525.640331:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+48:2351:x1875232130812160:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 15017us (15293us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361525.640344:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 263 00002000:00100000:1.0:1788361525.640356:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (8388608->9437183) req@ffff9a8987648a80 x1875232130812160/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.640366:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987648a80 with x1875232130812160 ext(8388608->9437183) 00002000:00010000:1.0:1788361525.640373:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987648a80 00000100:00100000:1.0:1788361525.640402:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 267 00000100:00100000:1.0:1788361525.640413:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:2351:x1875232130812544:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361525.652897:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+47:2351:x1875232130812416:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 24135us (24493us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361525.652910:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 264 00002000:00100000:1.0:1788361525.652922:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (10485760->11534335) req@ffff9a89859c8e00 x1875232130812416/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.652934:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859c8e00 with x1875232130812416 ext(10485760->11534335) 00002000:00010000:1.0:1788361525.652941:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859c8e00 00000100:00100000:1.0:1788361525.652974:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 268 00000100:00100000:1.0:1788361525.652986:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+46:2351:x1875232130812800:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361525.660201:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+46:2351:x1875232130812672:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 31431us (31743us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361525.660227:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 265 00002000:00100000:3.0:1788361525.660241:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (12582912->13631487) req@ffff9a89859caa00 x1875232130812672/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.660252:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859caa00 with x1875232130812672 ext(12582912->13631487) 00002000:00010000:3.0:1788361525.660258:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859caa00 00000100:00100000:3.0:1788361525.660286:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 269 00000100:00100000:2.0:1788361525.662394:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+45:2352:x1875232130812288:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:0.0:1788361525.666626:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+45:2351:x1875232130812928:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 31229us (38129us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361525.666639:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 266 00002000:00100000:0.0:1788361525.666652:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xca:0x0] (14680064->15728639) req@ffff9a8ab7140e00 x1875232130812928/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361525.666663:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7140e00 with x1875232130812928 ext(14680064->15728639) 00002000:00010000:0.0:1788361525.666990:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7140e00 00010000:00010000:1.0:1788361525.667926:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361525.676284:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+43:2351:x1875232130812544:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 35865us (47757us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361525.676305:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 267 00002000:00100000:1.0:1788361525.676316:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xca:0x0] (11534336->12582911) req@ffff9a8ab7140380 x1875232130812544/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.676326:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7140380 with x1875232130812544 ext(11534336->12582911) 00002000:00010000:1.0:1788361525.676332:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7140380 00000100:00100000:1.0:1788361525.679217:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+41:2351:x1875232130812800:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 26225us (49674us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361525.679229:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 268 00002000:00100000:1.0:1788361525.679241:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xca:0x0] (13631488->14680063) req@ffff9a8ab7140700 x1875232130812800/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.679253:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7140700 with x1875232130812800 ext(13631488->14680063) 00002000:00010000:1.0:1788361525.679259:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7140700 00000100:00100000:2.0:1788361525.686862:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+39:2352:x1875232130812288:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 26558us (57220us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361525.686876:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 269 00002000:00100000:2.0:1788361525.686904:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xca:0x0] (9437184->10485759) req@ffff9a8ab7143480 x1875232130812288/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.686916:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7143480 with x1875232130812288 ext(9437184->10485759) 00002000:00010000:2.0:1788361525.686923:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7143480 00000100:00100000:2.0:1788361525.744737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.744820:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130813184 00000100:00100000:0.0:1788361525.744831:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130813184 00000100:00100000:0.0:1788361525.744895:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:0.0:1788361525.744906:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+43:36578:x1875232130813184:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:0.0:1788361525.745207:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+44:36578:x1875232130813184:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 302us (477us total) trans 30064771403 rc 0/0 00000100:00100000:0.0:1788361525.745215:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:3.0:1788361525.802214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.802317:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130813312 00000100:00100000:0.0:1788361525.802331:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130813312 00000100:00100000:0.0:1788361525.802394:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 379 00000100:00100000:0.0:1788361525.802403:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+44:36584:x1875232130813312:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:0.0:1788361525.802427:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361525.802454:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6616019 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f92f expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802539:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6616020 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802553:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6616020 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802569:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6616020 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802584:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6616027 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802592:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6616027 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802598:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6616027 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802700:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d661602e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802710:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d661602e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802733:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d661602e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361525.802761:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 15728640 00000004:00200000:0.0:1788361525.802765:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361525.802795:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d661602e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802816:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d661602e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802824:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6616020 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802829:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6616020 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802836:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6616020 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802841:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361525.802846:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6616020 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802853:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6616020 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802865:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361525.802875:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361525.802880:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6616020 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802886:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d6616020 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802900:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6616027 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802907:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6616027 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802919:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6616027 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802924:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361525.802927:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6616027 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802934:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6616027 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802943:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff9a8a90b43300) 00010000:00010000:0.0:1788361525.802946:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361525.802949:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6616027 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802955:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9200/0xf6a94c97d6616027 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.802987:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6616019 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f92f expref: 46 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.803001:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d661602e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f92f expref: 45 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.803009:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:0.0:1788361525.803011:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361525.803013:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8e00, rc 0) 00000100:00100000:0.0:1788361525.803243:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+45:36584:x1875232130813312:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 840us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361525.803260:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 379 00000100:00100000:2.0:1788361525.808620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.810029:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130813568 00000100:00100000:1.0:1788361525.810041:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130813568 00000100:00100000:1.0:1788361525.810181:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 380 00000100:00100000:1.0:1788361525.810192:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+45:36584:x1875232130813568:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:1.0:1788361525.810212:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361525.810232:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac131c000/0xf6a94c97d6616035 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f936 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.810341:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac131ca00/0xf6a94c97d661603c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.810357:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac131ca00/0xf6a94c97d661603c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.810381:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac131ca00/0xf6a94c97d661603c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361525.810393:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x26:0x0]: returning size 15728640 00010000:00010000:1.0:1788361525.810516:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac131c000/0xf6a94c97d6616035 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f936 expref: 48 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.810534:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac131ca00/0xf6a94c97d661603c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f936 expref: 47 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361525.810542:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:1.0:1788361525.810545:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361525.810549:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac131ca00, rc 0) 00000100:00100000:1.0:1788361525.810623:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+47:36584:x1875232130813568:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 433us (2013us total) trans 30064771404 rc 0/0 00000100:00100000:1.0:1788361525.810631:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 380 00000100:00100000:2.0:1788361525.814043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.816455:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130813952 00000100:00100000:3.0:1788361525.816472:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130813952 00000100:00100000:3.0:1788361525.816538:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 381 00000100:00100000:3.0:1788361525.816548:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:36584:x1875232130813952:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361525.816574:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361525.816578:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1788361525.816605:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987622400/0xf6a94c97d6615fbe lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f90c expref: 47 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.816627:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d661602e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f92f expref: 46 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.816638:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361525.816643:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361525.816663:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661604a lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f93d expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.816701:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6616051 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361525.816919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.816975:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130813696 00000100:00100000:0.0:1788361525.816981:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130813696 00000100:00100000:0.0:1788361525.817025:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1788361525.817033:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+47:2350:x1875232130813696:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361525.817043:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361525.817057:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac131ca00/0xf6a94c97d661603c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f936 expref: 47 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.817076:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6616051 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.817113:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6616051 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361525.817118:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:0.0:1788361525.817124:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361525.817132:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6616051 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.817141:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6616051 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.817149:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6616051 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.817155:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985965e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361525.817159:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6616051 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.817167:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6616051 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.817173:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361525.817176:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361525.817181:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6616051 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361525.817182:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+46:2350:x1875232130813696:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 146us (260us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361525.817191:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d6616051 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361525.817198:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00010000:00010000:3.0:1788361525.817216:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6616058 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.817229:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6616058 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.817234:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6616058 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.818997:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6616058 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f93d expref: 47 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.819011:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361525.819014:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788361525.819026:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661604a lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x26:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f93d expref: 47 pid: 35346 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.819041:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964600/0xf6a94c97d6616058 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x26:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f93d expref: 46 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361525.819074:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:3.0:1788361525.819077:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1788361525.819079:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985964600, rc 0) 00000100:00100000:3.0:1788361525.819239:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+46:36584:x1875232130813952:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 2692us (5202us total) trans 30064771405 rc 0/0 00000100:00100000:3.0:1788361525.819248:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 381 00000100:00100000:2.0:1788361525.837634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.837710:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130814080 00000100:00100000:3.0:1788361525.837836:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130814080 00002000:00100000:3.0:1788361525.837898:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff9a89858aed80 x1875232130814080/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.837928:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858aed80 with x1875232130814080 ext(0->1048575) 00002000:00010000:3.0:1788361525.837935:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89858aed80 00000100:00100000:3.0:1788361525.837972:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 270 00000100:00100000:3.0:1788361525.837982:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+42:2352:x1875232130814080:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:0.0:1788361525.856902:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+42:2352:x1875232130814080:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 18912us (19268us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361525.856916:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 270 00002000:00100000:0.0:1788361525.856929:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (0->1048575) req@ffff9a89858aed80 x1875232130814080/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361525.856940:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858aed80 with x1875232130814080 ext(0->1048575) 00002000:00010000:0.0:1788361525.856947:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89858aed80 00000100:00100000:3.0:1788361525.878794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.878917:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130814208 00000100:00100000:0.0:1788361525.878927:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130814208 00002000:00100000:0.0:1788361525.878976:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff9a89921c1180 x1875232130814208/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361525.879008:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c1180 with x1875232130814208 ext(1048576->2097151) 00002000:00010000:0.0:1788361525.879014:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c1180 00000100:00100000:0.0:1788361525.879124:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 271 00000100:00100000:0.0:1788361525.879147:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+42:2349:x1875232130814208:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361525.892562:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+42:2349:x1875232130814208:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 13416us (14462us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361525.892577:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 271 00002000:00100000:2.0:1788361525.892589:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (1048576->2097151) req@ffff9a89921c1180 x1875232130814208/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.892601:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c1180 with x1875232130814208 ext(1048576->2097151) 00002000:00010000:2.0:1788361525.892608:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c1180 00000100:00100000:2.0:1788361525.911184:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361525.911236:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.911331:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130814464 00000100:00100000:3.0:1788361525.911342:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130814464 00002000:00100000:3.0:1788361525.911389:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff9a89858ac380 x1875232130814464/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.911400:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858ac380 with x1875232130814464 ext(3145728->4194303) 00002000:00010000:3.0:1788361525.911406:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89858ac380 00000100:00100000:3.0:1788361525.911435:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130814336 00000100:00100000:3.0:1788361525.911438:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130814336 00002000:00100000:3.0:1788361525.911453:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff9a89858ace00 x1875232130814336/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.911460:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858ace00 with x1875232130814336 ext(2097152->3145727) 00002000:00010000:3.0:1788361525.911463:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89858ace00 00000100:00100000:3.0:1788361525.911494:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 272 00000100:00100000:3.0:1788361525.911503:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130814464:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361525.911972:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 273 00000100:00100000:1.0:1788361525.911985:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+44:2350:x1875232130814336:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361525.921598:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130814464:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 10087us (10415us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361525.921604:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+43:2350:x1875232130814336:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 9609us (10352us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361525.921611:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 272 00000100:00100000:1.0:1788361525.921619:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 273 00002000:00100000:2.0:1788361525.921623:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (3145728->4194303) req@ffff9a89858ac380 x1875232130814464/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.921629:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xca:0x0] (2097152->3145727) req@ffff9a89858ace00 x1875232130814336/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.921638:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858ac380 with x1875232130814464 ext(3145728->4194303) 00002000:00010000:2.0:1788361525.921647:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89858ac380 00002000:00100000:1.0:1788361525.921648:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858ace00 with x1875232130814336 ext(2097152->3145727) 00002000:00010000:1.0:1788361525.921662:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89858ace00 00000100:00100000:0.0:1788361525.963943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.963990:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361525.964112:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130814592 00000100:00100000:1.0:1788361525.964123:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130814592 00002000:00100000:1.0:1788361525.964173:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff9a8987649880 x1875232130814592/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.964185:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987649880 with x1875232130814592 ext(4194304->5242879) 00002000:00010000:1.0:1788361525.964191:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8987649880 00000100:00100000:1.0:1788361525.964295:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130814720 00000100:00100000:1.0:1788361525.964299:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130814720 00002000:00100000:1.0:1788361525.964317:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff9a898764a300 x1875232130814720/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.964326:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898764a300 with x1875232130814720 ext(5242880->6291455) 00002000:00010000:1.0:1788361525.964329:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898764a300 00000100:00100000:3.0:1788361525.964578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361525.966823:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130814976 00000100:00100000:0.0:1788361525.966836:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130814976 00002000:00100000:0.0:1788361525.966884:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff9a89921c1c00 x1875232130814976/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361525.966893:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 274 00002000:00100000:0.0:1788361525.966900:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c1c00 with x1875232130814976 ext(7340032->8388607) 00000100:00100000:3.0:1788361525.966907:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+44:2352:x1875232130814592:12345-192.168.203.60@tcp:3:lfs.0 00002000:00010000:0.0:1788361525.966907:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c1c00 00000100:00100000:0.0:1788361525.966936:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 275 00000100:00100000:0.0:1788361525.966945:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+44:2351:x1875232130814720:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361525.967480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361525.967793:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130814848 00000100:00100000:3.0:1788361525.967798:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130814848 00002000:00100000:3.0:1788361525.967822:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff9a89921c1880 x1875232130814848/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/0 e 0 to 0 dl 1788361536 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361525.967832:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c1880 with x1875232130814848 ext(6291456->7340031) 00002000:00010000:3.0:1788361525.967837:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c1880 00000100:00100000:3.0:1788361525.967851:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 276 00000100:00100000:3.0:1788361525.967858:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+47:2352:x1875232130814976:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361525.967973:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 277 00000100:00100000:2.0:1788361525.967985:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+48:2351:x1875232130814848:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361525.978505:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+48:2352:x1875232130814592:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 11590us (14562us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361525.978520:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 274 00002000:00100000:1.0:1788361525.978533:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xca:0x0] (4194304->5242879) req@ffff9a8987649880 x1875232130814592/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.978543:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987649880 with x1875232130814592 ext(4194304->5242879) 00002000:00010000:1.0:1788361525.978550:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8987649880 00000100:00100000:1.0:1788361525.982477:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+46:2351:x1875232130814720:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 15522us (18475us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361525.982491:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 275 00002000:00100000:1.0:1788361525.982504:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xca:0x0] (5242880->6291455) req@ffff9a898764a300 x1875232130814720/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361525.982515:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898764a300 with x1875232130814720 ext(5242880->6291455) 00002000:00010000:1.0:1788361525.982538:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898764a300 00000100:00100000:2.0:1788361525.991123:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+44:2352:x1875232130814976:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 23255us (26536us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361525.991138:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 276 00002000:00100000:2.0:1788361525.991153:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xca:0x0] (7340032->8388607) req@ffff9a89921c1c00 x1875232130814976/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.991164:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c1c00 with x1875232130814976 ext(7340032->8388607) 00002000:00010000:2.0:1788361525.991171:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c1c00 00000100:00100000:2.0:1788361525.994468:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+42:2351:x1875232130814848:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 26476us (26977us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361525.994483:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 277 00002000:00100000:2.0:1788361525.994497:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xca:0x0] (6291456->7340031) req@ffff9a89921c1880 x1875232130814848/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:586/0 lens 488/440 e 0 to 0 dl 1788361536 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361525.994507:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c1880 with x1875232130814848 ext(6291456->7340031) 00002000:00010000:2.0:1788361525.994514:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c1880 00000100:00100000:0.0:1788361526.012485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361526.014845:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130815232 00000100:00100000:1.0:1788361526.014856:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130815232 00000100:00100000:1.0:1788361526.014918:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788361526.014929:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88352050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+46:36584:x1875232130815232:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:1.0:1788361526.015196:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88352050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+47:36584:x1875232130815232:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 269us (2720us total) trans 30064771406 rc 0/0 00000100:00100000:1.0:1788361526.015204:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:0.0:1788361526.059721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361526.059818:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130815488 00000100:00100000:1.0:1788361526.059828:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130815488 00000100:00100000:1.0:1788361526.059886:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 382 00000100:00100000:1.0:1788361526.059896:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+47:36594:x1875232130815488:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361526.059919:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361526.059940:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d661605f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f944 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361526.060042:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 512 00010000:00010000:1.0:1788361526.060262:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d661605f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f944 expref: 49 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.060273:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:1.0:1788361526.060275:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361526.060278:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d661605f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f944 expref: 49 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.060289:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ea00, rc 0) 00000100:00100000:1.0:1788361526.060332:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+48:36594:x1875232130815488:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 438us (621us total) trans 30064771407 rc 301/301 00000100:00100000:1.0:1788361526.060348:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 382 00000100:00100000:3.0:1788361526.062717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361526.062765:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130815616 00000100:00100000:1.0:1788361526.062774:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130815616 00000100:00100000:1.0:1788361526.063262:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 383 00000100:00100000:1.0:1788361526.063273:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+48:36594:x1875232130815616:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:1.0:1788361526.063342:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661606d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063357:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661606d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063370:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661606d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063383:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616074 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063389:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616074 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063395:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616074 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063504:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063513:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063520:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361526.063569:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063581:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661606d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063588:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661606d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063594:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661606d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063599:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361526.063603:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661606d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063610:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661606d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063621:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361526.063624:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361526.063628:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661606d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063634:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661606d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063648:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616074 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063654:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616074 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063664:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616074 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063669:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361526.063672:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616074 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063689:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616074 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063697:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff9a8984a32100) 00010000:00010000:1.0:1788361526.063699:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361526.063702:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616074 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063707:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616074 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063726:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063732:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063737:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063742:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361526.063744:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063760:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063767:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:1.0:1788361526.063770:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361526.063773:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.063789:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d661607b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361526.063877:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+48:36594:x1875232130815616:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 606us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361526.063885:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 383 00000100:00100000:3.0:1788361526.065991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361526.067826:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130815872 00000100:00100000:2.0:1788361526.067841:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130815872 00000100:00100000:2.0:1788361526.067911:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788361526.067920:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+48:36594:x1875232130815872:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361526.068260:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+49:36594:x1875232130815872:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 341us (2276us total) trans 30064771408 rc 0/0 00000100:00100000:2.0:1788361526.068268:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1788361526.123042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361526.123247:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130816128 00000100:00100000:3.0:1788361526.123259:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130816128 00000100:00100000:3.0:1788361526.123321:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 384 00000100:00100000:3.0:1788361526.123331:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+49:36604:x1875232130816128:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361526.123355:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361526.123374:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6616082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f94b expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361526.123494:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8400/0xf6a94c97d6616089 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361526.123509:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8400/0xf6a94c97d6616089 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361526.123519:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8400/0xf6a94c97d6616089 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361526.123539:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x24:0x0]: returning size 512 00010000:00010000:3.0:1788361526.123684:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d6616082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f94b expref: 52 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361526.123703:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8400/0xf6a94c97d6616089 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f94b expref: 51 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361526.123712:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:3.0:1788361526.123716:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788361526.123724:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8400, rc 0) 00000100:00100000:3.0:1788361526.123813:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+51:36604:x1875232130816128:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 476us (772us total) trans 30064771409 rc 0/0 00000100:00100000:3.0:1788361526.123829:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 384 00000100:00100000:3.0:1788361526.127330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361526.127466:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130816256 00000100:00100000:1.0:1788361526.127476:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130816256 00000100:00100000:1.0:1788361526.127534:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 385 00000100:00100000:1.0:1788361526.127545:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+51:36604:x1875232130816256:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:1.0:1788361526.127616:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616097 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127634:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616097 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127646:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616097 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127661:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661609e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127686:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661609e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127693:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661609e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127803:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127823:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127831:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361526.127873:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127886:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616097 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127893:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616097 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127900:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616097 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127908:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361526.127912:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616097 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127919:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616097 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127938:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:1.0:1788361526.127942:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361526.127946:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616097 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127953:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d6616097 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127968:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661609e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127974:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661609e lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127981:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661609e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127987:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1e000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361526.127990:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661609e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.127997:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661609e lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.128004:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0xdee864c2 (ffff9a8984a32100) 00010000:00010000:1.0:1788361526.128007:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361526.128010:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661609e lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.128016:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d661609e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0xdee864c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.128059:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.128066:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.128073:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.128079:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361526.128117:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.128126:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.128135:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x26:0x0].0x0 (ffff9a8a90b43b00) 00010000:00010000:1.0:1788361526.128137:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361526.128141:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.128580:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d66160a5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x26:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361526.128666:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+51:36604:x1875232130816256:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1120us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361526.128675:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 385 00000100:00100000:1.0:1788361526.179622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361526.179730:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130816384 00000100:00100000:0.0:1788361526.179739:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130816384 00000100:00100000:0.0:1788361526.179839:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 386 00000100:00100000:0.0:1788361526.179849:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+51:36610:x1875232130816384:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361526.179866:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361526.179884:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d66160ac lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f952 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.179962:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66160b3 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.179978:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66160b3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.179990:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66160b3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180002:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66160ba lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180009:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66160ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180015:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66160ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180145:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66160c1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180153:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66160c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180159:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66160c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361526.180188:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00000004:00200000:0.0:1788361526.180191:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361526.180207:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66160c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180228:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66160c1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180236:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66160b3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180243:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66160b3 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180248:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66160b3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180255:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361526.180258:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66160b3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180265:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66160b3 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180277:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x0 (ffff9a8a90b43e00) 00010000:00010000:0.0:1788361526.180279:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361526.180283:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66160b3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180289:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66160b3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180310:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66160ba lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180316:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66160ba lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180327:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66160ba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180332:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361526.180335:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66160ba lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180342:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66160ba lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180356:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x24:0x0].0x852f64c2 (ffff9a8a90b43300) 00010000:00010000:0.0:1788361526.180358:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361526.180361:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66160ba lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180367:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66160ba lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x24:0x0].0x852f64c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180401:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d66160ac lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f952 expref: 53 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180416:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44200/0xf6a94c97d66160c1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f952 expref: 52 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.180423:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:0.0:1788361526.180428:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361526.180430:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44200, rc 0) 00000100:00100000:0.0:1788361526.180492:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+52:36610:x1875232130816384:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 644us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361526.180506:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 386 00000100:00100000:2.0:1788361526.186021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361526.186184:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130816640 00000100:00100000:0.0:1788361526.186195:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130816640 00000100:00100000:0.0:1788361526.186254:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 387 00000100:00100000:0.0:1788361526.186263:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+52:36610:x1875232130816640:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361526.186284:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361526.186304:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160c8 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f959 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.186406:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160cf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.186420:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160cf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.186431:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160cf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361526.186440:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x25:0x0]: returning size 15728640 00010000:00010000:0.0:1788361526.186565:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160c8 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x24:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f959 expref: 55 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.186582:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160cf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f959 expref: 54 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361526.186591:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:0.0:1788361526.186594:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361526.186597:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45400, rc 0) 00000100:00100000:0.0:1788361526.186718:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+54:36610:x1875232130816640:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 455us (706us total) trans 30064771410 rc 0/0 00000100:00100000:0.0:1788361526.186726:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 387 00000100:00100000:3.0:1788361526.190408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361526.190641:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361526.190726:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130817024 00000100:00100000:1.0:1788361526.190736:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130817024 00000100:00100000:2.0:1788361526.190746:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130816896 00000100:00100000:2.0:1788361526.190750:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130816896 00000100:00100000:2.0:1788361526.190823:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:2.0:1788361526.190833:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:36610:x1875232130816896:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788361526.190850:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:1.0:1788361526.190857:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130817024:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361526.190870:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361526.190892:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160cf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f959 expref: 55 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361526.190908:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x25:0x0].0x0 (ffff9a8984a32c00) 00010000:00010000:1.0:1788361526.190912:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361526.190964:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+54:2352:x1875232130817024:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 107us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361526.190971:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000001:00080000:2.0:1788361526.191132:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771411 00000100:00100000:2.0:1788361526.191222:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:36610:x1875232130816896:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 391us (1081us total) trans 30064771412 rc 0/0 00000100:00100000:2.0:1788361526.191230:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000020:00080000:2.0:1788361526.191234:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788361526.432427:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361526.432516:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361526.432538:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144236160:0@lo:400:kworker.0 00000100:00100000:3.0:1788361526.432609:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361526.432689:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144236032:0@lo:400:kworker.0 00000100:00100000:3.0:1788361526.432718:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361526.432751:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361526.432756:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144235904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361526.432788:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361526.432817:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144236032 00000100:00100000:3.0:1788361526.432828:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144236032 00000100:00100000:3.0:1788361526.432878:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144235904 00000100:00100000:3.0:1788361526.432881:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144235904 00000100:00100000:3.0:1788361526.432904:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361526.432927:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144236032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361526.432982:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144236032:12345-0@lo:400:kworker.0 Request processed in 56us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361526.432989:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788361526.433005:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788361526.433010:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144235904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361526.433037:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144235904:12345-0@lo:400:kworker.0 Request processed in 27us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361526.433042:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788361526.433121:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144235904:0@lo:400:kworker.0 00000100:00100000:3.0:1788361526.433131:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771222 gen 2 00000004:00080000:3.0:1788361526.433136:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771222 committed transno 30064771222 00000100:00100000:3.0:1788361526.433155:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144236032:0@lo:400:kworker.0 00000100:00100000:3.0:1788361526.433175:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144236288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361526.433198:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361526.433231:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144236288 00000100:00100000:3.0:1788361526.433235:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144236288 00000100:00100000:3.0:1788361526.433258:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788361526.433264:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144236288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361526.433279:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 1703936 granted 308346880 pending 25559040 free 3741319168 avail 3739222016 00000100:00100000:3.0:1788361526.433312:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144236288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361526.433317:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788361526.433343:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7143b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144236288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361526.433370:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144236160 00000100:00100000:3.0:1788361526.433374:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144236160 00000100:00100000:3.0:1788361526.433399:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788361526.433405:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144236160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361526.433439:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144236160:12345-0@lo:400:kworker.0 Request processed in 34us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361526.433445:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788361526.433468:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144236160:0@lo:400:kworker.0 00000100:00080000:3.0:1788361526.433500:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361526.433504:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361526.433674:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144235776:0@lo:400:kworker.0 00000100:00100000:2.0:1788361526.433706:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361526.433938:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144236544:0@lo:400:kworker.0 00000100:00100000:0.0:1788361526.433966:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361526.433984:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361526.433989:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144236416:0@lo:400:kworker.0 00000100:00100000:0.0:1788361526.434010:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361526.434032:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144236544 00000100:00100000:0.0:1788361526.434035:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144236544 00000100:00100000:0.0:1788361526.434069:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144236416 00000100:00100000:0.0:1788361526.434072:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144236416 00000100:00100000:0.0:1788361526.434108:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788361526.434115:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144236544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361526.434150:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144236544:12345-0@lo:400:kworker.0 Request processed in 35us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361526.434157:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788361526.434171:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788361526.434177:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144236416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361526.434218:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144236416:12345-0@lo:400:kworker.0 Request processed in 41us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361526.434224:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788361526.434238:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361526.434254:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144236416:0@lo:400:kworker.0 00000100:00100000:0.0:1788361526.434262:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144236544:0@lo:400:kworker.0 00000100:00100000:3.0:1788361526.434467:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144235776 00000100:00100000:3.0:1788361526.434472:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144235776 00000100:00100000:3.0:1788361526.434542:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788361526.434550:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144235776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361526.434595:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144235776:12345-0@lo:400:kworker.0 Request processed in 46us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361526.434602:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000004:00080000:1.0:1788361526.434628:0:35370:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 916449540587ns, next at 917449537817ns, rc = 0 00000100:00100000:0.0:1788361526.434667:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144235776:0@lo:400:kworker.0 00010000:00010000:3.0:1788361526.693412:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788361526.945446:0:35368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 916960357898ns, next at 917960355970ns, rc = 0 00000100:00100000:3.0:1788361526.945503:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361526.945524:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144236672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361526.945594:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361526.945704:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144236672 00000100:00100000:2.0:1788361526.945712:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144236672 00000100:00100000:2.0:1788361526.945767:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788361526.945786:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144236672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361526.945820:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 204406784 pending 25559040 free 3804233728 avail 3802136576 00000100:00100000:2.0:1788361526.945890:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144236672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361526.945899:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788361526.946020:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144236672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788361527.713337:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361528.456186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361528.456287:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130817152 00000100:00100000:1.0:1788361528.456299:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130817152 00002000:00100000:1.0:1788361528.456370:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (42811392->42991615) req@ffff9a898b067100 x1875232130817152/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:589/0 lens 488/0 e 0 to 0 dl 1788361539 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361528.456382:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b067100 with x1875232130817152 ext(42811392->42991615) 00002000:00010000:1.0:1788361528.456389:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b067100 00000100:00100000:1.0:1788361528.456422:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 278 00000100:00100000:1.0:1788361528.456434:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+42:2352:x1875232130817152:12345-192.168.203.60@tcp:4:dd.0 00000100:00080000:3.0:1788361528.456772:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361528.456880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361528.457035:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130817280 00000100:00100000:3.0:1788361528.457040:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130817280 00000100:00100000:3.0:1788361528.457065:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:3.0:1788361528.457082:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130817280:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361528.457142:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130817280:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361528.457149:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:2.0:1788361528.457242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361528.457323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361528.457350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361528.457374:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130817408 00000100:00100000:2.0:1788361528.457378:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130817408 00000100:00100000:2.0:1788361528.457426:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130817664 00000100:00100000:2.0:1788361528.457430:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130817664 00000100:00100000:2.0:1788361528.457453:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:2.0:1788361528.457460:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130817408:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361528.457503:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130817408:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 43us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361528.457510:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:2.0:1788361528.457525:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:2.0:1788361528.457532:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130817664:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361528.457556:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992067b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130817664:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361528.457562:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00080000:2.0:1788361528.457587:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361528.457688:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130817536 00000100:00100000:3.0:1788361528.457692:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130817536 00000100:00100000:3.0:1788361528.457735:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:3.0:1788361528.457742:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2351:x1875232130817536:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361528.457784:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:2351:x1875232130817536:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 43us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361528.457803:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00080000:2.0:1788361528.459117:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361528.462263:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+44:2352:x1875232130817152:12345-192.168.203.60@tcp:4:dd.0 Request processed in 5823us (6078us total) trans 30064771250 rc 0/0 00000100:00100000:2.0:1788361528.462280:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 278 00002000:00100000:2.0:1788361528.462294:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xc6:0x0] (42811392->42991615) req@ffff9a898b067100 x1875232130817152/t30064771250(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:589/0 lens 488/448 e 0 to 0 dl 1788361539 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361528.462305:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898b067100 with x1875232130817152 ext(42811392->42991615) 00002000:00010000:2.0:1788361528.462311:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898b067100 00000001:00080000:1.0:1788361528.531346:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771410 is committed 00000004:00080000:1.0:1788361528.531366:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 12 committed 00000004:00080000:1.0:1788361528.531395:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 13 committed 00000001:00080000:1.0:1788361528.531415:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771412 is committed 00000020:00080000:1.0:1788361528.531423:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803904 batchid updated 00000004:00080000:1.0:1788361528.531441:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000004:00080000:1.0:1788361528.531446:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 12 committed 00000020:00080000:1.0:1788361528.531537:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000020:00080000:1.0:1788361528.531545:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000100:00100000:1.0:1788361528.531561:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144236800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788361528.531622:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361528.531694:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144236800 00000100:00100000:1.0:1788361528.531701:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144236800 00000100:00100000:1.0:1788361528.531751:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788361528.531759:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144236800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788361528.531944:0:36286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:1.0:1788361528.531947:0:36286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb mtime from disk: 1788361525 -> 1788361525 00002000:00010000:1.0:1788361528.531950:0:36286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361528.531952:0:36286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb ctime from disk: 1788361526 -> 1788361526 00002000:00010000:1.0:1788361528.531955:0:36286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xca:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:1.0:1788361528.531991:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144236800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 232us (369us total) trans 30064771251 rc 0/0 00000100:00100000:1.0:1788361528.531998:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788361528.532017:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361528.532194:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144236928:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788361528.532221:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361528.532251:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144236928 00000100:00100000:0.0:1788361528.532255:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144236928 00000100:00100000:0.0:1788361528.532284:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788361528.532290:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144236928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788361528.532366:0:35983:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:0.0:1788361528.532369:0:35983:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb mtime from disk: 1788361525 -> 1788361525 00002000:00010000:0.0:1788361528.532372:0:35983:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788361528.532374:0:35983:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb ctime from disk: 1788361525 -> 1788361525 00002000:00010000:0.0:1788361528.532377:0:35983:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xca:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788361528.532403:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144236928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (181us total) trans 30064771182 rc 0/0 00000100:00100000:0.0:1788361528.532409:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1788361528.532424:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788361528.532448:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8aa9cf1c00/2, rc 0, transno 30064771182 00000100:00100000:0.0:1788361528.532454:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144236928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1788361528.532523:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ab7141880/2, rc 0, transno 30064771251 00000100:00100000:1.0:1788361528.532528:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7141880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144236800:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1788361528.549235:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771247 is committed 00000001:00080000:1.0:1788361528.549302:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771250 is committed 00010000:00010000:1.0:1788361528.736425:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361529.010390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361529.010520:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130817792 00000100:00100000:0.0:1788361529.010592:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130817792 00000100:00100000:0.0:1788361529.010702:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 388 00000100:00100000:0.0:1788361529.010713:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+35:36553:x1875232130817792:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788361529.010827:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+35:36553:x1875232130817792:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 115us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361529.010834:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 388 00000100:00100000:3.0:1788361529.013839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361529.014047:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130818048 00000100:00100000:0.0:1788361529.014069:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130818048 00000100:00100000:1.0:1788361529.014313:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1788361529.014324:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:36553:x1875232130818048:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788361529.014882:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+36:36553:x1875232130818048:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 559us (1050us total) trans 30064771413 rc 0/0 00000100:00100000:1.0:1788361529.014890:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:3.0:1788361529.152190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361529.152323:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130818176 00000100:00100000:2.0:1788361529.152333:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130818176 00000100:00100000:2.0:1788361529.152402:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 389 00000100:00100000:2.0:1788361529.152413:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:37049:x1875232130818176:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:2.0:1788361529.152453:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361529.152475:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d66160dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f960 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361529.152548:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361529.152561:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361529.152574:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361529.152785:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1788361529.152790:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 17 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361529.153660:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361529.153695:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d66160dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f960 expref: 7 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361529.153719:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f960 expref: 6 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361529.153728:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:2.0:1788361529.153731:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361529.153735:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cfa00, rc 0) 00000100:00100000:2.0:1788361529.153883:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:37049:x1875232130818176:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 1470us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361529.153891:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 389 00000001:00080000:3.0:1788361529.576787:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771182 is committed 00000001:00080000:3.0:1788361529.576800:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771180 is committed 00000001:00080000:3.0:1788361529.576809:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771181 is committed 00010000:00010000:3.0:1788361529.762115:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361530.788926:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361531.026487:0:39000:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10d: Test RO-PCC with group quota on loop PCC device ========================================================== 11:05:30 (1788361530) 00000040:00080000:2.0:1788361531.424342:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361531.424352:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361531.425470:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 8 00000040:00080000:2.0:1788361531.425480:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361531.552350:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144237184:0@lo:400:kworker.0 00000100:00100000:2.0:1788361531.552361:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8987649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144237440:0@lo:400:kworker.0 00000100:00100000:2.0:1788361531.552476:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361531.552543:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144237056:0@lo:400:kworker.0 00000100:00100000:0.0:1788361531.552546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361531.552558:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144237440 00000100:00100000:2.0:1788361531.552566:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144237440 00000100:00100000:0.0:1788361531.552586:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898afded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144237696:0@lo:400:kworker.0 00000100:00100000:1.0:1788361531.552594:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361531.552621:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788361531.552627:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361531.552635:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898afdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144237568:0@lo:400:kworker.0 00000100:00100000:2.0:1788361531.552637:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144237440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361531.552653:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361531.552662:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144237312:0@lo:400:kworker.0 00000100:00100000:1.0:1788361531.552673:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361531.552701:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361531.552714:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992067800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144237440:12345-0@lo:400:kworker.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361531.552721:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144237184 00000100:00100000:2.0:1788361531.552723:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788361531.552726:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144237184 00000100:00100000:0.0:1788361531.552740:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144237696 00000100:00100000:0.0:1788361531.552759:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144237696 00000100:00100000:1.0:1788361531.552780:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144237312 00000100:00100000:1.0:1788361531.552784:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144237312 00000100:00100000:0.0:1788361531.552811:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144237568 00000100:00100000:1.0:1788361531.552817:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361531.552817:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144237568 00000100:00100000:0.0:1788361531.552841:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788361531.552847:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144237696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361531.552891:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144237696:12345-0@lo:400:kworker.0 Request processed in 44us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361531.552898:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788361531.552911:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788361531.552916:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144237568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361531.552945:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144237568:12345-0@lo:400:kworker.0 Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361531.552950:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1788361531.552968:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361531.552972:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361531.552974:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361531.553216:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144237184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361531.553250:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144237184:12345-0@lo:400:kworker.0 Request processed in 38us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361531.553273:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788361531.553292:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788361531.553297:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144237312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361531.553335:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144237312:12345-0@lo:400:kworker.0 Request processed in 42us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361531.553342:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788361531.553355:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144237056 00000100:00100000:3.0:1788361531.553361:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144237056 00000100:00100000:1.0:1788361531.553384:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144237824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361531.553398:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898afdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144237568:0@lo:400:kworker.0 00000100:00100000:3.0:1788361531.553413:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788361531.553419:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361531.553427:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144237056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361531.553438:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144237312:0@lo:400:kworker.0 00000100:00100000:1.0:1788361531.553486:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8987649c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144237440:0@lo:400:kworker.0 00000100:00100000:1.0:1788361531.553512:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144237824 00000100:00100000:1.0:1788361531.553515:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144237824 00000100:00100000:1.0:1788361531.553539:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788361531.553545:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144237824:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361531.553560:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771182 gen 2 00000004:00080000:0.0:1788361531.553567:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8aa9cf1c00, transno 30064771182 00002000:00000024:1.0:1788361531.553580:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 284491776 pending 0 free 3725590528 avail 3723493376 00000100:00100000:0.0:1788361531.553582:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144237184:0@lo:400:kworker.0 00000100:00100000:1.0:1788361531.556985:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144237824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3430us (3560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361531.556999:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788361531.557197:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7140000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144237824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361531.557408:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144237056:12345-0@lo:400:kworker.0 Request processed in 3983us (4815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361531.557419:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788361531.557542:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898afded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144237696:0@lo:400:kworker.0 00000100:00100000:2.0:1788361531.560041:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144237056:0@lo:400:kworker.0 00010000:00010000:1.0:1788361531.808529:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361531.983876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361531.984247:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130818432 00000100:00100000:0.0:1788361531.984258:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130818432 00000100:00100000:0.0:1788361531.984340:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 390 00000100:00100000:0.0:1788361531.984349:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+36:37334:x1875232130818432:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361531.984449:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361531.984469:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66160eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f967 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.984545:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.984562:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.984574:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.984607:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.984615:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.984622:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361531.985215:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788361531.985677:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616100 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985689:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616100 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985697:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616100 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361531.985708:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788361531.985869:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985878:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985885:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985891:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361531.985895:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985911:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985925:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:0.0:1788361531.985928:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361531.985932:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985938:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66160f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985950:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985956:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985961:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985965:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361531.985968:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985974:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985980:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a890c3800) 00010000:00010000:0.0:1788361531.985982:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361531.985985:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.985998:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66160f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.986590:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66160eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f967 expref: 39 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.986607:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616100 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f967 expref: 38 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361531.986616:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:0.0:1788361531.986618:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361531.986620:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45200, rc 0) 00000100:00100000:0.0:1788361531.986696:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+38:37334:x1875232130818432:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2347us (2828us total) trans 30064771414 rc 0/0 00000100:00100000:0.0:1788361531.986705:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 390 00000100:00100000:3.0:1788361531.990980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361531.992168:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130818560 00000100:00100000:2.0:1788361531.992180:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130818560 00000100:00100000:2.0:1788361531.992278:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:2.0:1788361531.992287:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+38:2351:x1875232130818560:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361531.992302:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361531.992324:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616100 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f967 expref: 38 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361531.992346:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361531.992350:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361531.992405:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:2351:x1875232130818560:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 119us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361531.992425:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1788361531.992973:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361531.993016:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130818688 00000100:00100000:2.0:1788361531.993022:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130818688 00000100:00100000:2.0:1788361531.993062:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 391 00000100:00100000:2.0:1788361531.993070:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:37334:x1875232130818688:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788361531.993166:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:37334:x1875232130818688:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 96us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361531.993173:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 391 00000100:00100000:1.0:1788361532.064454:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8992065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144237952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361532.064524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361532.064712:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144237952 00000100:00100000:3.0:1788361532.064720:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144237952 00000100:00100000:3.0:1788361532.064783:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788361532.064793:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144237952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361532.064831:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 178847744 pending 0 free 3788505088 avail 3786407936 00000100:00100000:3.0:1788361532.067063:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144237952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2263us (2530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361532.067076:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788361532.070199:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8992065500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144237952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361532.095462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.095575:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130818944 00000100:00100000:2.0:1788361532.095585:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130818944 00000100:00100000:2.0:1788361532.095680:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 392 00000100:00100000:2.0:1788361532.095690:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+37:37349:x1875232130818944:12345-192.168.203.60@tcp:36:mkdir.0 00010000:00010000:2.0:1788361532.095757:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361532.095782:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8987623600/0xf6a94c97d6615f16 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f8cd expref: 37 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.095813:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:2.0:1788361532.095818:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361532.096172:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.096187:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f960 expref: 5 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.096196:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.096239:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f960 expref: 5 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.096254:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f960 expref: 5 pid: 35345 timeout: 1022 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361532.096269:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8992066d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144238080:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361532.096367:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8abcce7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361532.098295:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8992066d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144238080:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361532.098320:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361532.098772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.099138:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130819072 00000100:00100000:2.0:1788361532.099145:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130819072 00010000:00010000:2.0:1788361532.099198:0:38408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f960 expref: 6 pid: 35345 timeout: 1022 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361532.099234:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1788361532.099244:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89810c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130819072:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361532.099257:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361532.099264:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f960 expref: 6 pid: 35345 timeout: 1022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.099275:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f960 expref: 6 pid: 35345 timeout: 1022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.099316:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d66160e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f960 expref: 6 pid: 35345 timeout: 1022 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.099334:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:2.0:1788361532.099338:0:38408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.099347:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.099354:0:38408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.099386:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361532.099438:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89810c7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130819072:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 195us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361532.099446:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00080000:0.0:1788361532.099528:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361532.099583:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.099592:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.099613:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.099623:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.099631:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361532.101074:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 512 00010000:00010000:1.0:1788361532.101117:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.101135:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.101142:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.101148:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361532.101152:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.101160:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.101171:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:1.0:1788361532.101174:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361532.101178:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.101183:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d661610e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361532.101208:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000584dfbdf reply state 000000005b8228a9 transno 30064771415 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361532.101216:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361532.101289:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+38:37349:x1875232130818944:12345-192.168.203.60@tcp:36:mkdir.0 Request processed in 5599us (5834us total) trans 30064771415 rc 0/0 00000100:00100000:1.0:1788361532.101297:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 392 00010000:00010000:2.0:1788361532.105869:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.105886:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.105893:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.105900:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361532.105904:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.105929:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.105945:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff9a8984a32100) 00010000:00010000:2.0:1788361532.105948:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361532.105952:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.105958:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d6616115 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361532.109347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.109563:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130819200 00000100:00100000:0.0:1788361532.109573:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130819200 00000100:00100000:0.0:1788361532.109663:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 393 00000100:00100000:0.0:1788361532.109674:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+37:37350:x1875232130819200:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361532.109709:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361532.109731:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d661611c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f96e expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.109816:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616123 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.109845:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.109857:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361532.109921:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1788361532.109925:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361532.109951:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616123 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.109976:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d661611c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f96e expref: 39 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.109995:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616123 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f96e expref: 38 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.110004:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361532.110007:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361532.110010:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45400, rc 0) 00000100:00100000:0.0:1788361532.110074:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+38:37350:x1875232130819200:12345-192.168.203.60@tcp:101:dd.0 Request processed in 401us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361532.110081:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 393 00000100:00100000:0.0:1788361532.114054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.114210:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130819328 00000100:00100000:1.0:1788361532.114221:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130819328 00000100:00100000:1.0:1788361532.114307:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 394 00000100:00100000:1.0:1788361532.114317:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+38:37350:x1875232130819328:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361532.114336:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361532.114355:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661612a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f975 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.115009:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6616131 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.115025:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6616131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.115035:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6616131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.115049:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6616138 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.115056:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6616138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.115063:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6616138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.115702:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661613f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.115712:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661613f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.115734:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661613f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361532.115836:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 512 00000004:00200000:0.0:1788361532.115839:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361532.115861:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661613f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.115873:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6616131 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.115879:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6616131 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.115886:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6616131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.115892:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1ea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361532.115896:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6616131 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.115903:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6616131 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.115996:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361532.116000:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361532.116004:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6616131 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116010:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1ea00/0xf6a94c97d6616131 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116032:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6616138 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116038:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6616138 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116044:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6616138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116049:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361532.116052:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6616138 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116058:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6616138 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116066:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x876d8c0 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361532.116069:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361532.116071:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6616138 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116077:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f600/0xf6a94c97d6616138 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x876d8c0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116373:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e600/0xf6a94c97d661612a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f975 expref: 40 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116457:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45a00/0xf6a94c97d661613f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f975 expref: 39 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.116478:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:0.0:1788361532.116480:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788361532.116483:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45a00, rc 0) 00000100:00100000:0.0:1788361532.116663:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+39:37350:x1875232130819328:12345-192.168.203.60@tcp:101:dd.0 Request processed in 2345us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361532.116672:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 394 00000100:00100000:3.0:1788361532.118766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.118880:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130819584 00000100:00100000:1.0:1788361532.118889:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130819584 00000100:00100000:1.0:1788361532.119001:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 395 00000100:00100000:1.0:1788361532.119012:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+39:37350:x1875232130819584:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361532.119031:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361532.119051:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6616146 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f97c expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.119233:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661614d lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.119247:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661614d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.119257:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661614d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.119271:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.119277:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.119284:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361532.119794:0:35347:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcb:0x0], index 0: 0 00010000:00010000:1.0:1788361532.119946:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661615b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.119956:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661615b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.119964:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661615b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.119997:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661614d lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.120016:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661614d lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.120023:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661614d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.120029:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1fe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361532.120033:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661614d lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.120040:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661614d lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.120052:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:1.0:1788361532.120055:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361532.120059:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661614d lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.120065:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1fe00/0xf6a94c97d661614d lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361532.120079:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ee59f4b reply state 00000000a6d811e1 transno 30064771416 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361532.120108:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788361532.120139:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1e000/0xf6a94c97d6616146 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f97c expref: 42 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.120155:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661615b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f97c expref: 41 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.120175:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:1.0:1788361532.120177:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361532.120180:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1f400, rc 0) 00000100:00100000:1.0:1788361532.120249:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+42:37350:x1875232130819584:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1238us (1491us total) trans 30064771416 rc 0/0 00000100:00100000:1.0:1788361532.120258:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 395 00010000:00010000:1.0:1788361532.122425:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.122441:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.122449:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.122455:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361532.122460:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.122467:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.122483:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff9a8984a32300) 00010000:00010000:1.0:1788361532.122486:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361532.122490:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.122497:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f200/0xf6a94c97d6616154 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361532.127433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.127508:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130819712 00000100:00100000:1.0:1788361532.127518:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130819712 00000100:00100000:1.0:1788361532.127604:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:1.0:1788361532.127616:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+8:37350:x1875232130819712:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361532.127638:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361532.127659:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6616169 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f983 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361532.127686:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361532.127709:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcb:0x0].0x0 since=922s v=(0 0) 00010000:00010000:1.0:1788361532.127714:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361532.127724:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6616169 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f983 expref: 9 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.127752:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006e29336/0xf6a94c97d6616169 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f983 expref: 9 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.127765:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1ea00, rc 0) 00000100:00100000:1.0:1788361532.127827:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:37350:x1875232130819712:12345-192.168.203.60@tcp:101:dd.0 Request processed in 215us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361532.127835:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00080000:0.0:1788361532.127946:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361532.171268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.173658:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130819840 00000100:00100000:1.0:1788361532.173672:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130819840 00002000:00100000:1.0:1788361532.173731:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff9a8a870b0e00 x1875232130819840/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.173773:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b0e00 with x1875232130819840 ext(0->1048575) 00002000:00010000:1.0:1788361532.173780:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b0e00 00000100:00100000:1.0:1788361532.173819:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 279 00000100:00100000:1.0:1788361532.173829:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130819840:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361532.185234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.185335:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130819968 00000100:00100000:0.0:1788361532.185344:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130819968 00002000:00100000:0.0:1788361532.185390:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff9a8992066d80 x1875232130819968/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.185401:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992066d80 with x1875232130819968 ext(1048576->2097151) 00002000:00010000:0.0:1788361532.185407:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992066d80 00000100:00100000:0.0:1788361532.185441:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 280 00000100:00100000:0.0:1788361532.185450:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+11:2352:x1875232130819968:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361532.197602:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130819840:12345-192.168.203.60@tcp:4:dd.0 Request processed in 23764us (26333us total) trans 30064771183 rc 0/0 00000100:00100000:1.0:1788361532.197617:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 279 00002000:00100000:1.0:1788361532.197629:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff9a8a870b0e00 x1875232130819840/t30064771183(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.197640:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b0e00 with x1875232130819840 ext(0->1048575) 00002000:00010000:1.0:1788361532.197646:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b0e00 00000100:00100000:2.0:1788361532.201073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.201186:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130820096 00000100:00100000:1.0:1788361532.201196:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130820096 00002000:00100000:1.0:1788361532.201241:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff9a8992064a80 x1875232130820096/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.201253:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992064a80 with x1875232130820096 ext(2097152->3145727) 00002000:00010000:1.0:1788361532.201258:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992064a80 00000100:00100000:1.0:1788361532.201291:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 281 00000100:00100000:1.0:1788361532.201301:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130820096:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361532.209522:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992066d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2352:x1875232130819968:12345-192.168.203.60@tcp:4:dd.0 Request processed in 24060us (24286us total) trans 30064771184 rc 0/0 00000100:00100000:1.0:1788361532.209538:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 280 00002000:00100000:1.0:1788361532.209568:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff9a8992066d80 x1875232130819968/t30064771184(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.209579:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992066d80 with x1875232130819968 ext(1048576->2097151) 00002000:00010000:1.0:1788361532.209586:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992066d80 00000100:00100000:0.0:1788361532.215237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.215264:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130820224 00000100:00100000:0.0:1788361532.215273:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130820224 00002000:00100000:0.0:1788361532.215312:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff9a898afde680 x1875232130820224/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.215324:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afde680 with x1875232130820224 ext(3145728->4194303) 00002000:00010000:0.0:1788361532.215329:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898afde680 00000100:00100000:0.0:1788361532.215351:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 282 00000100:00100000:0.0:1788361532.215359:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+15:2352:x1875232130820224:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361532.216333:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992064a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+17:2352:x1875232130820096:12345-192.168.203.60@tcp:4:dd.0 Request processed in 15031us (15269us total) trans 30064771185 rc 0/0 00000100:00100000:3.0:1788361532.216342:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 281 00002000:00100000:3.0:1788361532.216350:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff9a8992064a80 x1875232130820096/t30064771185(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.216358:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992064a80 with x1875232130820096 ext(2097152->3145727) 00002000:00010000:3.0:1788361532.216362:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992064a80 00000100:00100000:3.0:1788361532.220134:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+17:2352:x1875232130820224:12345-192.168.203.60@tcp:4:dd.0 Request processed in 4766us (4896us total) trans 30064771186 rc 0/0 00000100:00100000:3.0:1788361532.220147:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 282 00002000:00100000:3.0:1788361532.220160:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff9a898afde680 x1875232130820224/t30064771186(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.220170:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afde680 with x1875232130820224 ext(3145728->4194303) 00002000:00010000:3.0:1788361532.220184:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898afde680 00000100:00100000:2.0:1788361532.227233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.227330:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130820352 00000100:00100000:1.0:1788361532.227340:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130820352 00002000:00100000:1.0:1788361532.227388:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff9a8992066a00 x1875232130820352/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.227400:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992066a00 with x1875232130820352 ext(4194304->5242879) 00002000:00010000:1.0:1788361532.227406:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992066a00 00000100:00100000:1.0:1788361532.227478:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 283 00000100:00100000:1.0:1788361532.227488:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:2351:x1875232130820352:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361532.236111:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992066a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+19:2351:x1875232130820352:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8597us (8862us total) trans 30064771187 rc 0/0 00000100:00100000:3.0:1788361532.236126:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 283 00002000:00100000:3.0:1788361532.236138:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff9a8992066a00 x1875232130820352/t30064771187(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.236148:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992066a00 with x1875232130820352 ext(4194304->5242879) 00002000:00010000:3.0:1788361532.236155:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992066a00 00000100:00100000:0.0:1788361532.236880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.237355:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130820480 00000100:00100000:3.0:1788361532.237363:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130820480 00002000:00100000:3.0:1788361532.237399:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff9a898afdd500 x1875232130820480/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.237409:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdd500 with x1875232130820480 ext(5242880->6291455) 00002000:00010000:3.0:1788361532.237413:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898afdd500 00000100:00100000:3.0:1788361532.237469:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 284 00000100:00100000:3.0:1788361532.237477:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+19:2352:x1875232130820480:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361532.244119:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+21:2352:x1875232130820480:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6610us (7208us total) trans 30064771188 rc 0/0 00000100:00100000:3.0:1788361532.244133:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 284 00002000:00100000:3.0:1788361532.244146:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff9a898afdd500 x1875232130820480/t30064771188(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.244157:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdd500 with x1875232130820480 ext(5242880->6291455) 00002000:00010000:3.0:1788361532.244164:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898afdd500 00000100:00100000:1.0:1788361532.251313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.251471:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130820608 00000100:00100000:2.0:1788361532.251482:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130820608 00002000:00100000:2.0:1788361532.251532:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff9a8ab7143b80 x1875232130820608/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.251542:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7143b80 with x1875232130820608 ext(6291456->7340031) 00002000:00010000:2.0:1788361532.251547:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7143b80 00000100:00100000:2.0:1788361532.251618:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 285 00000100:00100000:2.0:1788361532.251629:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+21:2351:x1875232130820608:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361532.262075:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+23:2351:x1875232130820608:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10436us (10760us total) trans 30064771189 rc 0/0 00000100:00100000:2.0:1788361532.262107:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 285 00002000:00100000:2.0:1788361532.262119:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff9a8ab7143b80 x1875232130820608/t30064771189(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.262140:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7143b80 with x1875232130820608 ext(6291456->7340031) 00002000:00010000:2.0:1788361532.262146:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7143b80 00000100:00100000:2.0:1788361532.271844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.271908:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130820736 00000100:00100000:1.0:1788361532.271920:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130820736 00002000:00100000:1.0:1788361532.271970:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff9a8992064700 x1875232130820736/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.271981:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992064700 with x1875232130820736 ext(7340032->8388607) 00002000:00010000:1.0:1788361532.271988:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992064700 00000100:00100000:1.0:1788361532.272060:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 286 00000100:00100000:1.0:1788361532.272070:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+23:2351:x1875232130820736:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361532.286782:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992064700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+25:2351:x1875232130820736:12345-192.168.203.60@tcp:4:dd.0 Request processed in 14698us (14931us total) trans 30064771190 rc 0/0 00000100:00100000:2.0:1788361532.286798:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 286 00002000:00100000:2.0:1788361532.286814:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff9a8992064700 x1875232130820736/t30064771190(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.286825:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992064700 with x1875232130820736 ext(7340032->8388607) 00002000:00010000:2.0:1788361532.286832:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992064700 00000100:00100000:0.0:1788361532.290195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.290300:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130820864 00000100:00100000:1.0:1788361532.290312:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130820864 00002000:00100000:1.0:1788361532.290364:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff9a898afdea00 x1875232130820864/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.290395:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdea00 with x1875232130820864 ext(8388608->9437183) 00002000:00010000:1.0:1788361532.290401:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898afdea00 00000100:00100000:1.0:1788361532.290437:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 287 00000100:00100000:1.0:1788361532.290447:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+25:2351:x1875232130820864:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361532.302013:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.302071:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130820992 00000100:00100000:0.0:1788361532.302080:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130820992 00002000:00100000:0.0:1788361532.302161:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff9a8992065f80 x1875232130820992/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.302172:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992065f80 with x1875232130820992 ext(9437184->10485759) 00002000:00010000:0.0:1788361532.302178:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992065f80 00000100:00100000:0.0:1788361532.302209:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 288 00000100:00100000:0.0:1788361532.302220:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+27:2350:x1875232130820992:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361532.305237:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:2351:x1875232130820864:12345-192.168.203.60@tcp:4:dd.0 Request processed in 14781us (15040us total) trans 30064771191 rc 0/0 00000100:00100000:2.0:1788361532.305250:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 287 00002000:00100000:2.0:1788361532.305262:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff9a898afdea00 x1875232130820864/t30064771191(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.305270:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdea00 with x1875232130820864 ext(8388608->9437183) 00002000:00010000:2.0:1788361532.305274:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898afdea00 00000100:00100000:0.0:1788361532.309197:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992065f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130820992:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6970us (7542us total) trans 30064771192 rc 0/0 00000100:00100000:0.0:1788361532.309210:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 288 00002000:00100000:0.0:1788361532.309223:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff9a8992065f80 x1875232130820992/t30064771192(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.309233:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992065f80 with x1875232130820992 ext(9437184->10485759) 00002000:00010000:0.0:1788361532.309240:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992065f80 00000100:00100000:1.0:1788361532.318501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.318582:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130821120 00000100:00100000:3.0:1788361532.318603:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130821120 00002000:00100000:3.0:1788361532.318906:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff9a8987649f80 x1875232130821120/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.318917:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987649f80 with x1875232130821120 ext(10485760->11534335) 00002000:00010000:3.0:1788361532.318923:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987649f80 00000100:00100000:3.0:1788361532.318955:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 289 00000100:00100000:3.0:1788361532.318964:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130821120:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361532.325382:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+31:2350:x1875232130821120:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6408us (6878us total) trans 30064771193 rc 0/0 00000100:00100000:3.0:1788361532.326922:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 289 00002000:00100000:3.0:1788361532.326937:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff9a8987649f80 x1875232130821120/t30064771193(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.326949:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987649f80 with x1875232130821120 ext(10485760->11534335) 00002000:00010000:3.0:1788361532.326956:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987649f80 00000100:00100000:1.0:1788361532.331912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.331969:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130821248 00000100:00100000:3.0:1788361532.331979:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130821248 00002000:00100000:3.0:1788361532.332124:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff9a8987649c00 x1875232130821248/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.332138:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987649c00 with x1875232130821248 ext(11534336->12582911) 00002000:00010000:3.0:1788361532.332144:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987649c00 00000100:00100000:3.0:1788361532.332179:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 290 00000100:00100000:3.0:1788361532.332189:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+31:2350:x1875232130821248:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361532.341249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.341551:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987649c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+33:2350:x1875232130821248:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9362us (9646us total) trans 30064771194 rc 0/0 00000100:00100000:0.0:1788361532.341562:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 290 00002000:00100000:0.0:1788361532.341575:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff9a8987649c00 x1875232130821248/t30064771194(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.341585:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8987649c00 with x1875232130821248 ext(11534336->12582911) 00002000:00010000:0.0:1788361532.341603:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8987649c00 00000100:00100000:2.0:1788361532.341702:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130821376 00000100:00100000:2.0:1788361532.341711:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130821376 00002000:00100000:2.0:1788361532.341757:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff9a8a870b0000 x1875232130821376/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.341766:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b0000 with x1875232130821376 ext(12582912->13631487) 00002000:00010000:2.0:1788361532.341776:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b0000 00000100:00100000:2.0:1788361532.341797:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 291 00000100:00100000:2.0:1788361532.341807:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+33:2349:x1875232130821376:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361532.351750:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+35:2349:x1875232130821376:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9922us (10488us total) trans 30064771195 rc 0/0 00000100:00100000:3.0:1788361532.351776:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 291 00002000:00100000:3.0:1788361532.351790:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff9a8a870b0000 x1875232130821376/t30064771195(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.351801:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b0000 with x1875232130821376 ext(12582912->13631487) 00002000:00010000:3.0:1788361532.351808:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b0000 00000100:00100000:2.0:1788361532.353135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.353843:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130821504 00000100:00100000:3.0:1788361532.353852:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130821504 00002000:00100000:3.0:1788361532.353892:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff9a8992067100 x1875232130821504/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.353903:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992067100 with x1875232130821504 ext(13631488->14680063) 00002000:00010000:3.0:1788361532.353909:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992067100 00000100:00100000:3.0:1788361532.353974:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 292 00000100:00100000:3.0:1788361532.353983:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+35:2349:x1875232130821504:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361532.361607:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992067100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+37:2349:x1875232130821504:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7614us (8467us total) trans 30064771196 rc 0/0 00000100:00100000:0.0:1788361532.361621:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 292 00002000:00100000:0.0:1788361532.361634:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff9a8992067100 x1875232130821504/t30064771196(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.361646:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992067100 with x1875232130821504 ext(13631488->14680063) 00002000:00010000:0.0:1788361532.361652:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992067100 00000100:00100000:3.0:1788361532.364722:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.364812:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130821760 00000100:00100000:1.0:1788361532.364820:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130821760 00000100:00100000:1.0:1788361532.364876:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:1.0:1788361532.364886:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+41:37350:x1875232130821760:12345-192.168.203.60@tcp:35:dd.0 00000001:00080000:1.0:1788361532.365185:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771417 00000100:00100000:1.0:1788361532.365291:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+43:37350:x1875232130821760:12345-192.168.203.60@tcp:35:dd.0 Request processed in 406us (578us total) trans 30064771418 rc 0/0 00000100:00100000:1.0:1788361532.365299:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000020:00080000:1.0:1788361532.365304:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788361532.366071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.366116:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130821888 00000100:00100000:2.0:1788361532.366123:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130821888 00002000:00100000:2.0:1788361532.366158:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff9a8a870b2680 x1875232130821888/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.366169:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b2680 with x1875232130821888 ext(14680064->15728639) 00002000:00010000:2.0:1788361532.366175:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b2680 00000100:00100000:2.0:1788361532.366386:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 293 00000100:00100000:2.0:1788361532.366395:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+37:2349:x1875232130821888:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361532.375208:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130821888:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8803us (9128us total) trans 30064771197 rc 0/0 00000100:00100000:2.0:1788361532.375221:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 293 00002000:00100000:2.0:1788361532.375234:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff9a8a870b2680 x1875232130821888/t30064771197(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.375246:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b2680 with x1875232130821888 ext(14680064->15728639) 00002000:00010000:2.0:1788361532.375252:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b2680 00000100:00100000:0.0:1788361532.376595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.376655:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130822144 00000100:00100000:2.0:1788361532.376671:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130822144 00000100:00100000:2.0:1788361532.376721:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 396 00000100:00100000:2.0:1788361532.376812:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+43:37351:x1875232130822144:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361532.376834:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361532.376865:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d6616170 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f98a expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.376984:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6616177 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.376998:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6616177 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.377009:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6616177 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.377023:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.377029:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.377036:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361532.378440:0:37551:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcb:0x0], index 1: 0 00010000:00010000:2.0:1788361532.378597:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616185 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378610:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616185 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378619:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616185 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378727:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6616177 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378755:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6616177 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378763:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6616177 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378769:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cfc00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361532.378774:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6616177 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378781:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6616177 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378793:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:2.0:1788361532.378796:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361532.378800:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6616177 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378806:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d6616177 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361532.378820:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e1f06f78 reply state 0000000087973403 transno 30064771419 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361532.378829:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361532.378859:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d6616170 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f98a expref: 46 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378875:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616185 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f98a expref: 45 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.378893:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:2.0:1788361532.378896:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361532.378898:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce000, rc 0) 00000100:00100000:2.0:1788361532.378970:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+46:37351:x1875232130822144:12345-192.168.203.60@tcp:101:dd.0 Request processed in 2240us (2378us total) trans 30064771419 rc 0/0 00000100:00100000:2.0:1788361532.378979:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 396 00010000:00010000:2.0:1788361532.380475:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.380488:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.380494:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.380499:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361532.380503:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.380511:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.380524:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff9a8a83c0b900) 00010000:00010000:2.0:1788361532.380526:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361532.380530:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.380535:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d661617e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361532.384777:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.385642:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130822272 00000100:00100000:1.0:1788361532.385652:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130822272 00000100:00100000:1.0:1788361532.385722:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:1.0:1788361532.385733:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:37351:x1875232130822272:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361532.385763:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361532.385783:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6616193 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f991 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361532.385807:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361532.385827:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcb:0x0].0x0 since=922s v=(0 0) 00010000:00010000:1.0:1788361532.385845:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361532.385854:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6616193 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f991 expref: 12 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.385872:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ffe4b9c/0xf6a94c97d6616193 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f991 expref: 12 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.385884:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a8df1e600, rc 0) 00000100:00100000:1.0:1788361532.385940:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:37351:x1875232130822272:12345-192.168.203.60@tcp:101:dd.0 Request processed in 208us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361532.385947:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00080000:0.0:1788361532.386108:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361532.413353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.413927:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130822400 00000100:00100000:3.0:1788361532.413938:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130822400 00002000:00100000:2.0:1788361532.414460:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff9a898afdf100 x1875232130822400/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.414471:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdf100 with x1875232130822400 ext(0->1048575) 00002000:00010000:2.0:1788361532.414478:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdf100 00000100:00100000:2.0:1788361532.414552:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 294 00000100:00100000:2.0:1788361532.414564:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130822400:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361532.429072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.429798:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130822528 00000100:00100000:1.0:1788361532.429809:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130822528 00002000:00100000:1.0:1788361532.429860:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff9a898afdf480 x1875232130822528/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.429871:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdf480 with x1875232130822528 ext(1048576->2097151) 00002000:00010000:1.0:1788361532.429876:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdf480 00000100:00100000:1.0:1788361532.429913:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 295 00000100:00100000:1.0:1788361532.429922:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+14:2352:x1875232130822528:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361532.438453:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+16:2350:x1875232130822400:12345-192.168.203.60@tcp:4:dd.0 Request processed in 23882us (25098us total) trans 30064771252 rc 0/0 00000100:00100000:0.0:1788361532.438468:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 294 00002000:00100000:0.0:1788361532.438482:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff9a898afdf100 x1875232130822400/t30064771252(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.438493:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdf100 with x1875232130822400 ext(0->1048575) 00002000:00010000:0.0:1788361532.438499:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdf100 00000100:00100000:2.0:1788361532.445276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.445592:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130822656 00000100:00100000:0.0:1788361532.445602:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130822656 00002000:00100000:0.0:1788361532.445648:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff9a8992067480 x1875232130822656/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.445659:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992067480 with x1875232130822656 ext(2097152->3145727) 00002000:00010000:0.0:1788361532.445671:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8992067480 00000100:00100000:0.0:1788361532.445705:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 296 00000100:00100000:0.0:1788361532.445714:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+16:2352:x1875232130822656:12345-192.168.203.60@tcp:4:dd.0 00000040:00080000:2.0:1788361532.449525:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361532.449534:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361532.449568:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 8 00000040:00080000:2.0:1788361532.449573:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361532.458721:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+18:2352:x1875232130822528:12345-192.168.203.60@tcp:4:dd.0 Request processed in 28789us (29648us total) trans 30064771253 rc 0/0 00000100:00100000:2.0:1788361532.458748:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 295 00002000:00100000:2.0:1788361532.458763:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff9a898afdf480 x1875232130822528/t30064771253(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.458774:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdf480 with x1875232130822528 ext(1048576->2097151) 00002000:00010000:2.0:1788361532.458781:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdf480 00000100:00100000:0.0:1788361532.458978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.459198:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130822784 00000100:00100000:2.0:1788361532.459207:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130822784 00002000:00100000:2.0:1788361532.459245:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff9a898afde300 x1875232130822784/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.459253:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afde300 with x1875232130822784 ext(3145728->4194303) 00002000:00010000:2.0:1788361532.459267:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afde300 00000100:00100000:2.0:1788361532.459294:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 297 00000100:00100000:2.0:1788361532.459303:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+18:2351:x1875232130822784:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361532.462402:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992067480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:2352:x1875232130822656:12345-192.168.203.60@tcp:4:dd.0 Request processed in 16680us (17126us total) trans 30064771254 rc 0/0 00000100:00100000:2.0:1788361532.462415:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 296 00002000:00100000:2.0:1788361532.462426:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff9a8992067480 x1875232130822656/t30064771254(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.462437:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992067480 with x1875232130822656 ext(2097152->3145727) 00002000:00010000:2.0:1788361532.462442:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8992067480 00000100:00100000:3.0:1788361532.470955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.471400:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130822912 00000100:00100000:2.0:1788361532.471410:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130822912 00002000:00100000:2.0:1788361532.471460:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff9a8a870b1500 x1875232130822912/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.471472:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b1500 with x1875232130822912 ext(4194304->5242879) 00002000:00010000:2.0:1788361532.471477:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a870b1500 00000100:00100000:2.0:1788361532.471603:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 298 00000100:00100000:2.0:1788361532.471614:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+20:2351:x1875232130822912:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361532.483435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.484405:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+22:2351:x1875232130822784:12345-192.168.203.60@tcp:4:dd.0 Request processed in 25100us (25426us total) trans 30064771255 rc 0/0 00000100:00100000:3.0:1788361532.484418:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 297 00002000:00100000:3.0:1788361532.484430:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff9a898afde300 x1875232130822784/t30064771255(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.484440:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afde300 with x1875232130822784 ext(3145728->4194303) 00002000:00010000:3.0:1788361532.484457:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afde300 00000100:00100000:3.0:1788361532.484520:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130823040 00000100:00100000:3.0:1788361532.484528:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130823040 00002000:00100000:3.0:1788361532.484556:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff9a8ab710e300 x1875232130823040/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.484565:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710e300 with x1875232130823040 ext(5242880->6291455) 00002000:00010000:3.0:1788361532.484568:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710e300 00000100:00100000:2.0:1788361532.486009:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 299 00000100:00100000:2.0:1788361532.486025:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+22:2351:x1875232130823040:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361532.486289:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+24:2351:x1875232130822912:12345-192.168.203.60@tcp:4:dd.0 Request processed in 14675us (15340us total) trans 30064771256 rc 0/0 00000100:00100000:0.0:1788361532.486300:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 298 00002000:00100000:0.0:1788361532.486308:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff9a8a870b1500 x1875232130822912/t30064771256(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.486318:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b1500 with x1875232130822912 ext(4194304->5242879) 00002000:00010000:0.0:1788361532.486323:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a870b1500 00000100:00100000:2.0:1788361532.490033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.491237:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130823168 00000100:00100000:0.0:1788361532.491249:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130823168 00002000:00100000:0.0:1788361532.491297:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff9a8992066300 x1875232130823168/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.491308:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992066300 with x1875232130823168 ext(6291456->7340031) 00002000:00010000:0.0:1788361532.491314:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8992066300 00000100:00100000:0.0:1788361532.491346:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 300 00000100:00100000:0.0:1788361532.491355:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+24:2349:x1875232130823168:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361532.498791:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+26:2351:x1875232130823040:12345-192.168.203.60@tcp:4:dd.0 Request processed in 12760us (15354us total) trans 30064771257 rc 0/0 00000100:00100000:1.0:1788361532.498806:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 299 00002000:00100000:1.0:1788361532.498823:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff9a8ab710e300 x1875232130823040/t30064771257(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.498856:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab710e300 with x1875232130823040 ext(5242880->6291455) 00002000:00010000:1.0:1788361532.498863:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab710e300 00000100:00100000:0.0:1788361532.505289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.505315:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130823296 00000100:00100000:0.0:1788361532.505324:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130823296 00002000:00100000:0.0:1788361532.505377:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff9a898afdd880 x1875232130823296/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.505405:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdd880 with x1875232130823296 ext(7340032->8388607) 00002000:00010000:0.0:1788361532.505411:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdd880 00000100:00100000:0.0:1788361532.505440:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 301 00000100:00100000:0.0:1788361532.505450:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+26:2352:x1875232130823296:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361532.505656:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+28:2349:x1875232130823168:12345-192.168.203.60@tcp:4:dd.0 Request processed in 14301us (15630us total) trans 30064771258 rc 0/0 00000100:00100000:2.0:1788361532.505675:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 300 00002000:00100000:2.0:1788361532.505683:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff9a8992066300 x1875232130823168/t30064771258(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.505692:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992066300 with x1875232130823168 ext(6291456->7340031) 00002000:00010000:2.0:1788361532.505696:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8992066300 00000100:00100000:2.0:1788361532.514482:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+28:2352:x1875232130823296:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9021us (9189us total) trans 30064771259 rc 0/0 00000100:00100000:2.0:1788361532.514496:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 301 00002000:00100000:2.0:1788361532.514509:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff9a898afdd880 x1875232130823296/t30064771259(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.514519:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdd880 with x1875232130823296 ext(7340032->8388607) 00002000:00010000:2.0:1788361532.514526:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdd880 00000100:00100000:0.0:1788361532.519908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.519994:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130823424 00000100:00100000:3.0:1788361532.520004:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130823424 00002000:00100000:3.0:1788361532.520049:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (8388608->9437183) req@ffff9a898afdc000 x1875232130823424/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.520059:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdc000 with x1875232130823424 ext(8388608->9437183) 00002000:00010000:3.0:1788361532.520065:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdc000 00000100:00100000:3.0:1788361532.520125:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 302 00000100:00100000:3.0:1788361532.520135:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+28:2349:x1875232130823424:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361532.530826:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+30:2349:x1875232130823424:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10682us (10917us total) trans 30064771260 rc 0/0 00000100:00100000:3.0:1788361532.530839:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 302 00002000:00100000:3.0:1788361532.530852:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (8388608->9437183) req@ffff9a898afdc000 x1875232130823424/t30064771260(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.530863:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdc000 with x1875232130823424 ext(8388608->9437183) 00002000:00010000:3.0:1788361532.530870:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdc000 00000100:00100000:0.0:1788361532.538840:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.541457:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130823552 00000100:00100000:1.0:1788361532.541474:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130823552 00002000:00100000:1.0:1788361532.541536:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (9437184->10485759) req@ffff9a898afdfb80 x1875232130823552/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.541548:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdfb80 with x1875232130823552 ext(9437184->10485759) 00002000:00010000:1.0:1788361532.541555:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdfb80 00000100:00100000:1.0:1788361532.541643:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 303 00000100:00100000:1.0:1788361532.541653:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+30:2349:x1875232130823552:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361532.548898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.548973:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130823680 00000100:00100000:2.0:1788361532.548983:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130823680 00002000:00100000:2.0:1788361532.549045:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (10485760->11534335) req@ffff9a898afddc00 x1875232130823680/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.549056:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afddc00 with x1875232130823680 ext(10485760->11534335) 00002000:00010000:2.0:1788361532.549062:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afddc00 00000100:00100000:2.0:1788361532.549120:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 304 00000100:00100000:2.0:1788361532.549130:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+32:2350:x1875232130823680:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361532.551441:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+34:2349:x1875232130823552:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9781us (12605us total) trans 30064771261 rc 0/0 00000100:00100000:1.0:1788361532.551455:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 303 00002000:00100000:1.0:1788361532.551466:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (9437184->10485759) req@ffff9a898afdfb80 x1875232130823552/t30064771261(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.551477:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afdfb80 with x1875232130823552 ext(9437184->10485759) 00002000:00010000:1.0:1788361532.551483:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afdfb80 00000100:00100000:3.0:1788361532.559280:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+34:2350:x1875232130823680:12345-192.168.203.60@tcp:4:dd.0 Request processed in 10142us (10383us total) trans 30064771262 rc 0/0 00000100:00100000:3.0:1788361532.559307:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 304 00002000:00100000:3.0:1788361532.559319:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (10485760->11534335) req@ffff9a898afddc00 x1875232130823680/t30064771262(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.559330:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898afddc00 with x1875232130823680 ext(10485760->11534335) 00002000:00010000:3.0:1788361532.559336:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898afddc00 00000100:00100000:2.0:1788361532.567469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.567825:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130823808 00000100:00100000:3.0:1788361532.567834:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130823808 00002000:00100000:3.0:1788361532.567882:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (11534336->12582911) req@ffff9a8992064000 x1875232130823808/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.567894:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992064000 with x1875232130823808 ext(11534336->12582911) 00002000:00010000:3.0:1788361532.567899:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8992064000 00000100:00100000:3.0:1788361532.567934:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 305 00000100:00100000:3.0:1788361532.567944:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+34:2349:x1875232130823808:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361532.582001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.582120:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130823936 00000100:00100000:1.0:1788361532.582131:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130823936 00002000:00100000:1.0:1788361532.582178:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (12582912->13631487) req@ffff9a8aa9cf3480 x1875232130823936/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.582202:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf3480 with x1875232130823936 ext(12582912->13631487) 00002000:00010000:1.0:1788361532.582208:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8aa9cf3480 00000100:00100000:1.0:1788361532.582241:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 306 00000100:00100000:1.0:1788361532.582251:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+36:2350:x1875232130823936:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361532.583667:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992064000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+38:2349:x1875232130823808:12345-192.168.203.60@tcp:4:dd.0 Request processed in 15718us (16202us total) trans 30064771263 rc 0/0 00000100:00100000:1.0:1788361532.583678:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 305 00002000:00100000:1.0:1788361532.583688:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (11534336->12582911) req@ffff9a8992064000 x1875232130823808/t30064771263(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.583698:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992064000 with x1875232130823808 ext(11534336->12582911) 00002000:00010000:1.0:1788361532.583703:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8992064000 00000100:00100000:1.0:1788361532.593974:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+38:2350:x1875232130823936:12345-192.168.203.60@tcp:4:dd.0 Request processed in 11714us (11973us total) trans 30064771264 rc 0/0 00000100:00100000:1.0:1788361532.593987:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 306 00002000:00100000:1.0:1788361532.593998:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (12582912->13631487) req@ffff9a8aa9cf3480 x1875232130823936/t30064771264(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.594018:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf3480 with x1875232130823936 ext(12582912->13631487) 00002000:00010000:1.0:1788361532.594025:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8aa9cf3480 00000100:00100000:0.0:1788361532.598327:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.598531:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130824064 00000100:00100000:1.0:1788361532.598540:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130824064 00002000:00100000:1.0:1788361532.598596:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (13631488->14680063) req@ffff9a8aa9cf1c00 x1875232130824064/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.598607:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf1c00 with x1875232130824064 ext(13631488->14680063) 00002000:00010000:1.0:1788361532.598613:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8aa9cf1c00 00000100:00100000:1.0:1788361532.598640:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 307 00000100:00100000:1.0:1788361532.598650:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+38:2351:x1875232130824064:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361532.612448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.612487:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130824192 00000100:00100000:1.0:1788361532.612499:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.612508:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130824192 00000100:00100000:1.0:1788361532.612523:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130824448 00000100:00100000:1.0:1788361532.612528:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130824448 00002000:00100000:2.0:1788361532.612558:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (14680064->15728639) req@ffff9a8992064e00 x1875232130824192/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.612569:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992064e00 with x1875232130824192 ext(14680064->15728639) 00002000:00010000:2.0:1788361532.612575:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8992064e00 00000100:00100000:2.0:1788361532.612606:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 308 00000100:00100000:2.0:1788361532.612617:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+40:2352:x1875232130824192:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361532.612635:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361532.612646:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+45:37351:x1875232130824448:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:1.0:1788361532.613262:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+46:37351:x1875232130824448:12345-192.168.203.60@tcp:35:dd.0 Request processed in 616us (762us total) trans 30064771420 rc 0/0 00000100:00100000:1.0:1788361532.613270:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:0.0:1788361532.614277:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+42:2351:x1875232130824064:12345-192.168.203.60@tcp:4:dd.0 Request processed in 15622us (15955us total) trans 30064771265 rc 0/0 00000100:00100000:0.0:1788361532.614286:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 307 00002000:00100000:0.0:1788361532.614296:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (13631488->14680063) req@ffff9a8aa9cf1c00 x1875232130824064/t30064771265(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.614305:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8aa9cf1c00 with x1875232130824064 ext(13631488->14680063) 00002000:00010000:0.0:1788361532.614310:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8aa9cf1c00 00000100:00100000:3.0:1788361532.619305:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+42:2352:x1875232130824192:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6680us (6862us total) trans 30064771266 rc 0/0 00000100:00100000:3.0:1788361532.619317:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 308 00002000:00100000:3.0:1788361532.619330:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (14680064->15728639) req@ffff9a8992064e00 x1875232130824192/t30064771266(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/448 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.619341:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992064e00 with x1875232130824192 ext(14680064->15728639) 00002000:00010000:3.0:1788361532.619348:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8992064e00 00000100:00100000:0.0:1788361532.631604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.631697:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130824576 00000100:00100000:2.0:1788361532.631706:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130824576 00000100:00100000:2.0:1788361532.631766:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 397 00000100:00100000:2.0:1788361532.631774:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+46:37352:x1875232130824576:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361532.631795:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361532.631814:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d661619a lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f998 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.631849:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d66161a1 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.631859:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d66161a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.631868:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d66161a1 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.631958:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d661619a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f998 expref: 48 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.631972:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cee00/0xf6a94c97d66161a1 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f998 expref: 47 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.631982:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:2.0:1788361532.631984:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361532.631986:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cee00, rc 0) 00000100:00100000:2.0:1788361532.632042:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:37352:x1875232130824576:12345-192.168.203.60@tcp:101:chown.0 Request processed in 269us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361532.632047:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 397 00000100:00100000:1.0:1788361532.634013:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.634220:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130824832 00000100:00100000:2.0:1788361532.634228:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130824832 00000100:00100000:2.0:1788361532.634723:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 398 00000100:00100000:2.0:1788361532.634744:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+47:37352:x1875232130824832:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:2.0:1788361532.634799:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361532.634825:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f400/0xf6a94c97d661615b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f97c expref: 47 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.635156:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:2.0:1788361532.635162:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361532.635195:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.635210:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.635222:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361532.637538:0:35347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].14, 88 off9256 00000004:00080000:2.0:1788361532.637553:0:35347:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 922652466976ns, next at 923652464436ns, rc = 0 00000004:00010000:2.0:1788361532.637653:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e6efe00f reply state 0000000022871873 transno 30064771421 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361532.637665:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361532.637787:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+48:37352:x1875232130824832:12345-192.168.203.60@tcp:36:chown.0 Request processed in 3051us (3777us total) trans 30064771421 rc 0/0 00000100:00100000:2.0:1788361532.637795:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 398 00000100:00100000:1.0:1788361532.640835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.640916:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130824960 00000100:00100000:2.0:1788361532.640926:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130824960 00000100:00100000:2.0:1788361532.641016:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 399 00000100:00100000:2.0:1788361532.641026:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+48:37352:x1875232130824960:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361532.641048:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361532.641065:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66161af lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f99f expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.641147:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66161af lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f99f expref: 49 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.641162:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66161af lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f99f expref: 49 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.641179:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:2.0:1788361532.641182:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361532.641186:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf600, rc 0) 00000100:00100000:2.0:1788361532.641230:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+49:37352:x1875232130824960:12345-192.168.203.60@tcp:101:chown.0 Request processed in 206us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361532.641237:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 399 00010000:00010000:3.0:1788361532.641771:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361532.641782:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361532.641801:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361532.641808:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361532.641812:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361532.641820:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361532.641831:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:3.0:1788361532.641834:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788361532.641838:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361532.641845:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161a8 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x28:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361532.643496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.643589:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130825088 00000100:00100000:1.0:1788361532.643598:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130825088 00000100:00100000:1.0:1788361532.643671:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:1.0:1788361532.643680:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+39:2349:x1875232130825088:12345-192.168.203.60@tcp:2:chown.0 00002000:00010000:1.0:1788361532.643878:0:36286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:1.0:1788361532.643882:0:36286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb mtime from disk: 0 -> 1788361533 00002000:00010000:1.0:1788361532.643884:0:36286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361532.643887:0:36286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb ctime from disk: 0 -> 1788361533 00002000:00010000:1.0:1788361532.643889:0:36286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788361532.643946:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+40:2349:x1875232130825088:12345-192.168.203.60@tcp:2:chown.0 Request processed in 266us (460us total) trans 30064771198 rc 0/0 00000100:00100000:1.0:1788361532.643953:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:0.0:1788361532.657403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.657464:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130825216 00000100:00100000:2.0:1788361532.657489:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130825216 00000100:00100000:2.0:1788361532.657555:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 400 00000100:00100000:2.0:1788361532.657564:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+48:37353:x1875232130825216:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361532.658238:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361532.658271:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66161b6 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9a6 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.658310:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66161bd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.658323:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66161bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.658335:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66161bd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.658426:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66161b6 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9a6 expref: 50 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.658445:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfc00/0xf6a94c97d66161bd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9a6 expref: 49 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.658453:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:2.0:1788361532.658457:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361532.658460:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cfc00, rc 0) 00000100:00100000:2.0:1788361532.658558:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+49:37353:x1875232130825216:12345-192.168.203.60@tcp:101:chown.0 Request processed in 994us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361532.658566:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 400 00000100:00100000:2.0:1788361532.663921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.664171:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130825472 00000100:00100000:1.0:1788361532.664181:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130825472 00000100:00100000:1.0:1788361532.664234:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 401 00000100:00100000:1.0:1788361532.664244:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+49:37353:x1875232130825472:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:1.0:1788361532.664313:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361532.664341:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616185 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f98a expref: 49 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.664363:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:1.0:1788361532.664368:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361532.664396:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.664409:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361532.664417:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361532.665352:0:35347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].14, 88 off9328 00000004:00080000:1.0:1788361532.665364:0:35347:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 922680277535ns, next at 923680275392ns, rc = 0 00000004:00010000:1.0:1788361532.665444:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000027ad666 reply state 0000000031b46ae9 transno 30064771422 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361532.665454:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361532.665555:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+50:37353:x1875232130825472:12345-192.168.203.60@tcp:36:chown.0 Request processed in 1310us (1640us total) trans 30064771422 rc 0/0 00000100:00100000:1.0:1788361532.665562:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 401 00000100:00100000:0.0:1788361532.668024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.668116:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130825600 00000100:00100000:3.0:1788361532.668126:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130825600 00000100:00100000:3.0:1788361532.668169:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 402 00000100:00100000:3.0:1788361532.668178:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+50:37353:x1875232130825600:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:3.0:1788361532.668202:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361532.668220:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d66161cb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9ad expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361532.668288:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d66161cb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9ad expref: 51 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361532.668319:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d66161cb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9ad expref: 51 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361532.668340:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:3.0:1788361532.668343:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361532.668347:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9400, rc 0) 00000100:00100000:3.0:1788361532.668396:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+51:37353:x1875232130825600:12345-192.168.203.60@tcp:101:chown.0 Request processed in 219us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361532.668403:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 402 00010000:00010000:2.0:1788361532.673766:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.673781:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.673788:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.673795:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a8df1f000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361532.673799:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.673807:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.673824:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:2.0:1788361532.673827:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361532.673830:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.673836:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a8df1f000/0xf6a94c97d66161c4 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x29:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361532.674488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.674792:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130825728 00000100:00100000:2.0:1788361532.674800:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130825728 00000100:00100000:2.0:1788361532.674850:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:2.0:1788361532.674860:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+42:2352:x1875232130825728:12345-192.168.203.60@tcp:2:chown.0 00002000:00010000:2.0:1788361532.675206:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb size from disk: 0 -> 15728640 00002000:00010000:2.0:1788361532.675210:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb mtime from disk: 0 -> 1788361533 00002000:00010000:2.0:1788361532.675212:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361532.675227:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb ctime from disk: 0 -> 1788361533 00002000:00010000:2.0:1788361532.675229:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361532.675378:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+43:2352:x1875232130825728:12345-192.168.203.60@tcp:2:chown.0 Request processed in 518us (895us total) trans 30064771267 rc 0/0 00000100:00100000:2.0:1788361532.675386:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:1.0:1788361532.726535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.726818:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130825856 00000100:00100000:2.0:1788361532.726828:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130825856 00000100:00100000:2.0:1788361532.726877:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 403 00000100:00100000:2.0:1788361532.726884:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+50:37359:x1875232130825856:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:2.0:1788361532.726904:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361532.726920:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66161d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9b4 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.726974:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d66161d9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.726985:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d66161d9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.726994:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d66161d9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361532.727055:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 512 00000004:00200000:2.0:1788361532.727059:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361532.727083:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d66161d9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.727134:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d66161d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9b4 expref: 52 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.727170:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cec00/0xf6a94c97d66161d9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9b4 expref: 51 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.727179:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:2.0:1788361532.727181:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361532.727185:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cec00, rc 0) 00000100:00100000:0.0:1788361532.727312:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+51:37359:x1875232130825856:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 426us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361532.727320:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 403 00000100:00100000:1.0:1788361532.730346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.730405:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130825984 00000100:00100000:2.0:1788361532.730415:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130825984 00000100:00100000:2.0:1788361532.730805:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 404 00000100:00100000:2.0:1788361532.730814:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+51:37359:x1875232130825984:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:2.0:1788361532.730834:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361532.730851:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d66161e0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9bb expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731020:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66161e7 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731037:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66161e7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731049:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66161e7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731065:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66161ee lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731072:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66161ee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731236:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66161ee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731656:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161f5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731666:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731674:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361532.731700:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00000004:00200000:2.0:1788361532.731703:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361532.731721:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731731:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161f5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731749:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66161e7 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731756:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66161e7 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731763:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66161e7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731769:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361532.731773:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66161e7 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731787:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66161e7 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731799:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:2.0:1788361532.731801:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361532.731805:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66161e7 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731811:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce800/0xf6a94c97d66161e7 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731824:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66161ee lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731829:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66161ee lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731835:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66161ee lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731840:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361532.731842:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66161ee lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731847:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66161ee lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731853:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff9a8a83c0b900) 00010000:00010000:2.0:1788361532.731855:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361532.731858:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66161ee lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731869:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d66161ee lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731898:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d66161e0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9bb expref: 53 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731912:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161f5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9bb expref: 52 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361532.731920:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:2.0:1788361532.731922:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361532.731925:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cea00, rc 0) 00000100:00100000:2.0:1788361532.732480:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+52:37359:x1875232130825984:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 1665us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361532.732489:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 404 00000100:00100000:1.0:1788361532.737408:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.737868:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130826240 00000100:00100000:0.0:1788361532.737892:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130826240 00000100:00100000:0.0:1788361532.737986:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 405 00000100:00100000:0.0:1788361532.737996:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+52:37359:x1875232130826240:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:0.0:1788361532.738016:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361532.738035:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66161fc lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9c2 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.738164:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616203 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.738178:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616203 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.738188:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616203 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361532.738198:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00010000:00010000:0.0:1788361532.738324:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66161fc lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9c2 expref: 55 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.738344:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616203 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9c2 expref: 54 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.738354:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:0.0:1788361532.738356:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361532.738360:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44a00, rc 0) 00000100:00100000:0.0:1788361532.738495:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+54:37359:x1875232130826240:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 500us (1095us total) trans 30064771423 rc 0/0 00000100:00100000:0.0:1788361532.738502:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 405 00000100:00100000:1.0:1788361532.743969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.744148:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130826496 00000100:00100000:0.0:1788361532.744158:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130826496 00000100:00100000:0.0:1788361532.744255:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 406 00000100:00100000:0.0:1788361532.744265:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:37359:x1875232130826496:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:0.0:1788361532.744300:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361532.744303:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1788361532.744328:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d66161af lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f99f expref: 54 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744364:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616203 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9c2 expref: 53 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744378:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d66161f5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9bb expref: 52 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744388:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:0.0:1788361532.744392:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361532.744405:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6616211 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9c9 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744442:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616218 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744454:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616218 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744463:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616218 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744486:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616218 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744492:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616218 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744498:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616218 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744503:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361532.744507:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616218 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744513:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616218 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744521:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:0.0:1788361532.744524:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361532.744527:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616218 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744532:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616218 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744553:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d661621f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744560:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d661621f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744567:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d661621f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744802:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d661621f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9c9 expref: 54 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744810:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:0.0:1788361532.744812:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361532.744822:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d6616211 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9c9 expref: 54 pid: 35346 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744835:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80031800/0xf6a94c97d661621f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x28:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9c9 expref: 53 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361532.744856:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:0.0:1788361532.744858:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361532.744860:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80031800, rc 0) 00000100:00100000:0.0:1788361532.744965:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+53:37359:x1875232130826496:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 700us (1003us total) trans 30064771424 rc 0/0 00000100:00100000:0.0:1788361532.744972:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 406 00000100:00100000:2.0:1788361532.768168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.768347:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130826624 00000100:00100000:1.0:1788361532.768358:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130826624 00002000:00100000:1.0:1788361532.768407:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff9a8992065500 x1875232130826624/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361532.768419:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992065500 with x1875232130826624 ext(0->1048575) 00002000:00010000:1.0:1788361532.768424:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992065500 00000100:00100000:1.0:1788361532.768458:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 309 00000100:00100000:1.0:1788361532.768468:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8992065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+40:2351:x1875232130826624:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361532.780523:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8992065500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+40:2351:x1875232130826624:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 12048us (12356us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361532.780537:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 309 00002000:00100000:3.0:1788361532.780550:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (0->1048575) req@ffff9a8992065500 x1875232130826624/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.780562:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8992065500 with x1875232130826624 ext(0->1048575) 00002000:00010000:3.0:1788361532.780570:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8992065500 00000100:00100000:1.0:1788361532.793486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.793577:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130826752 00000100:00100000:3.0:1788361532.793587:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130826752 00002000:00100000:3.0:1788361532.793632:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff9a8a834cdf80 x1875232130826752/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.793643:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cdf80 with x1875232130826752 ext(1048576->2097151) 00002000:00010000:3.0:1788361532.793648:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cdf80 00000100:00100000:3.0:1788361532.793681:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 310 00000100:00100000:3.0:1788361532.793690:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+40:2352:x1875232130826752:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361532.803759:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+40:2352:x1875232130826752:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 10061us (10270us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361532.803773:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 310 00002000:00100000:2.0:1788361532.803785:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (1048576->2097151) req@ffff9a8a834cdf80 x1875232130826752/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.803796:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cdf80 with x1875232130826752 ext(1048576->2097151) 00002000:00010000:2.0:1788361532.803803:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cdf80 00000100:00100000:2.0:1788361532.822355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.822453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.822598:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130826880 00000100:00100000:0.0:1788361532.822608:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130826880 00002000:00100000:0.0:1788361532.822653:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff9a89859b1180 x1875232130826880/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.822664:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b1180 with x1875232130826880 ext(2097152->3145727) 00002000:00010000:0.0:1788361532.822669:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b1180 00000100:00100000:0.0:1788361532.822698:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130827008 00000100:00100000:0.0:1788361532.822702:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130827008 00002000:00100000:0.0:1788361532.822716:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff9a89859b0380 x1875232130827008/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.822731:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b0380 with x1875232130827008 ext(3145728->4194303) 00002000:00010000:0.0:1788361532.822743:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b0380 00000100:00100000:0.0:1788361532.822807:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 311 00000100:00100000:0.0:1788361532.822817:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+41:2349:x1875232130826880:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361532.823381:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 312 00000100:00100000:3.0:1788361532.823392:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+42:2350:x1875232130827008:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:0.0:1788361532.829496:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+42:2349:x1875232130826880:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 6670us (7140us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361532.829510:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 311 00002000:00100000:0.0:1788361532.829523:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (2097152->3145727) req@ffff9a89859b1180 x1875232130826880/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.829534:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b1180 with x1875232130826880 ext(2097152->3145727) 00002000:00010000:0.0:1788361532.829540:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b1180 00010000:00010000:3.0:1788361532.833221:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361532.833978:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+40:2350:x1875232130827008:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 10580us (11517us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361532.833991:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 312 00002000:00100000:2.0:1788361532.834073:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (3145728->4194303) req@ffff9a89859b0380 x1875232130827008/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.834082:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89859b0380 with x1875232130827008 ext(3145728->4194303) 00002000:00010000:2.0:1788361532.834122:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89859b0380 00000100:00100000:2.0:1788361532.864503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361532.864595:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130827136 00000100:00100000:0.0:1788361532.864604:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130827136 00002000:00100000:0.0:1788361532.864694:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff9a89858afb80 x1875232130827136/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.864702:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858afb80 with x1875232130827136 ext(4194304->5242879) 00002000:00010000:0.0:1788361532.864706:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89858afb80 00000100:00100000:0.0:1788361532.864729:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 313 00000100:00100000:0.0:1788361532.864746:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+40:2350:x1875232130827136:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361532.865151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.865181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.865203:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130827264 00000100:00100000:1.0:1788361532.865207:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130827264 00000100:00100000:3.0:1788361532.865226:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130827392 00002000:00100000:1.0:1788361532.865232:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff9a8a834ce300 x1875232130827264/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361532.865234:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130827392 00002000:00100000:1.0:1788361532.865243:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834ce300 with x1875232130827264 ext(5242880->6291455) 00002000:00010000:1.0:1788361532.865248:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834ce300 00002000:00100000:3.0:1788361532.865267:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff9a8a834cd180 x1875232130827392/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361532.865272:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 314 00002000:00100000:3.0:1788361532.865282:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cd180 with x1875232130827392 ext(6291456->7340031) 00002000:00010000:3.0:1788361532.865288:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cd180 00000100:00100000:1.0:1788361532.865288:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+43:2350:x1875232130827264:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:0.0:1788361532.865312:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 315 00000100:00100000:2.0:1788361532.865475:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.865496:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130827520 00000100:00100000:2.0:1788361532.865500:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130827520 00002000:00100000:2.0:1788361532.865522:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff9a8a89265180 x1875232130827520/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.865530:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89265180 with x1875232130827520 ext(7340032->8388607) 00002000:00010000:2.0:1788361532.865533:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89265180 00000100:00100000:0.0:1788361532.865561:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+45:2350:x1875232130827392:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361532.866912:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 316 00000100:00100000:2.0:1788361532.866927:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+46:2350:x1875232130827520:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361532.881263:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+46:2350:x1875232130827136:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 16516us (16759us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361532.881276:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 313 00002000:00100000:2.0:1788361532.881289:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (4194304->5242879) req@ffff9a89858afb80 x1875232130827136/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.881300:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89858afb80 with x1875232130827136 ext(4194304->5242879) 00002000:00010000:2.0:1788361532.881308:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a89858afb80 00000100:00100000:2.0:1788361532.885532:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+44:2350:x1875232130827264:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 20238us (20371us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361532.885545:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 314 00002000:00100000:2.0:1788361532.885557:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcb:0x0] (5242880->6291455) req@ffff9a8a834ce300 x1875232130827264/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.885568:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834ce300 with x1875232130827264 ext(5242880->6291455) 00002000:00010000:2.0:1788361532.885576:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834ce300 00000100:00100000:0.0:1788361532.890851:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+42:2350:x1875232130827392:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 25282us (25658us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361532.890885:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 315 00002000:00100000:0.0:1788361532.890899:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (6291456->7340031) req@ffff9a8a834cd180 x1875232130827392/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.890911:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cd180 with x1875232130827392 ext(6291456->7340031) 00002000:00010000:0.0:1788361532.890917:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cd180 00000100:00100000:2.0:1788361532.898782:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+40:2350:x1875232130827520:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 31850us (33296us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361532.898795:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 316 00002000:00100000:2.0:1788361532.898809:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (7340032->8388607) req@ffff9a8a89265180 x1875232130827520/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.898821:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89265180 with x1875232130827520 ext(7340032->8388607) 00002000:00010000:2.0:1788361532.898828:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a89265180 00000100:00100000:3.0:1788361532.952516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.952619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361532.954189:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130827648 00000100:00100000:2.0:1788361532.954217:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130827648 00002000:00100000:2.0:1788361532.954326:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff9a8a870b0700 x1875232130827648/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.954338:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b0700 with x1875232130827648 ext(8388608->9437183) 00002000:00010000:2.0:1788361532.954344:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b0700 00000100:00100000:2.0:1788361532.954404:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130827776 00000100:00100000:2.0:1788361532.954407:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130827776 00002000:00100000:2.0:1788361532.954464:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff9a898705c700 x1875232130827776/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361532.954494:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705c700 with x1875232130827776 ext(9437184->10485759) 00002000:00010000:2.0:1788361532.954526:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898705c700 00000100:00100000:2.0:1788361532.954565:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 317 00000100:00100000:2.0:1788361532.954575:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+41:2350:x1875232130827648:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361532.955306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.955346:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130827904 00000100:00100000:3.0:1788361532.955351:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130827904 00002000:00100000:3.0:1788361532.955373:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff9a8a834cc380 x1875232130827904/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.955382:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cc380 with x1875232130827904 ext(10485760->11534335) 00002000:00010000:3.0:1788361532.955386:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cc380 00000100:00100000:3.0:1788361532.955404:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 318 00000100:00100000:3.0:1788361532.955411:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130827776:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:0.0:1788361532.956702:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 319 00000100:00100000:0.0:1788361532.956716:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130827904:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361532.958388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.958425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.958469:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130828160 00000100:00100000:1.0:1788361532.958469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361532.958480:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130828160 00000100:00100000:1.0:1788361532.958498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361532.958517:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130828416 00002000:00100000:3.0:1788361532.958524:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff9a8a834cd500 x1875232130828160/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.958535:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cd500 with x1875232130828160 ext(12582912->13631487) 00000100:00100000:1.0:1788361532.958547:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130828416 00002000:00010000:3.0:1788361532.958550:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cd500 00000100:00100000:3.0:1788361532.958569:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130828032 00002000:00100000:1.0:1788361532.958573:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff9a8a834cd880 x1875232130828416/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361532.958574:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130828032 00002000:00100000:1.0:1788361532.958586:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cd880 with x1875232130828416 ext(14680064->15728639) 00002000:00010000:1.0:1788361532.958591:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cd880 00002000:00100000:3.0:1788361532.958597:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff9a8a834cf100 x1875232130828032/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1788361532.958603:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130828288 00000100:00100000:1.0:1788361532.958608:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130828288 00002000:00100000:3.0:1788361532.958609:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cf100 with x1875232130828032 ext(11534336->12582911) 00002000:00010000:3.0:1788361532.958615:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cf100 00002000:00100000:1.0:1788361532.958629:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff9a8a834cfb80 x1875232130828288/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/0 e 0 to 0 dl 1788361543 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1788361532.958632:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 320 00002000:00100000:1.0:1788361532.958642:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cfb80 with x1875232130828288 ext(13631488->14680063) 00000100:00100000:3.0:1788361532.958645:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+49:2350:x1875232130828160:12345-192.168.203.60@tcp:3:lfs.0 00002000:00010000:1.0:1788361532.958648:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cfb80 00000100:00100000:3.0:1788361532.971619:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+49:2350:x1875232130827648:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 17036us (19102us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361532.971632:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 317 00002000:00100000:3.0:1788361532.971646:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (8388608->9437183) req@ffff9a8a870b0700 x1875232130827648/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.971656:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a870b0700 with x1875232130827648 ext(8388608->9437183) 00002000:00010000:3.0:1788361532.971663:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a870b0700 00000100:00100000:3.0:1788361532.971698:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 321 00000100:00100000:3.0:1788361532.971709:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+48:2350:x1875232130828416:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:0.0:1788361532.995494:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+47:2349:x1875232130827776:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 40070us (42861us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361532.995509:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 318 00002000:00100000:0.0:1788361532.995525:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (9437184->10485759) req@ffff9a898705c700 x1875232130827776/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.995536:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898705c700 with x1875232130827776 ext(9437184->10485759) 00002000:00010000:0.0:1788361532.995544:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a898705c700 00000100:00100000:0.0:1788361532.995579:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 322 00000100:00100000:0.0:1788361532.995592:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+46:2350:x1875232130828032:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361532.996311:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+46:2350:x1875232130828160:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 37666us (37928us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361532.996321:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 320 00002000:00100000:3.0:1788361532.996331:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (12582912->13631487) req@ffff9a8a834cd500 x1875232130828160/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361532.996357:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cd500 with x1875232130828160 ext(12582912->13631487) 00002000:00010000:3.0:1788361532.996362:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cd500 00000100:00100000:3.0:1788361532.996387:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 323 00000100:00100000:3.0:1788361532.996397:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+45:2350:x1875232130828288:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:0.0:1788361532.997368:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+45:2350:x1875232130828416:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 25659us (38940us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361532.997377:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 321 00002000:00100000:0.0:1788361532.997385:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcb:0x0] (14680064->15728639) req@ffff9a8a834cd880 x1875232130828416/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361532.997394:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cd880 with x1875232130828416 ext(14680064->15728639) 00002000:00010000:0.0:1788361532.997407:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cd880 00000100:00100000:1.0:1788361533.003448:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130827904:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 46723us (48131us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361533.003466:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 319 00002000:00100000:1.0:1788361533.003481:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcb:0x0] (10485760->11534335) req@ffff9a8a834cc380 x1875232130827904/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361533.003492:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cc380 with x1875232130827904 ext(10485760->11534335) 00002000:00010000:1.0:1788361533.003499:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cc380 00000100:00100000:1.0:1788361533.015356:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+42:2350:x1875232130828032:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 19761us (56878us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361533.015368:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 322 00002000:00100000:1.0:1788361533.015381:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcb:0x0] (11534336->12582911) req@ffff9a8a834cf100 x1875232130828032/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361533.015391:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cf100 with x1875232130828032 ext(11534336->12582911) 00002000:00010000:1.0:1788361533.015407:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cf100 00000100:00100000:3.0:1788361533.016485:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+40:2350:x1875232130828288:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 20083us (57980us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361533.016495:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 323 00002000:00100000:3.0:1788361533.016505:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcb:0x0] (13631488->14680063) req@ffff9a8a834cfb80 x1875232130828288/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:593/0 lens 488/440 e 0 to 0 dl 1788361543 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361533.016515:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cfb80 with x1875232130828288 ext(13631488->14680063) 00002000:00010000:3.0:1788361533.016520:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a834cfb80 00000100:00100000:2.0:1788361533.055365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361533.057726:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130828672 00000100:00100000:0.0:1788361533.057752:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130828672 00000100:00100000:0.0:1788361533.057842:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:0.0:1788361533.057852:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88353850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+53:37359:x1875232130828672:12345-192.168.203.60@tcp:35:lfs.500 00000100:00080000:2.0:1788361533.057855:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361533.058119:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88353850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:37359:x1875232130828672:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 268us (2764us total) trans 30064771425 rc 0/0 00000100:00100000:0.0:1788361533.058125:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:0.0:1788361533.106944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361533.107053:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130828800 00000100:00100000:2.0:1788361533.107064:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130828800 00000100:00100000:2.0:1788361533.107154:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 407 00000100:00100000:2.0:1788361533.107165:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+54:37365:x1875232130828800:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:2.0:1788361533.107188:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361533.107208:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6616226 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9d0 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107273:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661622d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107289:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661622d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107300:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661622d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107315:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6616234 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107321:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6616234 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107328:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6616234 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107443:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d661623b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107453:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d661623b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107461:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d661623b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361533.107488:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x29:0x0]: returning size 15728640 00000004:00200000:2.0:1788361533.107492:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361533.107512:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d661623b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107523:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d661623b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107532:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661622d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107538:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661622d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107544:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661622d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107550:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361533.107554:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661622d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107561:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661622d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107578:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:2.0:1788361533.107581:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361533.107586:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661622d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107592:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d661622d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107604:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6616234 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107610:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6616234 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107616:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6616234 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107621:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8985964a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361533.107624:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6616234 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107630:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6616234 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107636:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff9a8a83c0b900) 00010000:00010000:2.0:1788361533.107639:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361533.107642:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6616234 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107647:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964a00/0xf6a94c97d6616234 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107686:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964e00/0xf6a94c97d6616226 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9d0 expref: 56 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107700:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d661623b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9d0 expref: 55 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361533.107707:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:2.0:1788361533.107709:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361533.108876:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965e00, rc 0) 00000100:00100000:2.0:1788361533.108975:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:37365:x1875232130828800:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 1808us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361533.108984:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 407 00000100:00100000:2.0:1788361533.112403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361533.112495:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130829056 00000100:00100000:0.0:1788361533.112506:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130829056 00000100:00100000:0.0:1788361533.112564:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 408 00000100:00100000:0.0:1788361533.112573:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:37365:x1875232130829056:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:0.0:1788361533.112595:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361533.112613:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616242 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9d7 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.112712:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616249 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.112727:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616249 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.112821:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616249 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361533.112833:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x29:0x0]: returning size 15728640 00010000:00010000:0.0:1788361533.112959:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616242 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9d7 expref: 58 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.112992:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616249 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9d7 expref: 57 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.113001:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:0.0:1788361533.113003:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361533.113006:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:0.0:1788361533.113768:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+57:37365:x1875232130829056:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 1193us (1373us total) trans 30064771426 rc 0/0 00000100:00100000:0.0:1788361533.113777:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 408 00000100:00100000:1.0:1788361533.117585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361533.117750:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130829312 00000100:00100000:0.0:1788361533.117759:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130829312 00000100:00100000:0.0:1788361533.117817:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 409 00000100:00100000:0.0:1788361533.117827:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+57:37365:x1875232130829312:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:0.0:1788361533.117852:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361533.117855:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1788361533.117881:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9400/0xf6a94c97d66161cb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9ad expref: 57 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.117905:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616249 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9d7 expref: 56 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.117918:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965e00/0xf6a94c97d661623b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9d0 expref: 55 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.117930:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:0.0:1788361533.117949:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361533.117963:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616257 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9de expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118013:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d661625e lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118026:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d661625e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118036:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d661625e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118050:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d661625e lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118057:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d661625e lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118063:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d661625e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118070:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361533.118074:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d661625e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118081:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d661625e lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118247:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:0.0:1788361533.118251:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361533.118255:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d661625e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118267:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d661625e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118291:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6616265 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118298:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6616265 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.118305:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6616265 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.122932:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6616265 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9de expref: 57 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.122950:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:0.0:1788361533.122953:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361533.122970:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616257 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9de expref: 57 pid: 35346 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.122991:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8200/0xf6a94c97d6616265 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x29:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9de expref: 56 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.123021:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:0.0:1788361533.123023:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361533.123026:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8200, rc 0) 00000100:00100000:0.0:1788361533.123117:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+56:37365:x1875232130829312:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 5290us (5540us total) trans 30064771427 rc 0/0 00000100:00100000:0.0:1788361533.123126:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 409 00000100:00100000:1.0:1788361533.143462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361533.143555:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130829440 00000100:00100000:3.0:1788361533.143566:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130829440 00002000:00100000:3.0:1788361533.143614:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff9a8a834cdc00 x1875232130829440/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/0 e 0 to 0 dl 1788361544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361533.143626:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cdc00 with x1875232130829440 ext(0->1048575) 00002000:00010000:3.0:1788361533.143632:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834cdc00 00000100:00100000:3.0:1788361533.143663:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 324 00000100:00100000:3.0:1788361533.143672:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130829440:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361533.153552:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130829440:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 9868us (10087us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361533.153570:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 324 00002000:00100000:3.0:1788361533.153599:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (0->1048575) req@ffff9a8a834cdc00 x1875232130829440/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/440 e 0 to 0 dl 1788361544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361533.153610:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cdc00 with x1875232130829440 ext(0->1048575) 00002000:00010000:3.0:1788361533.153617:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834cdc00 00000100:00100000:0.0:1788361533.169398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361533.169492:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130829568 00000100:00100000:2.0:1788361533.169503:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130829568 00002000:00100000:2.0:1788361533.169548:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff9a8a8926d500 x1875232130829568/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/0 e 0 to 0 dl 1788361544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361533.169560:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926d500 with x1875232130829568 ext(1048576->2097151) 00002000:00010000:2.0:1788361533.169565:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926d500 00000100:00100000:2.0:1788361533.169597:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 325 00000100:00100000:2.0:1788361533.169608:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+43:2351:x1875232130829568:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361533.180142:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+43:2351:x1875232130829568:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 10525us (10742us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361533.180156:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 325 00002000:00100000:3.0:1788361533.180170:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (1048576->2097151) req@ffff9a8a8926d500 x1875232130829568/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/440 e 0 to 0 dl 1788361544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361533.180181:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926d500 with x1875232130829568 ext(1048576->2097151) 00002000:00010000:3.0:1788361533.180188:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a8926d500 00000100:00100000:2.0:1788361533.203339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361533.203392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361533.203473:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130829696 00000100:00100000:1.0:1788361533.203484:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130829696 00002000:00100000:1.0:1788361533.203535:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff9a8a89267100 x1875232130829696/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/0 e 0 to 0 dl 1788361544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361533.203548:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89267100 with x1875232130829696 ext(2097152->3145727) 00002000:00010000:1.0:1788361533.203554:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89267100 00000100:00100000:1.0:1788361533.203587:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130829824 00000100:00100000:1.0:1788361533.203591:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130829824 00002000:00100000:1.0:1788361533.203607:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff9a8a89266300 x1875232130829824/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/0 e 0 to 0 dl 1788361544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361533.203616:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89266300 with x1875232130829824 ext(3145728->4194303) 00002000:00010000:1.0:1788361533.203619:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89266300 00000100:00100000:1.0:1788361533.203652:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 326 00000100:00100000:1.0:1788361533.203662:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+44:2350:x1875232130829696:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361533.203681:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 327 00000100:00100000:3.0:1788361533.203694:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130829824:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361533.217759:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+45:2350:x1875232130829696:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 14087us (14417us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361533.217772:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 326 00002000:00100000:3.0:1788361533.217786:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcb:0x0] (2097152->3145727) req@ffff9a8a89267100 x1875232130829696/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/440 e 0 to 0 dl 1788361544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361533.217796:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89267100 with x1875232130829696 ext(2097152->3145727) 00002000:00010000:3.0:1788361533.217803:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89267100 00000100:00100000:2.0:1788361533.218140:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+43:2349:x1875232130829824:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 14448us (14746us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361533.218176:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 327 00002000:00100000:2.0:1788361533.218183:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (3145728->4194303) req@ffff9a8a89266300 x1875232130829824/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/440 e 0 to 0 dl 1788361544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361533.218192:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89266300 with x1875232130829824 ext(3145728->4194303) 00002000:00010000:2.0:1788361533.218196:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89266300 00000100:00100000:1.0:1788361533.244995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361533.245244:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130829952 00000100:00100000:0.0:1788361533.245256:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130829952 00002000:00100000:1.0:1788361533.245489:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff9a8a834cea00 x1875232130829952/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/0 e 0 to 0 dl 1788361544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361533.245501:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cea00 with x1875232130829952 ext(4194304->5242879) 00002000:00010000:1.0:1788361533.245507:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834cea00 00000100:00100000:1.0:1788361533.245580:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 328 00000100:00100000:1.0:1788361533.245590:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+43:2352:x1875232130829952:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:2.0:1788361533.246763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361533.246835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361533.246927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361533.246997:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130830208 00000100:00100000:0.0:1788361533.247004:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130830208 00002000:00100000:0.0:1788361533.247037:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff9a8a89266680 x1875232130830208/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/0 e 0 to 0 dl 1788361544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361533.247048:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89266680 with x1875232130830208 ext(6291456->7340031) 00002000:00010000:0.0:1788361533.247053:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89266680 00000100:00100000:0.0:1788361533.247078:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130830080 00000100:00100000:0.0:1788361533.247081:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130830080 00002000:00100000:0.0:1788361533.247114:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff9a8a89267480 x1875232130830080/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/0 e 0 to 0 dl 1788361544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361533.247123:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89267480 with x1875232130830080 ext(5242880->6291455) 00002000:00010000:0.0:1788361533.247126:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89267480 00000100:00100000:0.0:1788361533.247147:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 329 00000100:00100000:0.0:1788361533.247165:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+46:2352:x1875232130830208:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:0.0:1788361533.247837:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 330 00000100:00100000:0.0:1788361533.247846:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+47:2352:x1875232130830080:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:3.0:1788361533.248945:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130830336 00000100:00100000:3.0:1788361533.248953:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130830336 00002000:00100000:3.0:1788361533.248987:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff9a8a89265880 x1875232130830336/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/0 e 0 to 0 dl 1788361544 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361533.249010:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89265880 with x1875232130830336 ext(7340032->8388607) 00002000:00010000:3.0:1788361533.249015:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89265880 00000100:00100000:0.0:1788361533.249050:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 331 00000100:00100000:0.0:1788361533.249059:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+49:2352:x1875232130830336:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:1.0:1788361533.267169:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+49:2352:x1875232130829952:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 21209us (21812us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361533.267183:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 328 00002000:00100000:1.0:1788361533.267197:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcb:0x0] (4194304->5242879) req@ffff9a8a834cea00 x1875232130829952/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/440 e 0 to 0 dl 1788361544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361533.267209:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a834cea00 with x1875232130829952 ext(4194304->5242879) 00002000:00010000:1.0:1788361533.267216:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a834cea00 00000100:00100000:0.0:1788361533.267703:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89266680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:2352:x1875232130830208:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 20544us (20940us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361533.267712:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 329 00002000:00100000:0.0:1788361533.267720:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcb:0x0] (6291456->7340031) req@ffff9a8a89266680 x1875232130830208/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/440 e 0 to 0 dl 1788361544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361533.267751:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89266680 with x1875232130830208 ext(6291456->7340031) 00002000:00010000:0.0:1788361533.267756:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89266680 00000100:00100000:1.0:1788361533.273743:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+45:2352:x1875232130830080:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 25876us (26886us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361533.273757:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 330 00002000:00100000:1.0:1788361533.273770:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcb:0x0] (5242880->6291455) req@ffff9a8a89267480 x1875232130830080/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/440 e 0 to 0 dl 1788361544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361533.273781:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89267480 with x1875232130830080 ext(5242880->6291455) 00002000:00010000:1.0:1788361533.273788:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89267480 00000100:00100000:0.0:1788361533.278308:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+43:2352:x1875232130830336:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 29239us (31369us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361533.278321:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 331 00002000:00100000:0.0:1788361533.278333:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcb:0x0] (7340032->8388607) req@ffff9a8a89265880 x1875232130830336/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:594/0 lens 488/440 e 0 to 0 dl 1788361544 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361533.278343:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a89265880 with x1875232130830336 ext(7340032->8388607) 00002000:00010000:0.0:1788361533.278349:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a89265880 00000100:00100000:1.0:1788361533.303239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361533.303658:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130830592 00000100:00100000:0.0:1788361533.303669:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130830592 00000100:00100000:0.0:1788361533.303726:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:0.0:1788361533.303747:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+56:37365:x1875232130830592:12345-192.168.203.60@tcp:35:lfs.500 00000100:00100000:0.0:1788361533.304311:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+57:37365:x1875232130830592:12345-192.168.203.60@tcp:35:lfs.500 Request processed in 565us (1081us total) trans 30064771428 rc 0/0 00000100:00100000:0.0:1788361533.304321:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:2.0:1788361533.360957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361533.361066:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130830848 00000100:00100000:1.0:1788361533.361075:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130830848 00000100:00100000:1.0:1788361533.361177:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 410 00000100:00100000:1.0:1788361533.361187:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+57:37375:x1875232130830848:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361533.361214:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361533.361236:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d661626c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9e5 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361533.361427:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 512 00010000:00010000:1.0:1788361533.361566:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d661626c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9e5 expref: 59 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.361581:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:1.0:1788361533.361584:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361533.361589:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d661626c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9e5 expref: 59 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.361603:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8800, rc 0) 00000100:00100000:1.0:1788361533.361703:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+58:37375:x1875232130830848:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 517us (756us total) trans 30064771429 rc 301/301 00000100:00100000:1.0:1788361533.361710:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 410 00000100:00100000:2.0:1788361533.364402:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361533.364479:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130830976 00000100:00100000:0.0:1788361533.364488:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130830976 00000100:00100000:0.0:1788361533.364537:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 411 00000100:00100000:0.0:1788361533.364545:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+58:37375:x1875232130830976:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1788361533.364607:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d661627a lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364624:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d661627a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364647:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d661627a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364661:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616281 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364668:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616281 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364675:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616281 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364772:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364780:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364786:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361533.364821:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364832:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d661627a lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364838:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d661627a lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364845:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d661627a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364860:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f94400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361533.364864:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d661627a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364872:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d661627a lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364882:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:0.0:1788361533.364885:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361533.364889:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d661627a lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364895:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d661627a lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364906:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616281 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364911:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616281 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364917:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616281 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364922:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f94e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361533.364925:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616281 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364931:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616281 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364947:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff9a8a890c3300) 00010000:00010000:0.0:1788361533.364950:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361533.364952:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616281 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364958:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616281 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364969:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364975:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364981:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364985:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f95e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361533.364988:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.364994:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.365000:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:0.0:1788361533.365002:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361533.365004:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.365010:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d6616288 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361533.365079:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+58:37375:x1875232130830976:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 534us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361533.365153:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 411 00000100:00100000:2.0:1788361533.367471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361533.367514:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130831232 00000100:00100000:1.0:1788361533.367523:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130831232 00000100:00100000:1.0:1788361533.368495:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:1.0:1788361533.368510:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+58:37375:x1875232130831232:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788361533.368765:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+59:37375:x1875232130831232:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 260us (1301us total) trans 30064771430 rc 0/0 00000100:00100000:1.0:1788361533.368773:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:2.0:1788361533.418518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361533.418697:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130831488 00000100:00100000:0.0:1788361533.418706:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130831488 00000100:00100000:0.0:1788361533.418830:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 412 00000100:00100000:0.0:1788361533.418842:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+59:37385:x1875232130831488:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361533.418866:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361533.418885:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d661628f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9ec expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.419023:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616296 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.419039:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616296 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.419051:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616296 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361533.419063:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x27:0x0]: returning size 512 00010000:00010000:0.0:1788361533.419210:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d661628f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9ec expref: 62 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.419228:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94e00/0xf6a94c97d6616296 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9ec expref: 61 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.419237:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:0.0:1788361533.419266:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361533.419270:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8f94e00, rc 0) 00000100:00100000:0.0:1788361533.419331:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+61:37385:x1875232130831488:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 492us (963us total) trans 30064771431 rc 0/0 00000100:00100000:0.0:1788361533.419339:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 412 00000100:00100000:2.0:1788361533.421684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361533.421783:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130831616 00000100:00100000:3.0:1788361533.421792:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130831616 00000100:00100000:3.0:1788361533.421873:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 413 00000100:00100000:3.0:1788361533.421882:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+61:37385:x1875232130831616:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1788361533.421942:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66162a4 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.421956:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66162a4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.421966:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66162a4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.421978:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d66162ab lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.421985:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d66162ab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.421991:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d66162ab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422105:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422114:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422133:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361533.422167:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422180:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66162a4 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422186:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66162a4 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422192:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66162a4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422198:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bca200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361533.422202:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66162a4 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422210:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66162a4 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422221:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:3.0:1788361533.422225:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361533.422229:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66162a4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422233:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bca200/0xf6a94c97d66162a4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422241:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d66162ab lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422313:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d66162ab lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422319:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d66162ab lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422324:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcbe00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361533.422328:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d66162ab lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422334:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d66162ab lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422343:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0xa92decdb (ffff9a8a827d7900) 00010000:00010000:3.0:1788361533.422345:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361533.422348:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d66162ab lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422355:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcbe00/0xf6a94c97d66162ab lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0xa92decdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422370:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422376:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422381:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422385:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a89bcb200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361533.422394:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422400:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422408:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x29:0x0].0x0 (ffff9a8a83c0b000) 00010000:00010000:3.0:1788361533.422410:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361533.422413:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361533.422420:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a89bcb200/0xf6a94c97d66162b2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361533.422485:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+61:37385:x1875232130831616:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 604us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361533.422493:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 413 00000100:00100000:2.0:1788361533.468686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361533.468967:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130831744 00000100:00100000:1.0:1788361533.468978:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130831744 00000100:00100000:1.0:1788361533.469040:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 414 00000100:00100000:1.0:1788361533.469051:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+61:37391:x1875232130831744:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361533.469074:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361533.469154:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d66162b9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9f3 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469250:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d66162c0 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469266:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d66162c0 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469280:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d66162c0 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469294:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d66162c7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469301:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d66162c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469307:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d66162c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469544:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d66162ce lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469554:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d66162ce lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469560:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d66162ce lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361533.469719:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00000004:00200000:1.0:1788361533.469724:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361533.469756:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d66162ce lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469780:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d66162ce lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469789:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d66162c0 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469795:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d66162c0 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469802:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d66162c0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469808:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361533.469812:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d66162c0 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469821:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d66162c0 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469833:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x0 (ffff9a8a890c3a00) 00010000:00010000:1.0:1788361533.469836:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361533.469840:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d66162c0 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469846:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8200/0xf6a94c97d66162c0 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469858:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d66162c7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469865:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d66162c7 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469878:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d66162c7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469883:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361533.469887:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d66162c7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469893:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d66162c7 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469901:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x27:0x0].0x4f74ecdb (ffff9a8aa8ee1800) 00010000:00010000:1.0:1788361533.469903:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361533.469906:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d66162c7 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469912:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9e00/0xf6a94c97d66162c7 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x27:0x0].0x4f74ecdb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469944:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8800/0xf6a94c97d66162b9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9f3 expref: 63 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469957:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9000/0xf6a94c97d66162ce lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9f3 expref: 62 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.469964:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:1.0:1788361533.469967:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361533.469969:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9000, rc 0) 00000100:00100000:1.0:1788361533.470818:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+62:37391:x1875232130831744:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1764us (2138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361533.470836:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 414 00000100:00100000:2.0:1788361533.474525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361533.474723:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130832000 00000100:00100000:0.0:1788361533.474745:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130832000 00000100:00100000:0.0:1788361533.474847:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 415 00000100:00100000:0.0:1788361533.474858:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+62:37391:x1875232130832000:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361533.474878:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361533.474897:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d66162d5 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86f9fa expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.474991:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d66162dc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.475006:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d66162dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.475018:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d66162dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361533.475029:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x28:0x0]: returning size 15728640 00010000:00010000:0.0:1788361533.475182:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95e00/0xf6a94c97d66162d5 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x27:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9fa expref: 65 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.475200:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d66162dc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9fa expref: 64 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361533.475226:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:0.0:1788361533.475229:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361533.475233:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8f94400, rc 0) 00000100:00100000:0.0:1788361533.475299:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+64:37391:x1875232130832000:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 443us (783us total) trans 30064771432 rc 0/0 00000100:00100000:0.0:1788361533.475306:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 415 00000100:00100000:2.0:1788361533.480222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361533.480263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361533.480379:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130832384 00000100:00100000:1.0:1788361533.480389:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130832384 00000100:00100000:1.0:1788361533.480474:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1788361533.480484:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+64:2352:x1875232130832384:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361533.480503:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361533.480525:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94400/0xf6a94c97d66162dc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f9fa expref: 64 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361533.480541:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x28:0x0].0x0 (ffff9a8984a32100) 00010000:00010000:1.0:1788361533.480546:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361533.480595:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+63:2352:x1875232130832384:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 114us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361533.480602:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1788361533.481019:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130832256 00000100:00100000:0.0:1788361533.481025:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130832256 00000100:00100000:0.0:1788361533.481063:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:0.0:1788361533.481071:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+63:37391:x1875232130832256:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361533.481530:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+64:37391:x1875232130832256:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 459us (1316us total) trans 30064771433 rc 0/0 00000100:00100000:0.0:1788361533.481538:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:2.0:1788361533.579197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361533.579254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361533.579386:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130832512 00000100:00100000:0.0:1788361533.579396:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130832512 00000100:00100000:0.0:1788361533.579452:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:0.0:1788361533.579463:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130832512:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361533.579689:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130832512:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 226us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361533.579697:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:3.0:1788361533.579760:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130832640 00000100:00100000:3.0:1788361533.579766:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130832640 00000100:00100000:3.0:1788361533.581173:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:3.0:1788361533.581191:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130832640:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361533.581311:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130832640:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 125us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361533.581320:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000001:00080000:1.0:1788361533.676481:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771433 is committed 00000004:00080000:1.0:1788361533.676517:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 13 committed 00000004:00080000:1.0:1788361533.676542:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 14 committed 00000100:00100000:1.0:1788361533.676787:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361533.676808:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144238208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788361533.676874:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361533.676929:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361533.676937:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144238336:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788361533.676963:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361533.676991:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144238208 00000100:00100000:1.0:1788361533.677005:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144238208 00000100:00100000:1.0:1788361533.677061:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144238336 00000100:00100000:1.0:1788361533.677064:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144238336 00000100:00100000:2.0:1788361533.677154:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788361533.677165:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144238208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788361533.677372:0:35982:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:2.0:1788361533.677377:0:35982:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb mtime from disk: 1788361533 -> 1788361533 00002000:00010000:2.0:1788361533.677379:0:35982:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361533.677382:0:35982:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb ctime from disk: 1788361533 -> 1788361533 00002000:00010000:2.0:1788361533.677394:0:35982:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 30727 00000100:00100000:2.0:1788361533.677437:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144238208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 274us (562us total) trans 30064771268 rc 0/0 00000100:00100000:2.0:1788361533.677446:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788361533.677467:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788361533.677497:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a834cca80/2, rc 0, transno 30064771268 00000100:00100000:2.0:1788361533.677503:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144238208:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788361533.677847:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788361533.677854:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144238336:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788361533.677942:0:36286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb size from disk: 15728640 -> 15728640 00002000:00010000:1.0:1788361533.677945:0:36286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb mtime from disk: 1788361533 -> 1788361533 00002000:00010000:1.0:1788361533.677947:0:36286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361533.677948:0:36286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb ctime from disk: 1788361533 -> 1788361533 00002000:00010000:1.0:1788361533.677950:0:36286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788361533.677984:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144238336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (1020us total) trans 30064771199 rc 0/0 00000100:00100000:1.0:1788361533.677991:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000004:00080000:1.0:1788361533.678031:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a89f27480/2, rc 0, transno 30064771199 00000100:00100000:1.0:1788361533.678037:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144238336:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1788361533.678649:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788361533.688293:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771265 is committed 00000001:00080000:0.0:1788361533.688335:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771251 is committed 00000001:00080000:0.0:1788361533.688342:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771267 is committed 00010000:00010000:1.0:1788361533.856341:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788361534.682377:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771196 is committed 00000001:00080000:3.0:1788361534.682424:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771199 is committed 00000001:00080000:3.0:1788361534.682429:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771198 is committed 00010000:00010000:3.0:1788361534.880224:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361535.905227:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361536.303534:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361536.303780:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130832768 00000100:00100000:1.0:1788361536.303802:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130832768 00000100:00100000:1.0:1788361536.303872:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 416 00000100:00100000:1.0:1788361536.303881:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+43:37334:x1875232130832768:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00080000:2.0:1788361536.303921:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361536.303985:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b063800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+43:37334:x1875232130832768:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 104us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361536.303992:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 416 00000100:00100000:2.0:1788361536.307487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361536.307574:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130833024 00000100:00100000:1.0:1788361536.307584:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130833024 00000100:00100000:1.0:1788361536.307645:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:1.0:1788361536.307655:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+43:37334:x1875232130833024:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788361536.308818:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+44:37334:x1875232130833024:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1154us (1328us total) trans 30064771434 rc 0/0 00000100:00100000:1.0:1788361536.308838:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:3.0:1788361536.469961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361536.470113:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130833152 00000100:00100000:0.0:1788361536.470129:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130833152 00000100:00100000:0.0:1788361536.470213:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 417 00000100:00100000:0.0:1788361536.470224:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:37831:x1875232130833152:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:0.0:1788361536.470248:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361536.470268:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66162ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa01 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361536.470530:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361536.470553:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361536.470565:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361536.470798:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1788361536.470802:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361536.470865:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361536.470887:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66162ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa01 expref: 7 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361536.470901:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa01 expref: 6 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361536.470909:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361536.470911:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361536.470914:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8f95200, rc 0) 00000100:00080000:2.0:1788361536.471119:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361536.471191:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:37831:x1875232130833152:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 969us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361536.471198:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 417 00000100:00100000:3.0:1788361536.672696:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144238464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361536.672780:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361536.672791:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361536.672809:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144238720:0@lo:400:kworker.0 00000100:00100000:3.0:1788361536.672842:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144238976:0@lo:400:kworker.0 00000100:00100000:1.0:1788361536.672843:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361536.672851:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144239104:0@lo:400:kworker.0 00000100:00100000:3.0:1788361536.672867:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361536.672867:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144238592:0@lo:400:kworker.0 00000100:00100000:3.0:1788361536.672888:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361536.672894:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144238848:0@lo:400:kworker.0 00000100:00100000:0.0:1788361536.672970:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144238464 00000100:00100000:0.0:1788361536.672981:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144238464 00000100:00100000:0.0:1788361536.673045:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788361536.673054:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144238464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361536.673106:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3709861888 avail 3707764736 00000100:00100000:2.0:1788361536.674789:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361536.674836:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361536.674847:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144239232:0@lo:400:kworker.0 00000100:00100000:2.0:1788361536.674887:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361536.674923:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144238720 00000100:00100000:2.0:1788361536.674929:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144238720 00000100:00100000:2.0:1788361536.674974:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788361536.674982:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144238720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361536.675027:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144238720:12345-0@lo:400:kworker.0 Request processed in 46us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361536.675034:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788361536.675058:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144238976 00000100:00100000:2.0:1788361536.675062:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144238976 00000100:00100000:2.0:1788361536.675102:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144239104 00000100:00100000:2.0:1788361536.675106:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144239104 00000100:00100000:2.0:1788361536.675148:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144239232 00000100:00100000:2.0:1788361536.675152:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144239232 00000100:00100000:2.0:1788361536.675168:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788361536.675176:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144238976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361536.675214:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144238976:12345-0@lo:400:kworker.0 Request processed in 39us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361536.675221:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788361536.675233:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788361536.675239:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144239104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361536.675271:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144239104:12345-0@lo:400:kworker.0 Request processed in 33us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361536.675278:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788361536.675289:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788361536.675295:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144239232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361536.675321:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144239232:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361536.675327:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788361536.675365:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144239232:0@lo:400:kworker.0 00000100:00100000:2.0:1788361536.675378:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144239104:0@lo:400:kworker.0 00000100:00080000:2.0:1788361536.675432:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361536.675437:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361536.675440:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361536.675576:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361536.675599:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361536.675615:0:3314:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771199 gen 2 00000004:00080000:1.0:1788361536.675620:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a89f27480, transno 30064771199 00000100:00100000:3.0:1788361536.675624:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b061880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144238976:0@lo:400:kworker.0 00000100:00100000:1.0:1788361536.675630:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b061500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144238720:0@lo:400:kworker.0 00000100:00100000:3.0:1788361536.675644:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144238848 00000100:00100000:3.0:1788361536.675647:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144238848 00000100:00100000:3.0:1788361536.675671:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788361536.675676:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144238848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361536.675721:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144238848:12345-0@lo:400:kworker.0 Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361536.675727:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788361536.675750:0:3312:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771251 gen 2 00000004:00080000:3.0:1788361536.675754:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ab7141880, transno 30064771251 00000100:00100000:3.0:1788361536.675766:0:3312:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8a834cca80 x1875232144238208/t30064771268(30064771268) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788361549 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788361536.675775:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144238848:0@lo:400:kworker.0 00000100:00100000:0.0:1788361536.675871:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144238464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2818us (3091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361536.675880:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788361536.676158:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144238464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361536.677116:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144238592 00000100:00100000:2.0:1788361536.677123:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144238592 00000100:00100000:2.0:1788361536.677169:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788361536.677177:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144238592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361536.677253:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144238592:12345-0@lo:400:kworker.0 Request processed in 77us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361536.677262:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788361536.677300:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b060e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144238592:0@lo:400:kworker.0 00010000:00010000:1.0:1788361536.928280:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361537.184360:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144239360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361537.184434:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361537.184520:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144239360 00000100:00100000:3.0:1788361537.184528:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144239360 00000100:00100000:3.0:1788361537.184574:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788361537.184582:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144239360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361537.184628:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 204406784 pending 0 free 3772776448 avail 3770679296 00000100:00100000:3.0:1788361537.184690:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144239360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361537.184698:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788361537.184964:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b062680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144239360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788361537.953752:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361538.075736:0:39200:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10e: Tolerate -EDQUOT failure when auto PCC-RO attach with user quota ========================================================== 11:05:38 (1788361538) 00000100:00100000:2.0:1788361538.697600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361538.697638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361538.697667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361538.697709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361538.697778:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130833280 00000100:00100000:2.0:1788361538.697787:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361538.697788:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130833280 00000100:00100000:2.0:1788361538.697812:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130833792 00000100:00100000:2.0:1788361538.697817:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130833792 00000100:00100000:1.0:1788361538.697857:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:2.0:1788361538.697858:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130833408 00000100:00100000:2.0:1788361538.697861:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130833408 00000100:00100000:1.0:1788361538.697869:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130833280:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361538.697881:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:2.0:1788361538.697889:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130833792:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361538.697950:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130833536 00000100:00100000:3.0:1788361538.697955:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130833536 00000100:00100000:1.0:1788361538.697956:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130833280:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 87us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361538.697965:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:3.0:1788361538.697984:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130833664 00000100:00100000:3.0:1788361538.697987:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130833664 00000100:00100000:3.0:1788361538.698019:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:3.0:1788361538.698027:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130833536:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361538.698038:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1788361538.698051:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130833408:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361538.700481:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130833792:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 2582us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361538.700495:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:2.0:1788361538.700547:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:2.0:1788361538.700559:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2349:x1875232130833664:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361538.700603:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2349:x1875232130833664:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 48us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361538.700609:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00080000:2.0:1788361538.700628:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361538.700633:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361538.700636:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361538.703953:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+9:2350:x1875232130833536:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 5915us (6302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361538.703969:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:0.0:1788361538.704478:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+44:2349:x1875232130833408:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 6427us (6764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361538.704489:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000001:00080000:1.0:1788361538.744945:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771434 is committed 00000001:00080000:0.0:1788361538.747506:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771268 is committed 00010000:00010000:3.0:1788361538.977350:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361539.100234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.100920:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130834048 00000100:00100000:0.0:1788361539.100931:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130834048 00000100:00100000:0.0:1788361539.100989:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 418 00000100:00100000:0.0:1788361539.100999:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+43:38116:x1875232130834048:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361539.101019:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361539.101029:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788361539.101053:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616123 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86f96e expref: 43 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.101072:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361539.101077:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361539.101148:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66162f8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa08 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.101481:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.101496:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa01 expref: 5 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.101557:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.101589:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa01 expref: 5 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.101601:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa01 expref: 5 pid: 35346 timeout: 1029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361539.101616:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144239488:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361539.101703:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8987026f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361539.104774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.105148:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130834176 00000100:00100000:2.0:1788361539.105158:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130834176 00010000:00010000:2.0:1788361539.105200:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa01 expref: 6 pid: 35346 timeout: 1029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361539.105280:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788361539.105290:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130834176:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361539.105305:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361539.105313:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa01 expref: 6 pid: 35346 timeout: 1029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.105340:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa01 expref: 6 pid: 35346 timeout: 1029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.105363:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:2.0:1788361539.105367:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.105377:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.105384:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.105403:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361539.105461:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130834176:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 172us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.105470:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00010000:00010000:0.0:1788361539.105542:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66162f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa01 expref: 5 pid: 35346 timeout: 1029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361539.105576:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144239488:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361539.105607:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.105617:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.105623:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.105645:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.105655:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.105664:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361539.106766:0:37122:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcc:0x0], index 0: 0 00010000:00010000:0.0:1788361539.107013:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d661630d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107027:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d661630d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107037:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d661630d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107070:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107083:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107132:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107139:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f95400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.107143:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107151:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107163:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361539.107166:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.107170:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107176:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d66162ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361539.107189:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e3477f3c reply state 00000000088d7517 transno 30064771435 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361539.107197:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361539.107229:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66162f8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa08 expref: 45 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107248:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d661630d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa08 expref: 44 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.107266:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.107268:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361539.107271:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8f95600, rc 0) 00000100:00100000:0.0:1788361539.107324:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+45:38116:x1875232130834048:12345-192.168.203.60@tcp:101:dd.0 Request processed in 6326us (7098us total) trans 30064771435 rc 0/0 00000100:00100000:0.0:1788361539.107333:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 418 00010000:00010000:0.0:1788361539.111120:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.111139:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.111147:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.111154:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f95800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.111159:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.111166:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.111182:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361539.111185:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.111189:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.111195:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d6616306 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361539.115771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.116068:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130834304 00000100:00100000:2.0:1788361539.116123:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130834304 00000100:00100000:2.0:1788361539.116268:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:2.0:1788361539.116279:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+9:38116:x1875232130834304:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361539.116297:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.116315:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006507f16e/0xf6a94c97d661631b lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa0f expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788361539.116339:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788361539.116360:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcc:0x0].0x0 since=929s v=(0 0) 00010000:00010000:2.0:1788361539.116364:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361539.116374:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006507f16e/0xf6a94c97d661631b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa0f expref: 10 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.116390:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006507f16e/0xf6a94c97d661631b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa0f expref: 10 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.116404:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abc459a00, rc 0) 00000100:00100000:2.0:1788361539.116472:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:38116:x1875232130834304:12345-192.168.203.60@tcp:101:dd.0 Request processed in 195us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.116479:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:3.0:1788361539.132289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.132801:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130834432 00000100:00100000:2.0:1788361539.132812:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130834432 00002000:00100000:2.0:1788361539.132863:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff9a8ab7141880 x1875232130834432/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361539.132875:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7141880 with x1875232130834432 ext(0->1048575) 00002000:00010000:2.0:1788361539.132880:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7141880 00000100:00100000:2.0:1788361539.132978:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 332 00000100:00100000:2.0:1788361539.132988:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130834432:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361539.145050:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.145221:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130834688 00000100:00100000:0.0:1788361539.145231:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130834688 00000100:00100000:0.0:1788361539.145285:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:0.0:1788361539.145294:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+44:38116:x1875232130834688:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:2.0:1788361539.145467:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130834432:12345-192.168.203.60@tcp:4:dd.0 Request processed in 12479us (13188us total) trans 30064771200 rc 0/0 00000100:00100000:2.0:1788361539.145477:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 332 00002000:00100000:2.0:1788361539.145486:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff9a8ab7141880 x1875232130834432/t30064771200(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/448 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361539.145495:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab7141880 with x1875232130834432 ext(0->1048575) 00002000:00010000:2.0:1788361539.145501:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab7141880 00000100:00100000:0.0:1788361539.145522:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+45:38116:x1875232130834688:12345-192.168.203.60@tcp:35:dd.0 Request processed in 228us (482us total) trans 30064771436 rc 0/0 00000100:00100000:0.0:1788361539.145542:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:3.0:1788361539.145901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.146071:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130834816 00000100:00100000:0.0:1788361539.146076:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130834816 00002000:00100000:0.0:1788361539.146119:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff9a8a835e3100 x1875232130834816/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361539.146261:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a835e3100 with x1875232130834816 ext(1048576->2097151) 00002000:00010000:0.0:1788361539.146265:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a835e3100 00000100:00100000:0.0:1788361539.146291:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 333 00000100:00100000:0.0:1788361539.146299:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130834816:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361539.153554:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130834816:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7244us (7641us total) trans 30064771201 rc 0/0 00000100:00100000:0.0:1788361539.153568:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 333 00002000:00100000:0.0:1788361539.153582:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff9a8a835e3100 x1875232130834816/t30064771201(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/448 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361539.153592:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a835e3100 with x1875232130834816 ext(1048576->2097151) 00002000:00010000:0.0:1788361539.153599:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a835e3100 00000100:00100000:1.0:1788361539.160275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.160824:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130834944 00000100:00100000:2.0:1788361539.160833:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130834944 00000100:00100000:2.0:1788361539.160885:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 419 00000100:00100000:2.0:1788361539.160892:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+45:38117:x1875232130834944:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361539.160911:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.160927:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459000/0xf6a94c97d6616322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa16 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.160977:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616329 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.160987:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.160995:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361539.161041:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1788361539.161327:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361539.161351:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.161370:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459000/0xf6a94c97d6616322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa16 expref: 47 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.161382:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa16 expref: 46 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.161388:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361539.161390:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361539.161393:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abc458a00, rc 0) 00000100:00100000:2.0:1788361539.161441:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+46:38117:x1875232130834944:12345-192.168.203.60@tcp:101:chown.0 Request processed in 550us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.161446:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 419 00000100:00100000:0.0:1788361539.163607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.163705:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130835072 00000100:00100000:2.0:1788361539.163714:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130835072 00000100:00100000:2.0:1788361539.163866:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 420 00000100:00100000:2.0:1788361539.163877:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+46:38117:x1875232130835072:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361539.163893:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.163909:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458000/0xf6a94c97d6616330 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa1d expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.163940:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458600/0xf6a94c97d6616337 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.163951:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458600/0xf6a94c97d6616337 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.163973:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458600/0xf6a94c97d6616337 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.164056:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458000/0xf6a94c97d6616330 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa1d expref: 48 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.164073:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458600/0xf6a94c97d6616337 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa1d expref: 47 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.164080:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.164083:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788361539.164107:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abc458600, rc 0) 00000100:00100000:2.0:1788361539.164161:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+47:38117:x1875232130835072:12345-192.168.203.60@tcp:101:chown.0 Request processed in 287us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.164168:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 420 00000100:00100000:1.0:1788361539.165783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.165874:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130835328 00000100:00100000:0.0:1788361539.165880:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130835328 00000100:00100000:0.0:1788361539.165932:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 421 00000100:00100000:0.0:1788361539.165942:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+47:38117:x1875232130835328:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:0.0:1788361539.165989:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361539.166005:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d661630d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa08 expref: 47 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.166015:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.166018:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361539.166036:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.166044:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.166050:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361539.167270:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].15, 88 off9344 00000004:00080000:0.0:1788361539.167279:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 929182192766ns, next at 930182191183ns, rc = 0 00000004:00010000:0.0:1788361539.167350:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087d15158 reply state 00000000893a41b3 transno 30064771437 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361539.167360:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361539.167451:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+48:38117:x1875232130835328:12345-192.168.203.60@tcp:36:chown.0 Request processed in 1510us (1670us total) trans 30064771437 rc 0/0 00000100:00100000:0.0:1788361539.167459:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 421 00010000:00010000:2.0:1788361539.168791:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.168800:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.168804:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.168808:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f95800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.168811:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.168817:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.168838:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.168840:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788361539.168843:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.168847:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d661633e lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361539.169121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.169188:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130835456 00000100:00100000:2.0:1788361539.169196:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130835456 00000100:00100000:2.0:1788361539.169280:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 422 00000100:00100000:2.0:1788361539.169290:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:38117:x1875232130835456:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361539.169307:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.169320:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459000/0xf6a94c97d6616345 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa24 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.169368:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459000/0xf6a94c97d6616345 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa24 expref: 48 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.169380:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459000/0xf6a94c97d6616345 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa24 expref: 48 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.169396:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.169399:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361539.169402:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abc459000, rc 0) 00000100:00100000:2.0:1788361539.169450:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+48:38117:x1875232130835456:12345-192.168.203.60@tcp:101:chown.0 Request processed in 162us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.169466:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 422 00000100:00100000:1.0:1788361539.170719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.171172:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130835584 00000100:00100000:2.0:1788361539.171180:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130835584 00000100:00100000:2.0:1788361539.171229:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:2.0:1788361539.171238:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2351:x1875232130835584:12345-192.168.203.60@tcp:2:chown.0 00002000:00010000:2.0:1788361539.171411:0:35983:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1788361539.171415:0:35983:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 0 -> 1788361539 00002000:00010000:2.0:1788361539.171418:0:35983:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361539.171420:0:35983:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 0 -> 1788361539 00002000:00010000:2.0:1788361539.171422:0:35983:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361539.171467:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2351:x1875232130835584:12345-192.168.203.60@tcp:2:chown.0 Request processed in 230us (750us total) trans 30064771202 rc 0/0 00000100:00100000:2.0:1788361539.171475:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:3.0:1788361539.198269:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.198471:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130835840 00000100:00100000:2.0:1788361539.198485:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130835840 00000100:00100000:2.0:1788361539.198549:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 423 00000100:00100000:2.0:1788361539.198560:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+48:38123:x1875232130835840:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:2.0:1788361539.198584:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.198607:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458000/0xf6a94c97d661634c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa2b expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.198687:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d6616353 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.198716:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d6616353 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.198745:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d6616353 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.198762:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d661635a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.198769:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d661635a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.198776:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d661635a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.198918:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458e00/0xf6a94c97d6616361 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.198927:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458e00/0xf6a94c97d6616361 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.198935:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458e00/0xf6a94c97d6616361 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361539.198945:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00010000:00010000:2.0:1788361539.199045:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d6616353 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199054:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d6616353 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199060:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d6616353 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199067:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc459e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.199077:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d6616353 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199129:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d6616353 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199143:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361539.199147:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.199151:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d6616353 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199157:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d6616353 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199171:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d661635a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199177:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d661635a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199183:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d661635a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199188:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc458400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.199191:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d661635a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199197:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d661635a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.199204:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788361539.199207:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.201045:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d661635a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.201056:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d661635a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.201141:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458000/0xf6a94c97d661634c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa2b expref: 51 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.201157:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458e00/0xf6a94c97d6616361 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa2b expref: 50 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.201165:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.201168:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361539.201170:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abc458e00, rc 0) 00000100:00100000:2.0:1788361539.201249:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+50:38123:x1875232130835840:12345-192.168.203.60@tcp:101:dd.500 Request processed in 2689us (3048us total) trans 30064771438 rc 0/0 00000100:00100000:2.0:1788361539.201257:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 423 00000100:00100000:1.0:1788361539.203972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.204072:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130836096 00000100:00100000:0.0:1788361539.204168:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130836096 00000100:00100000:0.0:1788361539.204256:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 424 00000100:00100000:0.0:1788361539.204267:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+50:38123:x1875232130836096:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:0.0:1788361539.204291:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361539.204294:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1788361539.204318:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459000/0xf6a94c97d6616345 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa24 expref: 50 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204341:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458e00/0xf6a94c97d6616361 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa2b expref: 49 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204353:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.204357:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361539.204370:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d661636f lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa32 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204409:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616376 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204422:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616376 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204433:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616376 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204446:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616376 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204453:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616376 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204472:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616376 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204478:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f94200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.204482:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616376 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204490:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616376 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204500:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.204503:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361539.204506:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616376 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204512:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616376 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204537:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d661637d lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204545:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d661637d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204552:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d661637d lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204783:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d661637d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa32 expref: 51 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204791:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.204799:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361539.204811:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d661636f lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa32 expref: 51 pid: 37122 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204824:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d661637d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa32 expref: 50 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.204849:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.204852:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361539.204854:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8f95400, rc 0) 00000100:00100000:0.0:1788361539.204911:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+50:38123:x1875232130836096:12345-192.168.203.60@tcp:101:dd.500 Request processed in 645us (946us total) trans 30064771439 rc 0/0 00000100:00100000:0.0:1788361539.204919:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 424 00000100:00100000:3.0:1788361539.215529:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361539.215786:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130836224 00000100:00100000:1.0:1788361539.215795:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130836224 00002000:00100000:1.0:1788361539.215843:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff9a8a835e2300 x1875232130836224/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361539.215854:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a835e2300 with x1875232130836224 ext(0->1048575) 00002000:00010000:1.0:1788361539.215860:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a835e2300 00000100:00100000:1.0:1788361539.215899:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 334 00000100:00100000:1.0:1788361539.215909:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130836224:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:0.0:1788361539.230137:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130836224:12345-192.168.203.60@tcp:3:dd.0 Request processed in 14216us (14610us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361539.230151:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 334 00002000:00100000:0.0:1788361539.230164:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff9a8a835e2300 x1875232130836224/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/440 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361539.230175:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a835e2300 with x1875232130836224 ext(0->1048575) 00002000:00010000:0.0:1788361539.230183:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a835e2300 00000100:00100000:1.0:1788361539.241922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361539.242029:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130836352 00000100:00100000:3.0:1788361539.242040:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130836352 00002000:00100000:3.0:1788361539.242112:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff9a8ac0a52300 x1875232130836352/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361539.242124:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a52300 with x1875232130836352 ext(1048576->2097151) 00002000:00010000:3.0:1788361539.242130:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a52300 00000100:00100000:2.0:1788361539.242200:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 335 00000100:00100000:2.0:1788361539.242218:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130836352:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:2.0:1788361539.248361:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130836352:12345-192.168.203.60@tcp:3:dd.0 Request processed in 6140us (6438us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361539.248376:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 335 00002000:00100000:2.0:1788361539.248391:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff9a8ac0a52300 x1875232130836352/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/440 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361539.248403:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a52300 with x1875232130836352 ext(1048576->2097151) 00002000:00010000:2.0:1788361539.248411:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a52300 00000100:00100000:3.0:1788361539.261398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.261561:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130836608 00000100:00100000:0.0:1788361539.261572:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130836608 00000100:00100000:0.0:1788361539.261632:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:0.0:1788361539.261642:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88352c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+50:38123:x1875232130836608:12345-192.168.203.60@tcp:35:dd.500 00000100:00100000:0.0:1788361539.261914:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88352c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+51:38123:x1875232130836608:12345-192.168.203.60@tcp:35:dd.500 Request processed in 274us (526us total) trans 30064771440 rc 0/0 00000100:00100000:0.0:1788361539.261931:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:3.0:1788361539.301181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.301262:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130836736 00000100:00100000:2.0:1788361539.301279:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130836736 00000100:00100000:2.0:1788361539.301331:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 425 00000100:00100000:2.0:1788361539.301341:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+51:38133:x1875232130836736:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361539.301414:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616384 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301431:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301443:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301457:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d661638b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301462:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d661638b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301466:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d661638b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301547:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301555:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301562:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361539.301598:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301623:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616384 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301627:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616384 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301632:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616384 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301638:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc458400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.301643:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616384 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301651:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616384 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301663:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361539.301666:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.301671:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301677:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301700:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d661638b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301706:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d661638b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301712:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d661638b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301723:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc459e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.301727:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d661638b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301733:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d661638b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301741:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788361539.301744:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.301746:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d661638b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301752:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d661638b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301765:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301770:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301775:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301780:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc458c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.301782:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301787:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.301802:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.301805:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.302067:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.302074:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458c00/0xf6a94c97d6616392 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361539.302210:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+51:38133:x1875232130836736:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 869us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.302218:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 425 00000100:00100000:2.0:1788361539.328246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.328511:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130836992 00000100:00100000:0.0:1788361539.328522:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130836992 00000100:00100000:0.0:1788361539.328611:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 426 00000100:00100000:0.0:1788361539.328621:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+51:38134:x1875232130836992:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361539.328641:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361539.328660:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa39 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328744:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66163a0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328774:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66163a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328786:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66163a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328804:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66163a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328813:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66163a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328820:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66163a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328916:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66163a0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328939:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66163a0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328946:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66163a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328952:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f94200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.328956:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66163a0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328963:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66163a0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328975:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:0.0:1788361539.328978:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.328983:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66163a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.328989:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d66163a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.329003:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66163a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.329008:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66163a7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.329015:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66163a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.329020:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f95200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.329029:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66163a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.329036:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66163a7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.329044:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361539.329046:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.329049:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66163a7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.329055:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d66163a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.329131:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616399 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa39 expref: 52 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.329141:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:0.0:1788361539.329143:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361539.329146:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa39 expref: 52 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.329156:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8f95600, rc 0) 00000100:00100000:0.0:1788361539.329213:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+51:38134:x1875232130836992:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 595us (977us total) trans 0 rc 301/301 00000100:00100000:0.0:1788361539.329220:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 426 00000100:00100000:3.0:1788361539.332331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.332487:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130837120 00000100:00100000:0.0:1788361539.332498:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130837120 00000100:00100000:0.0:1788361539.332562:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 427 00000100:00100000:0.0:1788361539.332572:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+51:38134:x1875232130837120:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1788361539.332649:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94c00/0xf6a94c97d66163ae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.332665:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94c00/0xf6a94c97d66163ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.332676:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94c00/0xf6a94c97d66163ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.332704:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.332712:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.332720:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333466:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333477:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333485:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361539.333519:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00000004:00200000:0.0:1788361539.333523:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361539.333536:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333549:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94c00/0xf6a94c97d66163ae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333565:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94c00/0xf6a94c97d66163ae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333572:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94c00/0xf6a94c97d66163ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333578:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f94c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.333582:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94c00/0xf6a94c97d66163ae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333589:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94c00/0xf6a94c97d66163ae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333600:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:0.0:1788361539.333603:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.333607:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94c00/0xf6a94c97d66163ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333613:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94c00/0xf6a94c97d66163ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333624:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333629:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163b5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333634:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333639:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f95800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.333649:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333656:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163b5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333663:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361539.333665:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.333668:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163b5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.333674:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.334056:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.334063:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.334069:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.334074:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f94800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.334077:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.334083:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.334126:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.334129:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.334139:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.334145:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163bc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361539.334235:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+51:38134:x1875232130837120:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1661us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361539.334244:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 427 00000100:00100000:3.0:1788361539.375290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.375434:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130837376 00000100:00100000:2.0:1788361539.375445:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130837376 00000100:00100000:2.0:1788361539.375506:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 428 00000100:00100000:2.0:1788361539.375516:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+51:38140:x1875232130837376:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361539.375537:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.375541:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361539.375566:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616329 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa16 expref: 51 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376055:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361539.376069:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361539.376144:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d66163c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa40 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376292:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d66163ca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376315:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d66163ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376326:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d66163ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376340:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376348:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376355:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376429:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459800/0xf6a94c97d66163d8 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376438:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459800/0xf6a94c97d66163d8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376445:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459800/0xf6a94c97d66163d8 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361539.376455:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 2097152 00010000:00010000:2.0:1788361539.376555:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d66163ca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376563:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d66163ca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376569:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d66163ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376582:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc458400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.376586:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d66163ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376606:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d66163ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376616:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788361539.376619:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.376623:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d66163ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376629:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d66163ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376639:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376645:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376651:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376656:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc459600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.376658:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376664:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376681:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361539.376683:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.376686:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376701:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376740:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d66163c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa40 expref: 53 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376756:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459800/0xf6a94c97d66163d8 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa40 expref: 52 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.376763:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.376766:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361539.376768:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abc459800, rc 0) 00000100:00100000:2.0:1788361539.376882:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+52:38140:x1875232130837376:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1366us (1601us total) trans 30064771441 rc 0/0 00000100:00100000:2.0:1788361539.376890:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 428 00000100:00100000:2.0:1788361539.380557:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.380710:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130837632 00000100:00100000:0.0:1788361539.380721:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130837632 00000100:00100000:0.0:1788361539.380784:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 429 00000100:00100000:0.0:1788361539.380795:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+52:38140:x1875232130837632:12345-192.168.203.60@tcp:36:dd.0 00010000:00010000:0.0:1788361539.380857:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788361539.380893:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95400/0xf6a94c97d661637d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa32 expref: 52 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.380913:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459800/0xf6a94c97d66163d8 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa40 expref: 51 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.380924:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.380929:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361539.381153:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.381167:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.381177:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361539.381248:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771442 00000004:00010000:0.0:1788361539.381285:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003a44631a reply state 0000000022e16b3d transno 30064771443 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361539.381294:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361539.381385:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b061180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+53:38140:x1875232130837632:12345-192.168.203.60@tcp:36:dd.0 Request processed in 591us (836us total) trans 30064771443 rc 0/0 00000100:00100000:0.0:1788361539.381392:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 429 00000020:00080000:0.0:1788361539.381397:0:35345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788361539.382938:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.382951:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.382958:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.382965:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f94800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.382969:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.382976:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.382988:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.382991:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.382995:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.383016:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94800/0xf6a94c97d66163e6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361539.383446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.383500:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130837760 00000100:00100000:0.0:1788361539.383510:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130837760 00000100:00100000:0.0:1788361539.383555:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 430 00000100:00100000:0.0:1788361539.383563:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+52:38140:x1875232130837760:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:0.0:1788361539.383591:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361539.383605:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163ed lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa47 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.383653:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163ed lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa47 expref: 53 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.383665:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163ed lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa47 expref: 53 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.383680:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.383682:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361539.383685:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8f95800, rc 0) 00000100:00100000:0.0:1788361539.383746:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+53:38140:x1875232130837760:12345-192.168.203.60@tcp:101:dd.0 Request processed in 184us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361539.383753:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 430 00000100:00100000:3.0:1788361539.389565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.389832:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130838016 00000100:00100000:2.0:1788361539.389843:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130838016 00000100:00100000:2.0:1788361539.389945:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 431 00000100:00100000:2.0:1788361539.389955:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+53:38140:x1875232130838016:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361539.389979:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.389996:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361539.390025:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95800/0xf6a94c97d66163ed lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa47 expref: 53 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.390044:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.390049:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361539.390060:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d66163f4 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa4e expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.390146:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163fb lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.390158:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163fb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.390168:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163fb lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.390355:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163fb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa4e expref: 55 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.390364:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.390366:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788361539.390376:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459e00/0xf6a94c97d66163f4 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa4e expref: 55 pid: 35346 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.390388:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163fb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa4e expref: 54 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.390413:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.390425:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788361539.390428:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abc459600, rc 0) 00000100:00100000:2.0:1788361539.390488:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:38140:x1875232130838016:12345-192.168.203.60@tcp:101:dd.0 Request processed in 534us (933us total) trans 30064771444 rc 0/0 00000100:00100000:2.0:1788361539.390495:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 431 00000100:00100000:3.0:1788361539.396686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.396904:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130838272 00000100:00100000:2.0:1788361539.396915:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130838272 00000100:00100000:2.0:1788361539.396976:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 432 00000100:00100000:2.0:1788361539.396985:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+54:38140:x1875232130838272:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361539.397017:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.397020:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361539.397045:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459600/0xf6a94c97d66163fb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa4e expref: 54 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.397064:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.397069:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361539.397080:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616402 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa55 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.397152:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616409 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.397164:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616409 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.397172:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616409 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361539.397571:0:37551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].16, 88 off9432 00000004:00080000:2.0:1788361539.397585:0:37551:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 929412498307ns, next at 930182191183ns, rc = 0 00010000:00010000:0.0:1788361539.427209:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616409 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa55 expref: 56 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.427223:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.427237:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361539.427253:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458400/0xf6a94c97d6616402 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa55 expref: 56 pid: 37551 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.427266:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616409 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa55 expref: 55 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.427293:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.427295:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361539.427296:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abc458a00, rc 0) 00000100:00100000:0.0:1788361539.427345:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:38140:x1875232130838272:12345-192.168.203.60@tcp:101:dd.0 Request processed in 30362us (30667us total) trans 30064771445 rc 0/0 00000100:00100000:0.0:1788361539.427351:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 432 00000001:00080000:3.0:1788361539.427707:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771443 is committed 00000004:00080000:3.0:1788361539.427724:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 15 committed 00000001:00080000:3.0:1788361539.427749:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771445 is committed 00000004:00080000:3.0:1788361539.427752:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000100:00100000:3.0:1788361539.427908:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144239616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788361539.427966:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361539.428167:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144239616 00000100:00100000:2.0:1788361539.428175:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144239616 00000100:00100000:2.0:1788361539.428234:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788361539.428243:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144239616:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788361539.428256:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788361539.428398:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1788361539.428401:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1788361539 -> 1788361539 00002000:00010000:2.0:1788361539.428403:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788361539.428405:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1788361539 -> 1788361539 00002000:00010000:2.0:1788361539.428406:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788361539.428443:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144239616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 201us (486us total) trans 30064771203 rc 0/0 00000100:00100000:2.0:1788361539.428449:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000004:00080000:0.0:1788361539.428474:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ac0a52680/2, rc 0, transno 30064771203 00000100:00100000:0.0:1788361539.428779:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144239616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788361539.428918:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144239744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788361539.428948:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361539.429036:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144239744 00000100:00100000:3.0:1788361539.429040:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144239744 00000100:00100000:3.0:1788361539.429132:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788361539.429140:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144239744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788361539.429335:0:35982:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1788361539.429339:0:35982:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1788361539 -> 1788361539 00002000:00010000:3.0:1788361539.429341:0:35982:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788361539.429343:0:35982:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1788361539 -> 1788361539 00002000:00010000:3.0:1788361539.429345:0:35982:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788361539.429626:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144239744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 486us (676us total) trans 30064771204 rc 0/0 00000100:00100000:3.0:1788361539.429687:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000004:00080000:0.0:1788361539.429878:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8abc895880/2, rc 0, transno 30064771204 00000100:00100000:0.0:1788361539.429886:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144239744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788361539.430850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361539.430935:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130838400 00000100:00100000:3.0:1788361539.430942:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130838400 00002000:00010000:3.0:1788361539.430978:0:35987:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/204 (0->18446744073709551615) 00002000:00100000:3.0:1788361539.430983:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a53b80 with x1875232130838400 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361539.430992:0:35987:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a53b80. 00000100:00100000:3.0:1788361539.431029:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 336 00000100:00100000:3.0:1788361539.431036:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130838400:12345-192.168.203.60@tcp:10:dd.0 00002000:00010000:3.0:1788361539.431497:0:35987:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:3.0:1788361539.431502:0:35987:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb mtime from disk: 1788361539 -> 1788361540 00002000:00010000:3.0:1788361539.431504:0:35987:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788361539.431506:0:35987:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb ctime from disk: 1788361539 -> 1788361540 00002000:00010000:3.0:1788361539.431509:0:35987:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788361539.431788:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+16:2350:x1875232130838400:12345-192.168.203.60@tcp:10:dd.0 Request processed in 751us (940us total) trans 30064771205 rc 0/0 00000100:00100000:3.0:1788361539.431796:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 336 00002000:00010000:3.0:1788361539.431799:0:35987:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/204 (0->18446744073709551615) 00002000:00100000:3.0:1788361539.431802:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a53b80 with x1875232130838400 ext(0->18446744073709551615) 00002000:00010000:3.0:1788361539.431807:0:35987:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a53b80. 00000100:00100000:1.0:1788361539.450548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.450626:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130838528 00000100:00100000:0.0:1788361539.450637:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130838528 00002000:00100000:0.0:1788361539.450686:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff9a8ac0a53480 x1875232130838528/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361539.450705:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a53480 with x1875232130838528 ext(0->1048575) 00002000:00010000:0.0:1788361539.450712:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a53480 00000100:00100000:0.0:1788361539.450768:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 337 00000100:00100000:0.0:1788361539.450778:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+16:2349:x1875232130838528:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361539.457066:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+18:2349:x1875232130838528:12345-192.168.203.60@tcp:4:dd.0 Request processed in 5846us (6084us total) trans 30064771206 rc 0/0 00000100:00100000:3.0:1788361539.457081:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 337 00002000:00100000:3.0:1788361539.457107:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff9a8ac0a53480 x1875232130838528/t30064771206(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/448 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361539.457118:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a53480 with x1875232130838528 ext(0->1048575) 00002000:00010000:3.0:1788361539.457124:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a53480 00000100:00100000:1.0:1788361539.469666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.472666:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130838656 00000100:00100000:2.0:1788361539.472681:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130838656 00002000:00100000:2.0:1788361539.472746:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff9a8ac0a51c00 x1875232130838656/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361539.472758:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a51c00 with x1875232130838656 ext(1048576->2097151) 00002000:00010000:2.0:1788361539.472764:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a51c00 00000100:00100000:2.0:1788361539.472895:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 338 00000100:00100000:2.0:1788361539.472905:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+18:2352:x1875232130838656:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361539.478068:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+20:2352:x1875232130838656:12345-192.168.203.60@tcp:4:dd.0 Request processed in 5155us (8401us total) trans 30064771207 rc 0/0 00000100:00100000:2.0:1788361539.478105:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 338 00002000:00100000:2.0:1788361539.478366:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff9a8ac0a51c00 x1875232130838656/t30064771207(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/448 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361539.478392:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a51c00 with x1875232130838656 ext(1048576->2097151) 00002000:00010000:2.0:1788361539.478398:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a51c00 00000100:00100000:0.0:1788361539.483235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361539.483356:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130838784 00000100:00100000:1.0:1788361539.483366:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130838784 00002000:00100000:1.0:1788361539.483413:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff9a8a8926f100 x1875232130838784/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361539.483424:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926f100 with x1875232130838784 ext(2097152->3145727) 00002000:00010000:1.0:1788361539.483429:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a8926f100 00000100:00100000:1.0:1788361539.483463:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 339 00000100:00100000:1.0:1788361539.483473:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+20:2351:x1875232130838784:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361539.491878:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+22:2351:x1875232130838784:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8396us (8641us total) trans 30064771208 rc 0/0 00000100:00100000:1.0:1788361539.491902:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 339 00002000:00100000:1.0:1788361539.491914:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff9a8a8926f100 x1875232130838784/t30064771208(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/448 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361539.491925:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926f100 with x1875232130838784 ext(2097152->3145727) 00002000:00010000:1.0:1788361539.491931:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a8926f100 00000100:00100000:0.0:1788361539.499195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361539.499340:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130838912 00000100:00100000:1.0:1788361539.499349:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130838912 00002000:00100000:1.0:1788361539.499394:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff9a8a8926ea00 x1875232130838912/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361539.499405:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926ea00 with x1875232130838912 ext(3145728->4194303) 00002000:00010000:1.0:1788361539.499411:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a8926ea00 00000100:00100000:1.0:1788361539.499444:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 340 00000100:00100000:1.0:1788361539.499453:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+22:2352:x1875232130838912:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361539.508785:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+24:2352:x1875232130838912:12345-192.168.203.60@tcp:4:dd.0 Request processed in 9322us (9589us total) trans 30064771209 rc 0/0 00000100:00100000:1.0:1788361539.508799:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 340 00002000:00100000:1.0:1788361539.508812:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff9a8a8926ea00 x1875232130838912/t30064771209(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/448 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361539.508822:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a8926ea00 with x1875232130838912 ext(3145728->4194303) 00002000:00010000:1.0:1788361539.508828:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8a8926ea00 00000100:00100000:2.0:1788361539.513185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.513233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361539.513303:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130839040 00000100:00100000:3.0:1788361539.513314:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130839040 00000100:00100000:0.0:1788361539.513320:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130839296 00000100:00100000:0.0:1788361539.513327:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130839296 00002000:00100000:3.0:1788361539.513362:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff9a8abc896d80 x1875232130839040/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361539.513374:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc896d80 with x1875232130839040 ext(4194304->5242879) 00000100:00100000:0.0:1788361539.513378:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:0.0:1788361539.513391:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+44:38140:x1875232130839296:12345-192.168.203.60@tcp:35:dd.0 00002000:00010000:3.0:1788361539.513395:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abc896d80 00000100:00100000:3.0:1788361539.513599:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 341 00000100:00100000:3.0:1788361539.513608:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+24:2350:x1875232130839040:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:0.0:1788361539.514236:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+45:38140:x1875232130839296:12345-192.168.203.60@tcp:35:dd.0 Request processed in 847us (1059us total) trans 30064771446 rc 0/0 00000100:00100000:0.0:1788361539.514245:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:2.0:1788361539.522790:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+26:2350:x1875232130839040:12345-192.168.203.60@tcp:4:dd.0 Request processed in 8993us (9366us total) trans 30064771210 rc 0/0 00000100:00100000:2.0:1788361539.522804:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 341 00002000:00100000:2.0:1788361539.522821:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff9a8abc896d80 x1875232130839040/t30064771210(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/448 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361539.522833:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc896d80 with x1875232130839040 ext(4194304->5242879) 00002000:00010000:2.0:1788361539.522839:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abc896d80 00000100:00100000:1.0:1788361539.575568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.575634:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130839424 00000100:00100000:0.0:1788361539.575645:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130839424 00000100:00100000:0.0:1788361539.575774:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 433 00000100:00100000:0.0:1788361539.575786:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+45:38150:x1875232130839424:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361539.575810:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361539.575834:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616410 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa5c expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.575905:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d6616417 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.575921:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d6616417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.575932:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d6616417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361539.576405:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1788361539.576410:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361539.576493:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d6616417 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.576518:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616410 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa5c expref: 47 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.576535:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d6616417 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa5c expref: 46 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.576541:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361539.576543:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361539.576546:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8f95200, rc 0) 00000100:00100000:0.0:1788361539.576609:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+46:38150:x1875232130839424:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 825us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361539.576615:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 433 00000100:00100000:3.0:1788361539.578993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.581782:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130839552 00000100:00100000:2.0:1788361539.581796:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130839552 00000100:00100000:2.0:1788361539.581905:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 434 00000100:00100000:2.0:1788361539.581916:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+46:38150:x1875232130839552:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361539.581988:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d661641e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.582005:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d661641e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584064:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d661641e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584101:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d6616425 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584127:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d6616425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584134:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d6616425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584531:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584541:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584548:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361539.584590:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584602:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d661641e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584609:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d661641e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584615:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d661641e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584621:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc458800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.584624:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d661641e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584632:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d661641e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584651:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361539.584653:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.584658:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d661641e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584665:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d661641e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584676:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d6616425 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584682:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d6616425 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584700:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d6616425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584705:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc459c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.584708:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d6616425 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584715:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d6616425 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584722:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788361539.584724:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.584727:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d6616425 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584732:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d6616425 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584757:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584763:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584770:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584775:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc458200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.584779:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584785:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584792:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.584795:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.584798:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.584803:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d661642c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361539.584893:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+46:38150:x1875232130839552:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 2975us (5903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.584902:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 434 00000100:00100000:1.0:1788361539.650208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.650314:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130839808 00000100:00100000:0.0:1788361539.650325:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130839808 00000100:00100000:0.0:1788361539.650384:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 435 00000100:00100000:0.0:1788361539.650394:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+46:38156:x1875232130839808:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:0.0:1788361539.650412:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361539.650432:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616433 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa63 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.650503:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d661643a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.650533:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d661643a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.650545:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d661643a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.650561:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d6616441 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.650568:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d6616441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.650575:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d6616441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.650986:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94000/0xf6a94c97d6616448 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.650996:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94000/0xf6a94c97d6616448 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651011:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94000/0xf6a94c97d6616448 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361539.651020:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:0.0:1788361539.651145:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d661643a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651153:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d661643a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651160:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d661643a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651173:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f94200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.651178:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d661643a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651187:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d661643a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651199:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361539.651202:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.651206:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d661643a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651212:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d661643a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651225:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d6616441 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651414:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d6616441 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651420:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d6616441 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651425:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f95c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361539.651428:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d6616441 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651434:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d6616441 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651451:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361539.651453:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361539.651456:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d6616441 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651462:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d6616441 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651504:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616433 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa63 expref: 49 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651518:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94000/0xf6a94c97d6616448 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa63 expref: 48 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.651525:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.651528:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361539.651530:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8f94000, rc 0) 00000100:00100000:0.0:1788361539.651662:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+48:38156:x1875232130839808:12345-192.168.203.60@tcp:101:dd.500 Request processed in 1260us (1454us total) trans 30064771447 rc 0/0 00000100:00100000:0.0:1788361539.651670:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 435 00000100:00100000:1.0:1788361539.658779:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.659243:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130840064 00000100:00100000:0.0:1788361539.659255:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130840064 00000100:00100000:2.0:1788361539.659348:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 436 00000100:00100000:2.0:1788361539.659362:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+48:38156:x1875232130840064:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:2.0:1788361539.659396:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.659400:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1788361539.659428:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458a00/0xf6a94c97d6616409 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa55 expref: 48 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659449:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94000/0xf6a94c97d6616448 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa63 expref: 47 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659460:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.659465:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361539.659477:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d6616456 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa6a expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659509:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d661645d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659518:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d661645d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659526:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d661645d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659535:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d661645d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659539:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d661645d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659544:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d661645d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659556:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abc459c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.659559:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d661645d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659565:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d661645d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659570:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.659572:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361539.659574:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d661645d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659578:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc459c00/0xf6a94c97d661645d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659607:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d6616464 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659612:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d6616464 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.659616:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d6616464 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.660162:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d6616464 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa6a expref: 49 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.660168:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.660170:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788361539.660177:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458200/0xf6a94c97d6616456 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa6a expref: 49 pid: 35347 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.660193:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abc458800/0xf6a94c97d6616464 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa6a expref: 48 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.660218:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.660221:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788361539.660223:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abc458800, rc 0) 00000100:00100000:2.0:1788361539.660296:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+48:38156:x1875232130840064:12345-192.168.203.60@tcp:101:dd.500 Request processed in 937us (1531us total) trans 30064771448 rc 0/0 00000100:00100000:2.0:1788361539.660304:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 436 00000100:00100000:1.0:1788361539.672143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361539.672324:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130840192 00000100:00100000:3.0:1788361539.672338:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130840192 00002000:00100000:3.0:1788361539.672399:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff9a8ac0a50700 x1875232130840192/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361539.672411:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a50700 with x1875232130840192 ext(0->1048575) 00002000:00010000:3.0:1788361539.672417:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a50700 00000100:00100000:3.0:1788361539.672488:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 342 00000100:00100000:3.0:1788361539.672498:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:2351:x1875232130840192:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:0.0:1788361539.683248:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+26:2351:x1875232130840192:12345-192.168.203.60@tcp:3:dd.0 Request processed in 10730us (11097us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361539.683267:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 342 00002000:00100000:0.0:1788361539.683283:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcc:0x0] (0->1048575) req@ffff9a8ac0a50700 x1875232130840192/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/440 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361539.683329:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a50700 with x1875232130840192 ext(0->1048575) 00002000:00010000:0.0:1788361539.683338:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a50700 00000100:00100000:1.0:1788361539.691165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361539.691293:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130840320 00000100:00100000:3.0:1788361539.691304:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130840320 00002000:00100000:3.0:1788361539.691350:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff9a8ac0a50e00 x1875232130840320/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361539.691362:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a50e00 with x1875232130840320 ext(1048576->2097151) 00002000:00010000:3.0:1788361539.691368:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a50e00 00000100:00100000:3.0:1788361539.691401:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 343 00000100:00100000:3.0:1788361539.691411:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+26:2350:x1875232130840320:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:0.0:1788361539.704410:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+26:2350:x1875232130840320:12345-192.168.203.60@tcp:3:dd.0 Request processed in 12988us (13244us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361539.704425:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 343 00002000:00100000:0.0:1788361539.704439:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0xcc:0x0] (1048576->2097151) req@ffff9a8ac0a50e00 x1875232130840320/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/440 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361539.704450:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a50e00 with x1875232130840320 ext(1048576->2097151) 00002000:00010000:0.0:1788361539.704457:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a50e00 00000100:00100000:1.0:1788361539.717339:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.717390:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130840448 00000100:00100000:1.0:1788361539.717394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.717400:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130840448 00002000:00100000:2.0:1788361539.717442:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff9a8ac0a53800 x1875232130840448/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361539.717451:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a53800 with x1875232130840448 ext(2097152->3145727) 00002000:00010000:2.0:1788361539.717456:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a53800 00000100:00100000:2.0:1788361539.717508:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130840576 00000100:00100000:2.0:1788361539.717512:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130840576 00002000:00100000:2.0:1788361539.717529:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff9a8ac0a51500 x1875232130840576/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361539.717537:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a51500 with x1875232130840576 ext(3145728->4194303) 00002000:00010000:2.0:1788361539.717540:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a51500 00000100:00100000:3.0:1788361539.717573:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 344 00000100:00100000:3.0:1788361539.717585:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+27:2352:x1875232130840448:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:1.0:1788361539.717680:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 345 00000100:00100000:1.0:1788361539.717701:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+27:2352:x1875232130840576:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:3.0:1788361539.725284:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+28:2352:x1875232130840448:12345-192.168.203.60@tcp:3:dd.0 Request processed in 7692us (7943us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1788361539.725312:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 344 00002000:00100000:3.0:1788361539.725325:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcc:0x0] (2097152->3145727) req@ffff9a8ac0a53800 x1875232130840448/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/440 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361539.725335:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a53800 with x1875232130840448 ext(2097152->3145727) 00002000:00010000:3.0:1788361539.725341:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a53800 00000100:00100000:0.0:1788361539.728568:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+26:2352:x1875232130840576:12345-192.168.203.60@tcp:3:dd.0 Request processed in 10869us (11165us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361539.728582:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 345 00002000:00100000:0.0:1788361539.728594:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0xcc:0x0] (3145728->4194303) req@ffff9a8ac0a51500 x1875232130840576/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/440 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361539.728605:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ac0a51500 with x1875232130840576 ext(3145728->4194303) 00002000:00010000:0.0:1788361539.728611:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ac0a51500 00000100:00100000:2.0:1788361539.754537:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.754602:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130840704 00000100:00100000:2.0:1788361539.754613:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130840704 00002000:00100000:2.0:1788361539.754665:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff9a8abc895180 x1875232130840704/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/0 e 0 to 0 dl 1788361550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361539.754697:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc895180 with x1875232130840704 ext(4194304->5242879) 00002000:00010000:2.0:1788361539.754704:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abc895180 00000100:00100000:2.0:1788361539.754738:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 346 00000100:00100000:2.0:1788361539.754749:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:2351:x1875232130840704:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:0.0:1788361539.762536:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+26:2351:x1875232130840704:12345-192.168.203.60@tcp:3:dd.0 Request processed in 7780us (8004us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361539.762549:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 346 00002000:00100000:0.0:1788361539.762561:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcc:0x0] (4194304->5242879) req@ffff9a8abc895180 x1875232130840704/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:600/0 lens 488/440 e 0 to 0 dl 1788361550 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361539.762571:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc895180 with x1875232130840704 ext(4194304->5242879) 00002000:00010000:0.0:1788361539.762588:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abc895180 00000100:00100000:2.0:1788361539.777000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.777472:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130840960 00000100:00100000:0.0:1788361539.777483:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130840960 00000100:00100000:0.0:1788361539.777783:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:0.0:1788361539.777793:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+48:38156:x1875232130840960:12345-192.168.203.60@tcp:35:dd.500 00000100:00100000:0.0:1788361539.778004:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+49:38156:x1875232130840960:12345-192.168.203.60@tcp:35:dd.500 Request processed in 212us (1013us total) trans 30064771449 rc 0/0 00000100:00100000:0.0:1788361539.778012:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000001:00080000:3.0:1788361539.790022:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771201 is committed 00000001:00080000:3.0:1788361539.790142:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771209 is committed 00000001:00080000:3.0:1788361539.790220:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771210 is committed 00000001:00080000:3.0:1788361539.790235:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771203 is committed 00000001:00080000:3.0:1788361539.790326:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771204 is committed 00000100:00100000:1.0:1788361539.815282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.815390:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130841088 00000100:00100000:2.0:1788361539.815401:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130841088 00000100:00100000:2.0:1788361539.815493:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 437 00000100:00100000:2.0:1788361539.815503:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+49:38162:x1875232130841088:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361539.815579:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661646b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.815597:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661646b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.815609:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661646b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.815624:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616472 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.815631:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.815637:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816035:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816054:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816062:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361539.816175:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816187:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661646b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816194:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661646b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816201:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661646b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816207:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.816211:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661646b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816218:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661646b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816242:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361539.816245:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.816250:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661646b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816256:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661646b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816281:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616472 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816287:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616472 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816294:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816300:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.816303:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616472 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816310:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616472 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816318:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361539.816321:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.816324:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616472 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816329:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616472 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816342:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816349:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816354:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816365:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.816368:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816374:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816381:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.816383:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.816386:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.816391:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616479 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361539.816468:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+49:38162:x1875232130841088:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 965us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.816475:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 437 00000100:00100000:0.0:1788361539.830432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.830518:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130841344 00000100:00100000:2.0:1788361539.830528:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130841344 00000100:00100000:2.0:1788361539.830579:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 438 00000100:00100000:2.0:1788361539.830588:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+49:38163:x1875232130841344:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361539.830609:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.830627:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616480 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa71 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.830704:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616487 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.830736:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616487 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.830746:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616487 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.830761:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661648e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.830769:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661648e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.830776:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661648e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831134:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616487 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831142:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616487 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831149:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616487 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831155:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.831158:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616487 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831165:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616487 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831176:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361539.831186:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.831190:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616487 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831197:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616487 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831209:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661648e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831214:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661648e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831219:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661648e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831224:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.831227:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661648e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831232:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661648e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831238:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361539.831241:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.831243:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661648e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831248:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661648e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831278:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616480 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa71 expref: 50 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831293:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361539.831295:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361539.831299:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616480 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa71 expref: 50 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.831308:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902600, rc 0) 00000100:00100000:2.0:1788361539.831357:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+49:38163:x1875232130841344:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 769us (932us total) trans 0 rc 301/301 00000100:00100000:2.0:1788361539.831365:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 438 00000100:00100000:0.0:1788361539.834078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.835972:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130841472 00000100:00100000:2.0:1788361539.835985:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130841472 00000100:00100000:2.0:1788361539.836109:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 439 00000100:00100000:2.0:1788361539.836119:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+49:38163:x1875232130841472:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361539.836195:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d6616495 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836212:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d6616495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836224:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d6616495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836239:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661649c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836246:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661649c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836257:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661649c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836611:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836635:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836642:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361539.836680:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00000004:00200000:2.0:1788361539.836696:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361539.836710:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836722:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d6616495 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836728:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d6616495 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836734:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d6616495 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836739:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.836743:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d6616495 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836750:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d6616495 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836761:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361539.836764:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.836768:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d6616495 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836774:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d6616495 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836785:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661649c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836791:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661649c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836796:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661649c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836800:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.836803:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661649c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836808:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661649c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836814:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788361539.836816:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.836819:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661649c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836824:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661649c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836842:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836848:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836853:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836859:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.836861:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836868:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836875:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.836877:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.836880:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.836886:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164a3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361539.837962:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+49:38163:x1875232130841472:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1839us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.837973:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 439 00000100:00100000:1.0:1788361539.875343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.875430:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130841600 00000100:00100000:2.0:1788361539.875439:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130841600 00000100:00100000:2.0:1788361539.875493:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 440 00000100:00100000:2.0:1788361539.875502:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+49:38169:x1875232130841600:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361539.875523:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.875542:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa78 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.875607:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d66164b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.875622:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d66164b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.875633:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d66164b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.875647:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.875654:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.875661:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.875977:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.875987:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.875995:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361539.876031:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00000004:00200000:2.0:1788361539.876035:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361539.876053:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876065:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876072:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d66164b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876078:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d66164b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876119:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d66164b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876126:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.876135:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d66164b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876144:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d66164b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876155:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361539.876158:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.876163:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d66164b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876168:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d66164b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876184:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876189:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876195:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876200:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361539.876203:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876210:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876215:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf56bb4d7 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788361539.876217:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361539.876219:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876223:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf56bb4d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876250:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa78 expref: 51 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876263:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa78 expref: 50 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.876273:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.876276:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361539.876278:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902600, rc 0) 00000100:00100000:2.0:1788361539.876332:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+50:38169:x1875232130841600:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 830us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.876340:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 440 00000100:00100000:1.0:1788361539.878610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361539.878789:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130841856 00000100:00100000:0.0:1788361539.878797:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130841856 00000100:00100000:0.0:1788361539.878876:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 441 00000100:00100000:0.0:1788361539.878884:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+50:38169:x1875232130841856:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361539.878901:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361539.878916:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7200/0xf6a94c97d66164c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa7f expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.878996:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6200/0xf6a94c97d66164cd lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.879009:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6200/0xf6a94c97d66164cd lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.879019:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6200/0xf6a94c97d66164cd lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361539.879028:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00010000:00010000:0.0:1788361539.879184:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7200/0xf6a94c97d66164c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa7f expref: 53 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.879207:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6200/0xf6a94c97d66164cd lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa7f expref: 52 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.879219:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.879222:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788361539.879225:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a843c6200, rc 0) 00000100:00100000:0.0:1788361539.879265:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+52:38169:x1875232130841856:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 382us (661us total) trans 30064771450 rc 0/0 00000100:00100000:0.0:1788361539.879272:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 441 00000100:00100000:1.0:1788361539.936251:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.936388:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130842112 00000100:00100000:2.0:1788361539.936398:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130842112 00000100:00100000:2.0:1788361539.936483:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 442 00000100:00100000:2.0:1788361539.936494:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+52:38175:x1875232130842112:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361539.936518:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361539.936538:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa86 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.936638:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164e2 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.936652:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa78 expref: 53 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.936663:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164e2 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.936708:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa78 expref: 53 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.936720:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa78 expref: 53 pid: 35346 timeout: 1029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361539.936735:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144239872:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361539.936865:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a83f11900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361539.939944:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144239872:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361539.939970:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164e2 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361539.941457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361539.941816:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130842240 00000100:00100000:2.0:1788361539.941826:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130842240 00010000:00010000:2.0:1788361539.941863:0:38408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa78 expref: 54 pid: 35346 timeout: 1029 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361539.941910:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:2.0:1788361539.941920:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+54:2349:x1875232130842240:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361539.941935:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361539.941942:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa78 expref: 54 pid: 35346 timeout: 1029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.941958:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa78 expref: 54 pid: 35346 timeout: 1029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.941981:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164bf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2a:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa78 expref: 54 pid: 35346 timeout: 1029 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.941998:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:2.0:1788361539.942003:0:38408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164e2 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.942014:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164e2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.942022:0:38408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164e2 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361539.942052:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361539.942078:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164e2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.942113:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164e2 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361539.942131:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2a:0x0]: returning size 5242880 00000100:00100000:2.0:1788361539.942206:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+54:2349:x1875232130842240:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 286us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361539.942249:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00010000:00010000:0.0:1788361539.942265:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66164db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa86 expref: 54 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.942278:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903e00/0xf6a94c97d66164e2 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa86 expref: 53 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361539.942284:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2a:0x0].0x0 (ffff9a8a890c3000) 00010000:00010000:0.0:1788361539.942287:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361539.942289:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903e00, rc 0) 00000100:00100000:0.0:1788361539.942310:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+53:38175:x1875232130842112:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 5820us (6069us total) trans 30064771451 rc 0/0 00000100:00100000:0.0:1788361539.942325:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 442 00010000:00010000:1.0:1788361540.001385:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361541.025263:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361541.664650:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361541.664684:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361541.665560:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 6 00000040:00080000:0.0:1788361541.665573:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361541.792577:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144240000:0@lo:400:kworker.0 00000100:00100000:0.0:1788361541.792581:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144240128:0@lo:400:kworker.0 00000100:00100000:3.0:1788361541.792635:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144240256:0@lo:400:kworker.0 00000100:00100000:0.0:1788361541.792700:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361541.792701:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361541.792720:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144240384:0@lo:400:kworker.0 00000100:00100000:2.0:1788361541.792778:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144240512:0@lo:400:kworker.0 00000100:00100000:0.0:1788361541.792779:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144240640:0@lo:400:kworker.0 00000100:00100000:2.0:1788361541.792817:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361541.792822:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144240128 00000100:00100000:3.0:1788361541.792833:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144240128 00000100:00100000:0.0:1788361541.792842:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144240512 00000100:00100000:0.0:1788361541.792848:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144240512 00000100:00100000:2.0:1788361541.792877:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144240000 00000100:00100000:2.0:1788361541.792883:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144240000 00000100:00100000:1.0:1788361541.792895:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361541.792915:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788361541.792915:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144240384 00000100:00100000:0.0:1788361541.792921:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144240384 00000100:00100000:2.0:1788361541.792926:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788361541.792931:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144240128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361541.792939:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144240000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361541.792956:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788361541.792968:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788361541.792970:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144240512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361541.792981:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144240384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361541.793002:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144240128:12345-0@lo:400:kworker.0 Request processed in 76us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361541.793013:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788361541.793015:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144240000:12345-0@lo:400:kworker.0 Request processed in 75us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361541.793025:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788361541.793034:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144240512:12345-0@lo:400:kworker.0 Request processed in 70us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361541.793042:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144240384:12345-0@lo:400:kworker.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361541.793048:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788361541.793057:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788361541.793110:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144240512:0@lo:400:kworker.0 00000100:00100000:1.0:1788361541.793117:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144240384:0@lo:400:kworker.0 00000100:00100000:0.0:1788361541.793118:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361541.793126:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144240000:0@lo:400:kworker.0 00000100:00100000:1.0:1788361541.793157:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144240640 00000100:00100000:0.0:1788361541.793158:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771204 gen 2 00000100:00100000:1.0:1788361541.793161:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144240640 00000004:00080000:0.0:1788361541.793166:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ac0a52680, transno 30064771203 00000004:00080000:0.0:1788361541.793179:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8abc895880, transno 30064771204 00000100:00100000:0.0:1788361541.793185:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144240128:0@lo:400:kworker.0 00000100:00100000:1.0:1788361541.793197:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788361541.793201:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361541.793207:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144240640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361541.793213:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144240768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361541.793247:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144240640:12345-0@lo:400:kworker.0 Request processed in 43us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361541.793252:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361541.793271:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788361541.793282:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144240640:0@lo:400:kworker.0 00000100:00100000:0.0:1788361541.793316:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144240768 00000100:00100000:0.0:1788361541.793320:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144240768 00000100:00100000:0.0:1788361541.793355:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788361541.793362:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144240768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361541.793396:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 310050816 pending 0 free 3709861888 avail 3707764736 00000100:00100000:0.0:1788361541.793435:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144240768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361541.793442:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788361541.794051:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361541.794052:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361541.794060:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361541.794063:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361541.794222:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771268 gen 2 00000004:00080000:0.0:1788361541.794228:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a834cca80, transno 30064771268 00000100:00100000:1.0:1788361541.794237:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144240256 00000100:00100000:1.0:1788361541.794244:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144240256 00000100:00100000:0.0:1788361541.794258:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f584a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144240768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361541.794289:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788361541.794299:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144240256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361541.794362:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144240256:12345-0@lo:400:kworker.0 Request processed in 64us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361541.794369:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788361541.794551:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144240256:0@lo:400:kworker.0 00010000:00010000:0.0:1788361542.048404:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361542.307456:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361542.307479:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144240896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361542.307543:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361542.307604:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144240896 00000100:00100000:2.0:1788361542.307611:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144240896 00000100:00100000:2.0:1788361542.307655:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788361542.307663:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144240896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361542.307710:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216334336 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361542.307761:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144240896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361542.307768:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788361542.307791:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144240896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361542.812410:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361542.815242:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130842368 00000100:00100000:0.0:1788361542.815258:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130842368 00000100:00080000:1.0:1788361542.815488:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361542.815513:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 443 00000100:00100000:0.0:1788361542.815527:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:38604:x1875232130842368:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:0.0:1788361542.815550:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361542.818637:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7c00/0xf6a94c97d66164f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa8d expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361542.818742:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361542.818757:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361542.818797:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361542.819023:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1788361542.819027:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 19 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361542.819141:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361542.819170:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7c00/0xf6a94c97d66164f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa8d expref: 7 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361542.819187:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa8d expref: 6 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361542.819195:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361542.819198:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361542.819201:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a843c6000, rc 0) 00000100:00100000:0.0:1788361542.819275:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:38604:x1875232130842368:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 3753us (6875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361542.819284:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 443 00010000:00010000:1.0:1788361543.072867:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361543.818941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361543.818986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361543.819026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361543.819053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361543.819081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361543.819131:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130842880 00000100:00100000:1.0:1788361543.819140:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130842880 00000100:00100000:1.0:1788361543.819195:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130842752 00000100:00100000:1.0:1788361543.819199:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130842752 00000100:00100000:1.0:1788361543.819224:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1788361543.819235:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:2352:x1875232130842880:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361543.819304:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:2352:x1875232130842880:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361543.819313:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:0.0:1788361543.819315:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130842496 00000100:00100000:0.0:1788361543.819320:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130842496 00000100:00100000:1.0:1788361543.819350:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:1.0:1788361543.819363:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130842752:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361543.819372:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130842624 00000100:00100000:0.0:1788361543.819376:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:2.0:1788361543.819378:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130842624 00000100:00100000:0.0:1788361543.819387:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130842496:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361543.819393:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130842752:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361543.819401:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1788361543.819411:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130843008 00000100:00100000:2.0:1788361543.819416:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130843008 00000100:00100000:0.0:1788361543.819422:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130842496:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 37us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361543.819430:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:0.0:1788361543.819431:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00080000:3.0:1788361543.819503:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361543.819514:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361543.819516:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361543.819574:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+53:2352:x1875232130842624:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361543.819585:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1788361543.819596:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2352:x1875232130843008:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361543.819611:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+53:2352:x1875232130842624:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 39us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361543.819620:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1788361543.819638:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2352:x1875232130843008:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 42us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361543.819646:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00010000:00010000:3.0:1788361544.098704:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788361544.676614:0:39400:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 10f: Tolerate -EDQUOT failure when auto PCC-RO attach with group quota ========================================================== 11:05:44 (1788361544) 00000001:00080000:1.0:1788361544.890078:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771451 is committed 00010000:00010000:1.0:1788361545.123226:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361545.656604:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361545.656789:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130843264 00000100:00100000:2.0:1788361545.656798:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130843264 00000100:00100000:2.0:1788361545.656920:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 444 00000100:00100000:2.0:1788361545.656931:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+47:38890:x1875232130843264:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361545.656951:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361545.656955:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361545.656979:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95200/0xf6a94c97d6616417 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa5c expref: 47 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.656997:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361545.657003:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361545.657014:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164fe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa94 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.657391:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.657406:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa8d expref: 5 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.657415:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.657447:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa8d expref: 5 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.657460:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa8d expref: 5 pid: 35346 timeout: 1035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361545.657473:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144241024:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361545.657568:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6480 going to sleep for 11 seconds 00000100:00080000:3.0:1788361545.657933:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361545.660130:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144241024:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361545.660156:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361545.660832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361545.660992:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130843392 00000100:00100000:2.0:1788361545.660999:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130843392 00010000:00010000:2.0:1788361545.661048:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa8d expref: 6 pid: 35346 timeout: 1035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361545.661178:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:2.0:1788361545.661188:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2349:x1875232130843392:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361545.661205:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361545.661213:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa8d expref: 6 pid: 35346 timeout: 1035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.661225:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa8d expref: 6 pid: 35346 timeout: 1035 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361545.661240:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788361545.661250:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6000/0xf6a94c97d66164f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa8d expref: 6 pid: 35346 timeout: 1035 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.661265:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:2.0:1788361545.661271:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.661280:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.661287:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.661315:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361545.661371:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130843392:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 184us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361545.661379:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00010000:00010000:0.0:1788361545.661434:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.661441:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.661462:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.661471:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.661478:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788361545.662498:0:35346:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcc:0x0], index 1: 0 00010000:00010000:0.0:1788361545.662756:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d6616513 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662769:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d6616513 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662779:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d6616513 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662813:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662820:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662837:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662843:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361545.662847:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662855:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662866:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361545.662869:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361545.662873:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662879:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616505 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361545.662891:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000079d03ea7 reply state 0000000081221f7f transno 30064771452 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361545.662899:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788361545.662932:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d66164fe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa94 expref: 49 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662951:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d6616513 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa94 expref: 48 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.662958:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361545.662967:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361545.662970:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a843c6600, rc 0) 00000100:00100000:0.0:1788361545.663035:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+49:38890:x1875232130843264:12345-192.168.203.60@tcp:101:dd.0 Request processed in 6105us (6439us total) trans 30064771452 rc 0/0 00000100:00100000:0.0:1788361545.663043:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 444 00010000:00010000:2.0:1788361545.665168:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.665184:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.665192:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.665197:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a843c7a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361545.665201:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.665208:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.665224:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8a890c3500) 00010000:00010000:2.0:1788361545.665227:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361545.665231:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.665237:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c7a00/0xf6a94c97d661650c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361545.667861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361545.667925:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130843520 00000100:00100000:1.0:1788361545.667935:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130843520 00000100:00100000:1.0:1788361545.668011:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:1.0:1788361545.668022:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:38890:x1875232130843520:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361545.668040:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361545.668061:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053366688/0xf6a94c97d6616521 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fa9b expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361545.668393:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361545.668415:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcc:0x0].0x0 since=935s v=(0 0) 00010000:00010000:1.0:1788361545.668420:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361545.668431:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053366688/0xf6a94c97d6616521 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa9b expref: 13 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.668469:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053366688/0xf6a94c97d6616521 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa9b expref: 13 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.668483:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac8c00, rc 0) 00000100:00100000:1.0:1788361545.668544:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:38890:x1875232130843520:12345-192.168.203.60@tcp:101:dd.0 Request processed in 524us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361545.668551:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00080000:3.0:1788361545.668644:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361545.689816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361545.689927:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130843648 00000100:00100000:2.0:1788361545.689938:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130843648 00002000:00100000:2.0:1788361545.689991:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff9a89921c3100 x1875232130843648/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:606/0 lens 488/0 e 0 to 0 dl 1788361556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361545.690004:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c3100 with x1875232130843648 ext(0->1048575) 00002000:00010000:2.0:1788361545.690009:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c3100 00000100:00100000:2.0:1788361545.690082:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 347 00000100:00100000:2.0:1788361545.690130:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130843648:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:3.0:1788361545.704817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361545.705155:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361545.706445:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130844032 00000100:00100000:0.0:1788361545.706459:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130844032 00000100:00100000:2.0:1788361545.706557:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:2.0:1788361545.706581:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+48:38890:x1875232130844032:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:3.0:1788361545.707493:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130843776 00000100:00100000:3.0:1788361545.707501:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130843776 00000100:00100000:2.0:1788361545.707552:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+49:38890:x1875232130844032:12345-192.168.203.60@tcp:35:dd.0 Request processed in 981us (2741us total) trans 30064771453 rc 0/0 00000100:00100000:2.0:1788361545.707564:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00002000:00100000:3.0:1788361545.708024:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff9a8a9f584e00 x1875232130843776/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:606/0 lens 488/0 e 0 to 0 dl 1788361556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361545.708035:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9f584e00 with x1875232130843776 ext(1048576->2097151) 00002000:00010000:3.0:1788361545.708041:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9f584e00 00000100:00100000:3.0:1788361545.708070:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 348 00000100:00100000:3.0:1788361545.708077:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+16:2352:x1875232130843776:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361545.709272:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+17:2350:x1875232130843648:12345-192.168.203.60@tcp:4:dd.0 Request processed in 19138us (19461us total) trans 30064771269 rc 0/0 00000100:00100000:1.0:1788361545.709283:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 347 00002000:00100000:1.0:1788361545.709292:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff9a89921c3100 x1875232130843648/t30064771269(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:606/0 lens 488/448 e 0 to 0 dl 1788361556 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361545.709301:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a89921c3100 with x1875232130843648 ext(0->1048575) 00002000:00010000:1.0:1788361545.709304:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a89921c3100 00000100:00100000:3.0:1788361545.719911:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:2352:x1875232130843776:12345-192.168.203.60@tcp:4:dd.0 Request processed in 11822us (14743us total) trans 30064771270 rc 0/0 00000100:00100000:3.0:1788361545.719999:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 348 00002000:00100000:3.0:1788361545.720012:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff9a8a9f584e00 x1875232130843776/t30064771270(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:606/0 lens 488/448 e 0 to 0 dl 1788361556 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361545.720022:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9f584e00 with x1875232130843776 ext(1048576->2097151) 00002000:00010000:3.0:1788361545.720029:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9f584e00 00000100:00100000:1.0:1788361545.727909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361545.728049:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130844160 00000100:00100000:2.0:1788361545.728061:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130844160 00000100:00100000:2.0:1788361545.728211:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 445 00000100:00100000:2.0:1788361545.728226:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+49:38891:x1875232130844160:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361545.728250:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361545.728273:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616528 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86faa2 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.728337:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903200/0xf6a94c97d661652f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.728353:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903200/0xf6a94c97d661652f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.728364:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903200/0xf6a94c97d661652f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361545.728426:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1788361545.728430:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361545.728453:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903200/0xf6a94c97d661652f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.728475:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616528 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faa2 expref: 51 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.728492:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903200/0xf6a94c97d661652f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faa2 expref: 50 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.728502:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361545.728505:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361545.728508:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903200, rc 0) 00000100:00100000:2.0:1788361545.728565:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+50:38891:x1875232130844160:12345-192.168.203.60@tcp:101:chown.0 Request processed in 341us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361545.728571:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 445 00000100:00100000:2.0:1788361545.734060:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361545.734165:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130844288 00000100:00100000:3.0:1788361545.734177:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130844288 00000100:00100000:3.0:1788361545.734249:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 446 00000100:00100000:3.0:1788361545.734260:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+50:38891:x1875232130844288:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:3.0:1788361545.734313:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361545.734333:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6616536 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86faa9 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.734372:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661653d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.734386:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661653d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.734398:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661653d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.734492:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985964200/0xf6a94c97d6616536 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faa9 expref: 52 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.734512:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8985965000/0xf6a94c97d661653d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faa9 expref: 51 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.734521:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361545.734524:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361545.734527:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8985965000, rc 0) 00000100:00100000:3.0:1788361545.734586:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+51:38891:x1875232130844288:12345-192.168.203.60@tcp:101:chown.0 Request processed in 329us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361545.734593:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 446 00000100:00100000:1.0:1788361545.740469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361545.741118:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130844544 00000100:00100000:0.0:1788361545.741127:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130844544 00000100:00100000:0.0:1788361545.741180:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 447 00000100:00100000:0.0:1788361545.741187:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+51:38891:x1875232130844544:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:0.0:1788361545.741233:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361545.741255:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d6616513 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fa94 expref: 51 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.741270:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361545.741274:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361545.741296:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.741306:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.741312:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361545.741711:0:35346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].15, 88 off9416 00000004:00080000:0.0:1788361545.741722:0:35346:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 935756635393ns, next at 936756633016ns, rc = 0 00000004:00010000:0.0:1788361545.741807:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3f03e88 reply state 000000002013ca09 transno 30064771454 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361545.741817:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361545.741912:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+52:38891:x1875232130844544:12345-192.168.203.60@tcp:36:chown.0 Request processed in 724us (1450us total) trans 30064771454 rc 0/0 00000100:00100000:0.0:1788361545.741921:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 447 00010000:00010000:0.0:1788361545.742882:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.742894:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.742901:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.742908:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a843c6e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361545.742912:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.742919:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.742934:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361545.742937:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788361545.742941:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.742947:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616544 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361545.744255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361545.744347:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130844672 00000100:00100000:2.0:1788361545.744356:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130844672 00000100:00100000:2.0:1788361545.744445:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 448 00000100:00100000:2.0:1788361545.744455:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+51:38891:x1875232130844672:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1788361545.744480:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361545.744498:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661654b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fab0 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.744569:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661654b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fab0 expref: 52 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.744583:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661654b lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fab0 expref: 52 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.744604:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361545.744607:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361545.744611:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903400, rc 0) 00000100:00100000:2.0:1788361545.744672:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+52:38891:x1875232130844672:12345-192.168.203.60@tcp:101:chown.0 Request processed in 218us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361545.744682:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 448 00000100:00100000:1.0:1788361545.746260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361545.746522:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130844800 00000100:00100000:0.0:1788361545.746552:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130844800 00000100:00100000:0.0:1788361545.746605:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:0.0:1788361545.746614:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+17:2352:x1875232130844800:12345-192.168.203.60@tcp:2:chown.0 00002000:00010000:0.0:1788361545.746804:0:35982:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1788361545.746808:0:35982:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 0 -> 1788361546 00002000:00010000:0.0:1788361545.746809:0:35982:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788361545.746810:0:35982:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 0 -> 1788361546 00002000:00010000:0.0:1788361545.746812:0:35982:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788361545.746854:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+18:2352:x1875232130844800:12345-192.168.203.60@tcp:2:chown.0 Request processed in 241us (599us total) trans 30064771271 rc 0/0 00000100:00100000:0.0:1788361545.746861:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:3.0:1788361545.790044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361545.790162:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130845056 00000100:00100000:1.0:1788361545.790172:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130845056 00000100:00100000:1.0:1788361545.790233:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 449 00000100:00100000:1.0:1788361545.790242:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+52:38897:x1875232130845056:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:1.0:1788361545.790261:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361545.790310:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9800/0xf6a94c97d6616552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fab7 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790380:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d6616559 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790405:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d6616559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790417:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d6616559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790433:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6616560 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790440:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6616560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790447:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6616560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790575:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6616567 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790585:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6616567 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790593:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6616567 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361545.790602:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00010000:00010000:1.0:1788361545.790701:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d6616559 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790719:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d6616559 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790725:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d6616559 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790730:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac8e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361545.790735:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d6616559 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790742:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d6616559 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790753:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:1.0:1788361545.790757:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361545.790761:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d6616559 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790768:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac8e00/0xf6a94c97d6616559 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790781:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6616560 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790787:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6616560 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790793:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6616560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790798:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8abeac9c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361545.790807:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6616560 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790814:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6616560 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790822:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8aa8ee1500) 00010000:00010000:1.0:1788361545.790824:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361545.790827:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6616560 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790833:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9c00/0xf6a94c97d6616560 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790870:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9800/0xf6a94c97d6616552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fab7 expref: 55 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790883:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6616567 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fab7 expref: 54 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361545.790890:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361545.790892:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361545.790895:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8abeac9600, rc 0) 00000100:00100000:1.0:1788361545.790959:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+54:38897:x1875232130845056:12345-192.168.203.60@tcp:101:dd.500 Request processed in 718us (924us total) trans 30064771455 rc 0/0 00000100:00100000:1.0:1788361545.790967:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 449 00000100:00100000:1.0:1788361545.801998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361545.802267:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130845312 00000100:00100000:0.0:1788361545.802276:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130845312 00000100:00100000:0.0:1788361545.802375:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 450 00000100:00100000:0.0:1788361545.802386:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:38897:x1875232130845312:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:0.0:1788361545.802410:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361545.802414:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:0.0:1788361545.802438:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661654b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fab0 expref: 54 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802459:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8abeac9600/0xf6a94c97d6616567 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fab7 expref: 53 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802467:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361545.802470:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361545.802480:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616575 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fabe expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802527:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d661657c lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802536:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d661657c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802542:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d661657c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802552:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d661657c lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802556:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d661657c lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802560:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d661657c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802564:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a843c6600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361545.802567:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d661657c lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802571:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d661657c lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802576:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361545.802577:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361545.802579:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d661657c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802582:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6600/0xf6a94c97d661657c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802602:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6400/0xf6a94c97d6616583 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802607:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6400/0xf6a94c97d6616583 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.802614:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6400/0xf6a94c97d6616583 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.803157:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6400/0xf6a94c97d6616583 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fabe expref: 55 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.803165:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361545.803167:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361545.803175:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6e00/0xf6a94c97d6616575 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fabe expref: 55 pid: 35346 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.803187:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6400/0xf6a94c97d6616583 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fabe expref: 54 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361545.803215:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361545.803218:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361545.803220:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a843c6400, rc 0) 00000100:00100000:0.0:1788361545.803273:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:38897:x1875232130845312:12345-192.168.203.60@tcp:101:dd.500 Request processed in 890us (1284us total) trans 30064771456 rc 0/0 00000100:00100000:0.0:1788361545.803280:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 450 00000100:00100000:3.0:1788361545.815864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361545.815982:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130845440 00000100:00100000:0.0:1788361545.815993:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130845440 00002000:00100000:0.0:1788361545.816054:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff9a898bca2300 x1875232130845440/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:606/0 lens 488/0 e 0 to 0 dl 1788361556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361545.816065:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca2300 with x1875232130845440 ext(0->1048575) 00002000:00010000:0.0:1788361545.816070:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca2300 00000100:00100000:0.0:1788361545.816141:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 349 00000100:00100000:0.0:1788361545.816151:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+18:2350:x1875232130845440:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:0.0:1788361545.826417:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+18:2350:x1875232130845440:12345-192.168.203.60@tcp:3:dd.0 Request processed in 10258us (10552us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361545.826430:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 349 00002000:00100000:0.0:1788361545.826444:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff9a898bca2300 x1875232130845440/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:606/0 lens 488/440 e 0 to 0 dl 1788361556 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361545.826456:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a898bca2300 with x1875232130845440 ext(0->1048575) 00002000:00010000:0.0:1788361545.826462:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a898bca2300 00000100:00100000:1.0:1788361545.841138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361545.841233:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130845568 00000100:00100000:0.0:1788361545.841243:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130845568 00002000:00100000:0.0:1788361545.841289:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff9a8a9f584a80 x1875232130845568/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:606/0 lens 488/0 e 0 to 0 dl 1788361556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361545.841300:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9f584a80 with x1875232130845568 ext(1048576->2097151) 00002000:00010000:0.0:1788361545.841307:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9f584a80 00000100:00100000:0.0:1788361545.841342:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 350 00000100:00100000:0.0:1788361545.841352:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+18:2350:x1875232130845568:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:0.0:1788361545.847694:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+18:2350:x1875232130845568:12345-192.168.203.60@tcp:3:dd.0 Request processed in 6332us (6554us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361545.847708:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 350 00002000:00100000:0.0:1788361545.847736:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff9a8a9f584a80 x1875232130845568/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:606/0 lens 488/440 e 0 to 0 dl 1788361556 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361545.847746:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a9f584a80 with x1875232130845568 ext(1048576->2097151) 00002000:00010000:0.0:1788361545.847753:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a9f584a80 00000100:00100000:3.0:1788361545.863305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361545.863403:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130845824 00000100:00100000:0.0:1788361545.863413:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130845824 00000100:00100000:0.0:1788361545.863473:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:0.0:1788361545.863484:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:38897:x1875232130845824:12345-192.168.203.60@tcp:35:dd.500 00000100:00100000:0.0:1788361545.863745:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:38897:x1875232130845824:12345-192.168.203.60@tcp:35:dd.500 Request processed in 263us (449us total) trans 30064771457 rc 0/0 00000100:00100000:0.0:1788361545.863753:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:3.0:1788361545.923026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361545.923323:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130845952 00000100:00100000:2.0:1788361545.923332:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130845952 00000100:00100000:2.0:1788361545.923390:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 451 00000100:00100000:2.0:1788361545.923400:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:38907:x1875232130845952:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361545.923475:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661658a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923501:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661658a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923513:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661658a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923534:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616591 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923542:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923550:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923655:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923665:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923673:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361545.923712:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923725:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661658a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923731:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661658a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923738:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661658a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923745:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361545.923749:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661658a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923756:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661658a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923767:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361545.923770:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361545.923774:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661658a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923780:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d661658a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923790:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616591 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923795:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616591 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923800:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616591 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923804:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361545.923807:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616591 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923811:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616591 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923817:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361545.923819:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361545.923821:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616591 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923826:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616591 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923839:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923845:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923850:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923855:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361545.923858:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923864:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923871:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361545.923874:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361545.923877:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.923883:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616598 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361545.923963:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:38907:x1875232130845952:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 564us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361545.923972:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 451 00000100:00100000:1.0:1788361545.961383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361545.961491:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130846208 00000100:00100000:3.0:1788361545.961502:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130846208 00000100:00100000:3.0:1788361545.961593:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 452 00000100:00100000:3.0:1788361545.961604:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:38908:x1875232130846208:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361545.961624:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361545.961653:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d661659f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fac5 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961731:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66165a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961747:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66165a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961758:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66165a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961773:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66165ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961779:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66165ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961785:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66165ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961887:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66165a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961894:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66165a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961932:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66165a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961938:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361545.961942:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66165a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961950:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66165a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961962:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788361545.961965:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361545.961968:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66165a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961974:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66165a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961988:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66165ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.961994:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66165ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.962000:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66165ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.962005:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361545.962008:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66165ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.962024:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66165ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.962033:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8a827d7400) 00010000:00010000:3.0:1788361545.962035:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361545.962038:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66165ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.962044:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66165ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.962077:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d661659f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fac5 expref: 56 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.962136:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:3.0:1788361545.962139:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361545.962143:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d661659f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fac5 expref: 56 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361545.962151:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389000, rc 0) 00000100:00100000:3.0:1788361545.962230:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:38908:x1875232130846208:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 620us (850us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361545.962237:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 452 00000100:00100000:0.0:1788361545.965480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361545.965579:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130846336 00000100:00100000:2.0:1788361545.965587:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130846336 00000100:00100000:2.0:1788361545.965680:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 453 00000100:00100000:2.0:1788361545.965690:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:38908:x1875232130846336:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361545.965763:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.965778:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.965788:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.965802:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.965809:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.965816:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.965909:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.965986:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.965994:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361545.966027:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00000004:00200000:2.0:1788361545.966032:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361545.966044:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.966057:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.966062:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.966069:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.966076:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361545.966079:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967191:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967214:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361545.967217:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361545.967222:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967229:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967243:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967249:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967255:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967261:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361545.967264:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967280:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967287:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361545.967290:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361545.967293:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967304:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967325:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967332:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967339:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967344:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361545.967347:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967353:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967361:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361545.967363:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361545.967371:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361545.967377:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361545.967460:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:38908:x1875232130846336:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1770us (1987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361545.967470:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 453 00000100:00100000:0.0:1788361546.001569:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361546.001713:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130846592 00000100:00100000:2.0:1788361546.001722:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130846592 00000100:00100000:2.0:1788361546.001783:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 454 00000100:00100000:2.0:1788361546.001793:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:38914:x1875232130846592:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361546.001815:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361546.001818:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788361546.001845:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903200/0xf6a94c97d661652f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faa2 expref: 55 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.001864:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b500) 00010000:00010000:2.0:1788361546.001873:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361546.001889:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86facc expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.002044:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.002058:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.002068:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.002080:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003160:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003173:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003277:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903c00/0xf6a94c97d66165de lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003288:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903c00/0xf6a94c97d66165de lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003294:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903c00/0xf6a94c97d66165de lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361546.003304:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 2097152 00010000:00010000:2.0:1788361546.003410:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003419:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003425:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003431:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361546.003436:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003444:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003454:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361546.003457:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361546.003461:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003471:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d66165d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003482:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003488:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003493:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003498:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361546.003501:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003507:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003514:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8a83c0b600) 00010000:00010000:2.0:1788361546.003516:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361546.003519:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003543:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d66165d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003587:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d66165c9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86facc expref: 57 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003609:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903c00/0xf6a94c97d66165de lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86facc expref: 56 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.003616:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361546.003618:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361546.003621:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903c00, rc 0) 00000100:00100000:2.0:1788361546.003709:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b065180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+56:38914:x1875232130846592:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1916us (2149us total) trans 30064771458 rc 0/0 00000100:00100000:2.0:1788361546.003725:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 454 00000100:00100000:1.0:1788361546.007392:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361546.007462:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130846848 00000100:00100000:3.0:1788361546.007474:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130846848 00000100:00100000:3.0:1788361546.007544:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 455 00000100:00100000:3.0:1788361546.007555:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+56:38914:x1875232130846848:12345-192.168.203.60@tcp:36:dd.0 00010000:00010000:3.0:1788361546.007628:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788361546.007665:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a843c6400/0xf6a94c97d6616583 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fabe expref: 56 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.007687:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903c00/0xf6a94c97d66165de lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86facc expref: 55 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.007698:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361546.007703:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361546.008217:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.008232:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.008243:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361546.008303:0:35345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771459 00000004:00010000:3.0:1788361546.008330:0:35345:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000077f2597a reply state 000000002617fd23 transno 30064771460 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361546.008339:0:35345:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361546.008423:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+57:38914:x1875232130846848:12345-192.168.203.60@tcp:36:dd.0 Request processed in 870us (1043us total) trans 30064771460 rc 0/0 00000100:00100000:3.0:1788361546.008431:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 455 00000020:00080000:3.0:1788361546.008436:0:35345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788361546.010874:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.010890:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.010897:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.010904:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361546.010909:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.010916:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.011061:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361546.011064:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361546.011069:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.011076:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66165ec lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361546.011803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361546.011877:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130846976 00000100:00100000:2.0:1788361546.011888:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130846976 00000100:00100000:2.0:1788361546.011979:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 456 00000100:00100000:2.0:1788361546.011989:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+56:38914:x1875232130846976:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1788361546.012012:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361546.012030:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903200/0xf6a94c97d66165f3 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fad3 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.012138:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903200/0xf6a94c97d66165f3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fad3 expref: 57 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.012153:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903200/0xf6a94c97d66165f3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fad3 expref: 57 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.012173:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361546.012176:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361546.012180:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903200, rc 0) 00000100:00100000:2.0:1788361546.012232:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+57:38914:x1875232130846976:12345-192.168.203.60@tcp:101:dd.0 Request processed in 244us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361546.012238:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 456 00000100:00100000:0.0:1788361546.014697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361546.014839:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130847232 00000100:00100000:1.0:1788361546.014847:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130847232 00000100:00100000:1.0:1788361546.014893:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 457 00000100:00100000:1.0:1788361546.014900:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+57:38914:x1875232130847232:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1788361546.014923:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361546.014926:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361546.014945:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903200/0xf6a94c97d66165f3 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fad3 expref: 57 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.014958:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361546.014962:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361546.014971:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94600/0xf6a94c97d66165fa lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fada expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.015006:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94a00/0xf6a94c97d6616601 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.015015:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94a00/0xf6a94c97d6616601 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.015021:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94a00/0xf6a94c97d6616601 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.015294:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94a00/0xf6a94c97d6616601 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fada expref: 59 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.015303:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361546.015306:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788361546.015331:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94600/0xf6a94c97d66165fa lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fada expref: 59 pid: 35347 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.015341:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94a00/0xf6a94c97d6616601 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fada expref: 58 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.015359:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361546.015361:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1788361546.015362:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8f94a00, rc 0) 00000100:00100000:1.0:1788361546.015403:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+58:38914:x1875232130847232:12345-192.168.203.60@tcp:101:dd.0 Request processed in 504us (716us total) trans 30064771461 rc 0/0 00000100:00100000:1.0:1788361546.015408:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 457 00000100:00100000:0.0:1788361546.020944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361546.021153:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130847488 00000100:00100000:3.0:1788361546.021222:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130847488 00000100:00100000:3.0:1788361546.021326:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 458 00000100:00100000:3.0:1788361546.021349:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+58:38914:x1875232130847488:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1788361546.021377:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361546.021380:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788361546.021408:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94a00/0xf6a94c97d6616601 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fada expref: 58 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.021426:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361546.021431:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361546.021444:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d6616608 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fae1 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.021491:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d661660f lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.021503:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d661660f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.021512:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d661660f lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788361546.021890:0:35345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].16, 88 off9504 00000004:00080000:3.0:1788361546.021901:0:35345:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 936036813873ns, next at 936756633016ns, rc = 0 00010000:00010000:0.0:1788361546.044445:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d661660f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fae1 expref: 60 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.044465:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361546.044468:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361546.044488:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d6616608 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fae1 expref: 60 pid: 35345 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.044509:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d661660f lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fae1 expref: 59 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.044577:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361546.044580:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1788361546.044583:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389a00, rc 0) 00000100:00100000:0.0:1788361546.044675:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+59:38914:x1875232130847488:12345-192.168.203.60@tcp:101:dd.0 Request processed in 23326us (23738us total) trans 30064771462 rc 0/0 00000100:00100000:0.0:1788361546.044683:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 458 00000001:00080000:1.0:1788361546.045509:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771457 is committed 00000004:00080000:1.0:1788361546.045524:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 14 committed 00000001:00080000:1.0:1788361546.045618:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771461 is committed 00000001:00080000:1.0:1788361546.045630:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771462 is committed 00000004:00080000:1.0:1788361546.045633:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 15 committed 00000100:00100000:3.0:1788361546.045763:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361546.045780:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144241152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788361546.045837:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361546.045944:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144241152 00000100:00100000:0.0:1788361546.045952:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144241152 00000100:00100000:0.0:1788361546.046033:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788361546.046042:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144241152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788361546.046241:0:36286:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1788361546.046244:0:36286:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1788361546 -> 1788361546 00002000:00010000:0.0:1788361546.046247:0:36286:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788361546.046249:0:36286:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1788361546 -> 1788361546 00002000:00010000:0.0:1788361546.046251:0:36286:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788361546.046290:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144241152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 249us (453us total) trans 30064771272 rc 0/0 00000100:00100000:0.0:1788361546.046297:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000004:00080000:0.0:1788361546.046344:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ab71b1f80/2, rc 0, transno 30064771272 00000100:00100000:0.0:1788361546.046355:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144241152:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788361546.046390:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144241280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788361546.046413:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788361546.046584:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361546.046814:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144241280 00000100:00100000:1.0:1788361546.046819:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144241280 00000100:00100000:1.0:1788361546.046892:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788361546.046899:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144241280:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788361546.047021:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1788361546.047025:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1788361546 -> 1788361546 00002000:00010000:1.0:1788361546.047027:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361546.047029:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1788361546 -> 1788361546 00002000:00010000:1.0:1788361546.047031:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788361546.047081:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144241280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (666us total) trans 30064771273 rc 0/0 00000100:00100000:1.0:1788361546.047123:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000004:00080000:3.0:1788361546.047198:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ab71b0380/2, rc 0, transno 30064771273 00000100:00100000:3.0:1788361546.047203:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144241280:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788361546.050711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361546.050865:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130847616 00000100:00100000:1.0:1788361546.050875:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130847616 00002000:00010000:1.0:1788361546.050924:0:38206:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/204 (0->18446744073709551615) 00002000:00100000:1.0:1788361546.050930:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b1c00 with x1875232130847616 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361546.050940:0:38206:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab71b1c00. 00000100:00100000:1.0:1788361546.050972:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 351 00000100:00100000:1.0:1788361546.050982:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+18:2349:x1875232130847616:12345-192.168.203.60@tcp:10:dd.0 00002000:00010000:1.0:1788361546.051629:0:38206:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb size from disk: 2097152 -> 0 00002000:00010000:1.0:1788361546.051635:0:38206:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb mtime from disk: 1788361546 -> 1788361546 00002000:00010000:1.0:1788361546.051637:0:38206:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361546.051639:0:38206:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb ctime from disk: 1788361546 -> 1788361546 00002000:00010000:1.0:1788361546.051642:0:38206:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0xcc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788361546.051756:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+19:2349:x1875232130847616:12345-192.168.203.60@tcp:10:dd.0 Request processed in 774us (1055us total) trans 30064771274 rc 0/0 00000100:00100000:1.0:1788361546.051765:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 351 00002000:00010000:1.0:1788361546.051770:0:38206:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/204 (0->18446744073709551615) 00002000:00100000:1.0:1788361546.051773:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b1c00 with x1875232130847616 ext(0->18446744073709551615) 00002000:00010000:1.0:1788361546.051777:0:38206:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab71b1c00. 00000100:00100000:2.0:1788361546.067451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361546.067927:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130847744 00000100:00100000:0.0:1788361546.067952:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130847744 00002000:00100000:0.0:1788361546.068000:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff9a8abc896300 x1875232130847744/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/0 e 0 to 0 dl 1788361557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361546.068012:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc896300 with x1875232130847744 ext(0->1048575) 00002000:00010000:0.0:1788361546.068018:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abc896300 00000100:00100000:0.0:1788361546.068054:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 352 00000100:00100000:0.0:1788361546.068063:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+19:2350:x1875232130847744:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361546.081703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361546.082704:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130847872 00000100:00100000:0.0:1788361546.082715:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130847872 00002000:00100000:0.0:1788361546.082762:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff9a8986705180 x1875232130847872/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/0 e 0 to 0 dl 1788361557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361546.082774:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986705180 with x1875232130847872 ext(1048576->2097151) 00002000:00010000:0.0:1788361546.082779:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8986705180 00000100:00100000:0.0:1788361546.082800:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 353 00000100:00100000:0.0:1788361546.082808:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+21:2350:x1875232130847872:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361546.085949:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+23:2350:x1875232130847744:12345-192.168.203.60@tcp:4:dd.0 Request processed in 17877us (18497us total) trans 30064771275 rc 0/0 00000100:00100000:1.0:1788361546.085963:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 352 00002000:00100000:1.0:1788361546.085975:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff9a8abc896300 x1875232130847744/t30064771275(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/448 e 0 to 0 dl 1788361557 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361546.086000:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc896300 with x1875232130847744 ext(0->1048575) 00002000:00010000:1.0:1788361546.086006:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abc896300 00000100:00100000:1.0:1788361546.089768:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+23:2350:x1875232130847872:12345-192.168.203.60@tcp:4:dd.0 Request processed in 6950us (8064us total) trans 30064771276 rc 0/0 00000100:00100000:1.0:1788361546.089781:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 353 00002000:00100000:1.0:1788361546.089792:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff9a8986705180 x1875232130847872/t30064771276(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/448 e 0 to 0 dl 1788361557 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361546.089803:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986705180 with x1875232130847872 ext(1048576->2097151) 00002000:00010000:1.0:1788361546.089809:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8986705180 00000100:00100000:3.0:1788361546.094553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361546.094638:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130848000 00000100:00100000:1.0:1788361546.094658:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130848000 00002000:00100000:1.0:1788361546.094704:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff9a8a835e0000 x1875232130848000/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/0 e 0 to 0 dl 1788361557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361546.094714:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a835e0000 with x1875232130848000 ext(2097152->3145727) 00002000:00010000:1.0:1788361546.094720:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a835e0000 00000100:00100000:1.0:1788361546.094750:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 354 00000100:00100000:1.0:1788361546.094759:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+23:2350:x1875232130848000:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361546.101788:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+25:2350:x1875232130848000:12345-192.168.203.60@tcp:4:dd.0 Request processed in 7020us (7235us total) trans 30064771277 rc 0/0 00000100:00100000:1.0:1788361546.101803:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 354 00002000:00100000:1.0:1788361546.101816:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff9a8a835e0000 x1875232130848000/t30064771277(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/448 e 0 to 0 dl 1788361557 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361546.101827:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a835e0000 with x1875232130848000 ext(2097152->3145727) 00002000:00010000:1.0:1788361546.101843:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a835e0000 00000100:00100000:3.0:1788361546.106871:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361546.107024:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130848128 00000100:00100000:2.0:1788361546.107034:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130848128 00002000:00100000:2.0:1788361546.107081:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff9a8a835e0380 x1875232130848128/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/0 e 0 to 0 dl 1788361557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361546.107129:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a835e0380 with x1875232130848128 ext(3145728->4194303) 00002000:00010000:2.0:1788361546.107135:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a835e0380 00000100:00100000:2.0:1788361546.107169:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 355 00000100:00100000:2.0:1788361546.107180:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+25:2349:x1875232130848128:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:2.0:1788361546.112304:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+27:2349:x1875232130848128:12345-192.168.203.60@tcp:4:dd.0 Request processed in 5117us (5432us total) trans 30064771278 rc 0/0 00000100:00100000:2.0:1788361546.112318:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 355 00002000:00100000:2.0:1788361546.112330:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff9a8a835e0380 x1875232130848128/t30064771278(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/448 e 0 to 0 dl 1788361557 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361546.112341:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a835e0380 with x1875232130848128 ext(3145728->4194303) 00002000:00010000:2.0:1788361546.112348:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8a835e0380 00000100:00100000:3.0:1788361546.119218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361546.119262:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361546.119706:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130848512 00000100:00100000:2.0:1788361546.119717:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130848512 00000100:00100000:2.0:1788361546.119774:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:2.0:1788361546.119784:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+48:38914:x1875232130848512:12345-192.168.203.60@tcp:35:dd.0 00000100:00100000:2.0:1788361546.120182:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+49:38914:x1875232130848512:12345-192.168.203.60@tcp:35:dd.0 Request processed in 398us (918us total) trans 30064771463 rc 0/0 00000100:00100000:2.0:1788361546.120189:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:1.0:1788361546.120473:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130848256 00000100:00100000:1.0:1788361546.120480:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130848256 00002000:00100000:1.0:1788361546.120519:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff9a8ab6abbb80 x1875232130848256/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/0 e 0 to 0 dl 1788361557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361546.120537:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6abbb80 with x1875232130848256 ext(4194304->5242879) 00002000:00010000:1.0:1788361546.120543:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6abbb80 00000100:00100000:1.0:1788361546.120574:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 356 00000100:00100000:1.0:1788361546.120582:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+27:2350:x1875232130848256:12345-192.168.203.60@tcp:4:dd.0 00000100:00100000:1.0:1788361546.134946:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130848256:12345-192.168.203.60@tcp:4:dd.0 Request processed in 14354us (15726us total) trans 30064771279 rc 0/0 00000100:00100000:1.0:1788361546.134961:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 356 00002000:00100000:1.0:1788361546.134973:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff9a8ab6abbb80 x1875232130848256/t30064771279(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/448 e 0 to 0 dl 1788361557 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361546.134984:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6abbb80 with x1875232130848256 ext(4194304->5242879) 00002000:00010000:1.0:1788361546.134991:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6abbb80 00010000:00010000:1.0:1788361546.144276:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361546.169553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361546.169697:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130848640 00000100:00100000:2.0:1788361546.169708:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130848640 00000100:00100000:2.0:1788361546.169766:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 459 00000100:00100000:2.0:1788361546.169776:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+49:38924:x1875232130848640:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361546.169800:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361546.169821:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fae8 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.169885:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d661661d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.169900:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d661661d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.169912:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d661661d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361546.170148:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1788361546.170153:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361546.170236:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d661661d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.170262:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fae8 expref: 51 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.170276:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d661661d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fae8 expref: 50 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.170284:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361546.170287:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361546.170290:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902600, rc 0) 00000100:00100000:2.0:1788361546.170356:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+50:38924:x1875232130848640:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 581us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361546.170362:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 459 00000100:00100000:0.0:1788361546.172577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361546.172684:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130848768 00000100:00100000:1.0:1788361546.172692:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130848768 00000100:00100000:1.0:1788361546.172748:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 460 00000100:00100000:1.0:1788361546.172757:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+50:38924:x1875232130848768:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:1.0:1788361546.172823:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616624 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.172839:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.172859:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.172875:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d661662b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.172883:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d661662b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.172889:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d661662b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173373:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173383:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173391:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361546.173431:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173444:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616624 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173451:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616624 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173457:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173474:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f94200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361546.173478:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616624 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173486:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616624 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173498:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:1.0:1788361546.173500:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361546.173504:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616624 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173510:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f94200/0xf6a94c97d6616624 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173521:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d661662b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173527:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d661662b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173533:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d661662b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173537:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f95c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361546.173540:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d661662b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173545:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d661662b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173562:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8aa8ee1500) 00010000:00010000:1.0:1788361546.173564:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361546.173567:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d661662b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173572:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95c00/0xf6a94c97d661662b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173585:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173590:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173595:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173600:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8f95600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361546.173602:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173607:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173614:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361546.173616:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361546.173618:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.173623:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8f95600/0xf6a94c97d6616632 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361546.173844:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+50:38924:x1875232130848768:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1086us (1272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361546.173852:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 460 00000100:00100000:0.0:1788361546.225046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361546.226678:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130849024 00000100:00100000:3.0:1788361546.226692:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130849024 00000100:00100000:3.0:1788361546.226818:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 461 00000100:00100000:3.0:1788361546.226829:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+50:38930:x1875232130849024:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:3.0:1788361546.226853:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361546.226872:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616639 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86faef expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.226942:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616640 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.226956:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616640 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.226967:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616640 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.226981:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616647 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.226988:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.226994:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227418:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388c00/0xf6a94c97d661664e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227437:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388c00/0xf6a94c97d661664e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227444:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388c00/0xf6a94c97d661664e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361546.227452:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:3.0:1788361546.227528:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616640 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227535:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616640 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227541:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616640 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227546:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361546.227551:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616640 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227558:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616640 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227569:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:3.0:1788361546.227572:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361546.227576:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616640 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227581:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616640 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227603:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616647 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227608:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616647 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227613:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616647 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227618:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361546.227620:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616647 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227627:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616647 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227634:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8a827d7400) 00010000:00010000:3.0:1788361546.227636:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361546.227639:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616647 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227654:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616647 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227694:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616639 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faef expref: 53 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227709:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388c00/0xf6a94c97d661664e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faef expref: 52 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361546.227728:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:3.0:1788361546.227730:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361546.227732:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388c00, rc 0) 00000100:00100000:3.0:1788361546.227797:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+52:38930:x1875232130849024:12345-192.168.203.60@tcp:101:dd.500 Request processed in 970us (2760us total) trans 30064771464 rc 0/0 00000100:00100000:3.0:1788361546.227806:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 461 00000100:00100000:1.0:1788361546.232827:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361546.232941:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130849280 00000100:00100000:2.0:1788361546.232952:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130849280 00000100:00100000:2.0:1788361546.233040:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 462 00000100:00100000:2.0:1788361546.233051:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+52:38930:x1875232130849280:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:2.0:1788361546.233110:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361546.233114:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1788361546.233143:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d661660f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fae1 expref: 52 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233167:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388c00/0xf6a94c97d661664e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faef expref: 51 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233178:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361546.233182:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361546.233197:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d661665c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86faf6 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233243:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616663 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233257:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616663 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233267:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616663 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233280:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616663 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233286:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616663 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233297:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616663 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233304:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361546.233308:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616663 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233316:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616663 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233324:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361546.233327:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361546.233331:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616663 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233337:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616663 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233361:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661666a lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233370:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661666a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233376:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661666a lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233547:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661666a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faf6 expref: 53 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233556:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361546.233559:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788361546.233570:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d661665c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faf6 expref: 53 pid: 35346 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233583:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902400/0xf6a94c97d661666a lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86faf6 expref: 52 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.233605:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361546.233607:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1788361546.233610:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902400, rc 0) 00000100:00100000:2.0:1788361546.233772:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+52:38930:x1875232130849280:12345-192.168.203.60@tcp:101:dd.500 Request processed in 721us (952us total) trans 30064771465 rc 0/0 00000100:00100000:2.0:1788361546.233779:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 462 00000100:00100000:1.0:1788361546.247723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361546.247826:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130849408 00000100:00100000:3.0:1788361546.247837:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130849408 00002000:00100000:3.0:1788361546.247884:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff9a8986704000 x1875232130849408/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/0 e 0 to 0 dl 1788361557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361546.247895:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986704000 with x1875232130849408 ext(0->1048575) 00002000:00010000:3.0:1788361546.247901:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8986704000 00000100:00100000:3.0:1788361546.247972:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 357 00000100:00100000:3.0:1788361546.247982:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130849408:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:2.0:1788361546.264532:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+29:2350:x1875232130849408:12345-192.168.203.60@tcp:3:dd.0 Request processed in 16541us (16806us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361546.264546:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 357 00002000:00100000:2.0:1788361546.264558:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0xcc:0x0] (0->1048575) req@ffff9a8986704000 x1875232130849408/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/440 e 0 to 0 dl 1788361557 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361546.264569:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986704000 with x1875232130849408 ext(0->1048575) 00002000:00010000:2.0:1788361546.264575:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8986704000 00000100:00100000:0.0:1788361546.287538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361546.290737:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130849536 00000100:00100000:3.0:1788361546.290759:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130849536 00002000:00100000:3.0:1788361546.290819:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff9a8ab71b2a00 x1875232130849536/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/0 e 0 to 0 dl 1788361557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361546.290831:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b2a00 with x1875232130849536 ext(1048576->2097151) 00002000:00010000:3.0:1788361546.290836:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab71b2a00 00000100:00100000:3.0:1788361546.290876:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 358 00000100:00100000:3.0:1788361546.290886:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130849536:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:1.0:1788361546.302927:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130849536:12345-192.168.203.60@tcp:3:dd.0 Request processed in 12032us (15390us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1788361546.302940:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 358 00002000:00100000:1.0:1788361546.302952:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xcc:0x0] (1048576->2097151) req@ffff9a8ab71b2a00 x1875232130849536/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/440 e 0 to 0 dl 1788361557 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361546.302962:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b2a00 with x1875232130849536 ext(1048576->2097151) 00002000:00010000:1.0:1788361546.302968:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab71b2a00 00000100:00100000:3.0:1788361546.313120:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361546.313191:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130849664 00000100:00100000:0.0:1788361546.313203:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130849664 00002000:00100000:0.0:1788361546.313261:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff9a8ab6ab8000 x1875232130849664/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/0 e 0 to 0 dl 1788361557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361546.313276:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6ab8000 with x1875232130849664 ext(2097152->3145727) 00002000:00010000:0.0:1788361546.313284:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6ab8000 00000100:00100000:0.0:1788361546.313382:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 359 00000100:00100000:0.0:1788361546.313392:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+29:2352:x1875232130849664:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:1.0:1788361546.314053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361546.314550:0:38206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130849792 00000100:00100000:3.0:1788361546.314558:0:38206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130849792 00002000:00100000:3.0:1788361546.314597:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff9a8986707b80 x1875232130849792/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/0 e 0 to 0 dl 1788361557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361546.314607:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986707b80 with x1875232130849792 ext(3145728->4194303) 00002000:00010000:3.0:1788361546.314612:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8986707b80 00000100:00100000:3.0:1788361546.314652:0:38206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 360 00000100:00100000:3.0:1788361546.314662:0:38206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+31:2351:x1875232130849792:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:0.0:1788361546.322139:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+31:2352:x1875232130849664:12345-192.168.203.60@tcp:3:dd.0 Request processed in 8736us (9051us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361546.322261:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 359 00002000:00100000:0.0:1788361546.322276:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xcc:0x0] (2097152->3145727) req@ffff9a8ab6ab8000 x1875232130849664/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/440 e 0 to 0 dl 1788361557 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361546.322287:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab6ab8000 with x1875232130849664 ext(2097152->3145727) 00002000:00010000:0.0:1788361546.322293:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8ab6ab8000 00000100:00100000:2.0:1788361546.325461:0:38206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:c05f3090-241b-43d5-9787-08721e3d4333+29:2351:x1875232130849792:12345-192.168.203.60@tcp:3:dd.0 Request processed in 10726us (11336us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1788361546.325476:0:38206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 360 00002000:00100000:2.0:1788361546.325488:0:38206:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0xcc:0x0] (3145728->4194303) req@ffff9a8986707b80 x1875232130849792/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/440 e 0 to 0 dl 1788361557 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788361546.325498:0:38206:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8986707b80 with x1875232130849792 ext(3145728->4194303) 00002000:00010000:2.0:1788361546.325505:0:38206:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8986707b80 00000100:00100000:2.0:1788361546.356322:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361546.356411:0:38815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130849920 00000100:00100000:0.0:1788361546.356422:0:38815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130849920 00002000:00100000:0.0:1788361546.356474:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff9a8abc896680 x1875232130849920/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/0 e 0 to 0 dl 1788361557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361546.356483:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc896680 with x1875232130849920 ext(4194304->5242879) 00002000:00010000:0.0:1788361546.356488:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abc896680 00000100:00100000:0.0:1788361546.356561:0:38815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 361 00000100:00100000:0.0:1788361546.356571:0:38815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130849920:12345-192.168.203.60@tcp:3:dd.0 00000100:00100000:0.0:1788361546.364008:0:38815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130849920:12345-192.168.203.60@tcp:3:dd.0 Request processed in 7428us (7685us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1788361546.364021:0:38815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 361 00002000:00100000:0.0:1788361546.364034:0:38815:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0xcc:0x0] (4194304->5242879) req@ffff9a8abc896680 x1875232130849920/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:607/0 lens 488/440 e 0 to 0 dl 1788361557 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361546.364044:0:38815:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abc896680 with x1875232130849920 ext(4194304->5242879) 00002000:00010000:0.0:1788361546.364062:0:38815:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a8abc896680 00000100:00100000:3.0:1788361546.391044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361546.391260:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130850176 00000100:00100000:0.0:1788361546.391272:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130850176 00000100:00100000:0.0:1788361546.391333:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:0.0:1788361546.391343:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88351450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+52:38930:x1875232130850176:12345-192.168.203.60@tcp:35:dd.500 00000100:00100000:0.0:1788361546.391605:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88351450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+53:38930:x1875232130850176:12345-192.168.203.60@tcp:35:dd.500 Request processed in 263us (569us total) trans 30064771466 rc 0/0 00000100:00100000:0.0:1788361546.391613:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:1.0:1788361546.440326:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361546.440706:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130850304 00000100:00100000:2.0:1788361546.440717:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130850304 00000100:00100000:2.0:1788361546.440781:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 463 00000100:00100000:2.0:1788361546.440790:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+53:38936:x1875232130850304:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361546.440866:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616671 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.440882:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616671 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.440892:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616671 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.440907:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616678 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.440913:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.440921:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441292:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441302:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441309:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361546.441361:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441373:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616671 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441379:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616671 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441386:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616671 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441392:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361546.441396:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616671 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441403:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616671 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441414:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361546.441417:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361546.441421:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441427:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441438:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441443:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616678 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441449:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616678 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441455:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361546.441458:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616678 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441463:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616678 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441471:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8a83c0b600) 00010000:00010000:2.0:1788361546.441473:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361546.441476:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616678 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441481:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d6616678 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441494:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441501:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441507:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441512:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361546.441515:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441525:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441532:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361546.441535:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361546.441538:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.441543:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d661667f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361546.441620:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+53:38936:x1875232130850304:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 829us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361546.441633:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 463 00000100:00100000:3.0:1788361546.458968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361546.459081:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130850560 00000100:00100000:0.0:1788361546.459119:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130850560 00000100:00100000:0.0:1788361546.459244:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 464 00000100:00100000:0.0:1788361546.459256:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+53:38937:x1875232130850560:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361546.459278:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361546.459298:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6616686 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fafd expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459375:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d661668d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459389:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d661668d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459401:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d661668d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459417:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616694 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459424:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459445:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459797:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d661668d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459804:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d661668d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459810:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d661668d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459816:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361546.459820:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d661668d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459826:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d661668d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459838:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:0.0:1788361546.459841:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361546.459845:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d661668d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459851:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d661668d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459861:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616694 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459866:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616694 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459878:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459883:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361546.459886:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616694 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459892:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616694 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459900:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361546.459902:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361546.459905:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616694 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459910:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616694 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459943:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6616686 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fafd expref: 54 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459953:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:0.0:1788361546.459955:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361546.459958:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6616686 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fafd expref: 54 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.459979:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80030200, rc 0) 00000100:00100000:0.0:1788361546.460045:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+53:38937:x1875232130850560:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 792us (1086us total) trans 0 rc 301/301 00000100:00100000:0.0:1788361546.460061:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 464 00000100:00100000:3.0:1788361546.464517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361546.464580:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130850688 00000100:00100000:2.0:1788361546.464590:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130850688 00000100:00100000:2.0:1788361546.464695:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 465 00000100:00100000:2.0:1788361546.464705:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+53:38937:x1875232130850688:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1788361546.464773:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d661669b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.464790:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d661669b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.464801:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d661669b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.464815:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.464827:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.464834:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465210:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465220:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465227:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361546.465260:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00000004:00200000:2.0:1788361546.465264:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361546.465277:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465300:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d661669b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465308:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d661669b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465315:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d661669b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465322:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361546.465326:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d661669b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465333:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d661669b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465344:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361546.465347:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361546.465351:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d661669b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465356:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d661669b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465366:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465371:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465376:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465381:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361546.465383:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465388:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465393:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8a83c0b600) 00010000:00010000:2.0:1788361546.465396:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361546.465398:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465406:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465416:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465421:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465426:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465430:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361546.465433:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465438:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465444:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361546.465446:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361546.465448:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.465453:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d66166a9 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361546.465522:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+53:38937:x1875232130850688:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 817us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361546.465530:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 465 00000100:00100000:2.0:1788361546.494143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361546.494513:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130850816 00000100:00100000:1.0:1788361546.494523:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130850816 00000100:00100000:1.0:1788361546.494583:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 466 00000100:00100000:1.0:1788361546.494593:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+53:38943:x1875232130850816:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361546.494613:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361546.494631:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66166b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb04 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.494701:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66166b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.494728:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66166b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.494740:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66166b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.494756:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66166be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.494762:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66166be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.494768:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66166be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.495241:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.495777:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.495791:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361546.495825:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00000004:00200000:1.0:1788361546.495829:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361546.495848:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.495858:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.495879:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66166b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.495885:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66166b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.495892:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66166b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.495897:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361546.495901:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66166b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.495909:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66166b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.495920:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:1.0:1788361546.495923:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361546.496031:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66166b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496039:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d66166b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496054:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66166be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496060:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66166be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496066:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66166be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496077:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361546.496080:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66166be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496128:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66166be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496138:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa08831f9 (ffff9a8aa8ee1500) 00010000:00010000:1.0:1788361546.496140:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361546.496143:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66166be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496148:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d66166be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa08831f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496182:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66166b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb04 expref: 55 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496196:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb04 expref: 54 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361546.496203:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:1.0:1788361546.496205:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361546.496208:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:1.0:1788361546.496295:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+54:38943:x1875232130850816:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1705us (2212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361546.496301:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 466 00000100:00100000:3.0:1788361546.500588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361546.501616:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130851072 00000100:00100000:0.0:1788361546.501626:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130851072 00000100:00100000:0.0:1788361546.501700:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 467 00000100:00100000:0.0:1788361546.501710:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+54:38943:x1875232130851072:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361546.501731:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361546.501752:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66166cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb0b expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.501882:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d66166d3 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.501898:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d66166d3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.501919:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d66166d3 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361546.501931:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:0.0:1788361546.502059:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d66166cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb0b expref: 57 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.502077:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45000/0xf6a94c97d66166d3 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2c:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb0b expref: 56 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.502130:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361546.502134:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788361546.502139:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45000, rc 0) 00000100:00100000:0.0:1788361546.502214:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+56:38943:x1875232130851072:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 504us (1754us total) trans 30064771467 rc 0/0 00000100:00100000:0.0:1788361546.502222:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 467 00000100:00100000:3.0:1788361546.588936:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361546.589052:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130851328 00000100:00100000:2.0:1788361546.589062:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130851328 00000100:00100000:2.0:1788361546.590796:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 468 00000100:00100000:2.0:1788361546.590816:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+56:38949:x1875232130851328:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361546.590848:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361546.590870:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb12 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.590972:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66166e8 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.590988:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb04 expref: 57 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.591006:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66166e8 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.591045:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb04 expref: 57 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.591059:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb04 expref: 57 pid: 35347 timeout: 1036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361546.591075:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144241408:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361546.591216:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361546.595881:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144241408:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361546.595910:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66166e8 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361546.596955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361546.597938:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130851456 00000100:00100000:2.0:1788361546.597947:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130851456 00010000:00010000:2.0:1788361546.597986:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb04 expref: 58 pid: 35347 timeout: 1036 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361546.598030:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:2.0:1788361546.598040:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6aba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+58:2349:x1875232130851456:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361546.598054:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361546.598061:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb04 expref: 58 pid: 35347 timeout: 1036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.598075:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb04 expref: 58 pid: 35347 timeout: 1036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.598112:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d66166c5 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb04 expref: 58 pid: 35347 timeout: 1036 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.598125:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:2.0:1788361546.598129:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66166e8 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.598137:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66166e8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.598143:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66166e8 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361546.598208:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361546.598260:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6aba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+57:2349:x1875232130851456:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 216us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361546.598267:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00010000:00010000:0.0:1788361546.598423:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66166e8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.598432:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66166e8 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361546.598451:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2c:0x0]: returning size 5242880 00010000:00010000:0.0:1788361546.598606:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb12 expref: 58 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.598622:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902e00/0xf6a94c97d66166e8 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2c:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb12 expref: 57 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361546.598630:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2c:0x0].0x0 (ffff9a8a890c3300) 00010000:00010000:0.0:1788361546.598632:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361546.598634:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902e00, rc 0) 00000100:00100000:0.0:1788361546.598671:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+57:38949:x1875232130851328:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 7864us (9745us total) trans 30064771468 rc 0/0 00000100:00100000:0.0:1788361546.598678:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 468 00000100:00100000:2.0:1788361546.912877:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144241536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361546.912909:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144241920:0@lo:400:kworker.0 00000100:00100000:0.0:1788361546.913005:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144241792:0@lo:400:kworker.0 00000100:00100000:2.0:1788361546.913069:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361546.913927:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144241664:0@lo:400:kworker.0 00000100:00100000:2.0:1788361546.913980:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361546.914254:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144242176:0@lo:400:kworker.0 00000100:00100000:1.0:1788361546.914270:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144241536 00000100:00100000:1.0:1788361546.914300:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144241536 00000100:00100000:1.0:1788361546.914348:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788361546.914356:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144241536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361546.914379:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 333905920 pending 11927552 free 3709861888 avail 3707764736 00000100:00100000:3.0:1788361546.916670:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361546.916727:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361546.916739:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144242048:0@lo:400:kworker.0 00000100:00100000:3.0:1788361546.918300:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361546.918371:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144241920 00000100:00100000:3.0:1788361546.918380:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144241920 00000100:00100000:3.0:1788361546.918425:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144242048 00000100:00100000:3.0:1788361546.918428:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144242048 00000100:00100000:3.0:1788361546.918455:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788361546.918463:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144241920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361546.918526:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144241920:12345-0@lo:400:kworker.0 Request processed in 64us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361546.918547:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788361546.918564:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788361546.918570:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144242048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361546.918602:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144242048:12345-0@lo:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361546.918607:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788361546.918623:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361546.918764:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144242048:0@lo:400:kworker.0 00000100:00100000:3.0:1788361546.918779:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144241920:0@lo:400:kworker.0 00000100:00100000:0.0:1788361546.918789:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361546.918831:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144241792 00000100:00100000:0.0:1788361546.918835:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144241792 00000100:00100000:3.0:1788361546.918847:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144241664 00000100:00100000:3.0:1788361546.918853:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144241664 00000100:00100000:0.0:1788361546.918877:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788361546.918886:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144241792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361546.918893:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788361546.918903:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144241664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361546.918928:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144241792:12345-0@lo:400:kworker.0 Request processed in 43us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361546.918936:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788361546.918955:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144241664:12345-0@lo:400:kworker.0 Request processed in 53us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361546.918962:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788361546.919074:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144241792:0@lo:400:kworker.0 00000100:00080000:3.0:1788361546.920425:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361546.920506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361546.920533:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875232144241536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6174us (7460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361546.920545:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788361546.920562:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144241664:0@lo:400:kworker.0 00000100:00100000:3.0:1788361546.920652:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144241536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361546.921519:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144242176 00000100:00100000:0.0:1788361546.921530:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144242176 00000100:00100000:0.0:1788361546.921609:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788361546.921613:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361546.921620:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144242176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361546.921708:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144242176:12345-0@lo:400:kworker.0 Request processed in 90us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361546.921715:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788361546.922078:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144242176:0@lo:400:kworker.0 00010000:00010000:3.0:1788361547.169383:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361547.425511:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144242304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361547.425589:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361547.425695:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144242304 00000100:00100000:2.0:1788361547.425703:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144242304 00000100:00100000:2.0:1788361547.425764:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788361547.425773:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144242304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361547.425810:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216334336 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361547.425938:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144242304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 166us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361547.425947:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788361547.426008:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144242304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361548.192338:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361548.936669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361548.936714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361548.936745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361548.936777:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361548.936809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361548.936842:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130852096 00000100:00100000:2.0:1788361548.936851:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130852096 00000100:00100000:2.0:1788361548.936906:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130851712 00000100:00100000:2.0:1788361548.936910:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130851712 00000100:00100000:2.0:1788361548.936935:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:2.0:1788361548.936943:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130852096:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361548.936970:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130851840 00000100:00100000:1.0:1788361548.936976:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130851840 00000100:00100000:1.0:1788361548.937010:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130851968 00000100:00100000:1.0:1788361548.937012:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130851968 00000100:00100000:2.0:1788361548.937028:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130852096:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361548.937036:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:2.0:1788361548.937041:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1788361548.937046:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130851840:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361548.937066:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:2.0:1788361548.937077:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+57:2349:x1875232130851712:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361548.937083:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130851840:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361548.937115:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:1.0:1788361548.937127:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:1.0:1788361548.937134:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130851968:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361548.937160:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+29:2349:x1875232130851968:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361548.937167:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:3.0:1788361548.937230:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130851584 00000100:00100000:3.0:1788361548.937235:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130851584 00000100:00100000:3.0:1788361548.937270:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:3.0:1788361548.937278:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130851584:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:0.0:1788361548.937280:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361548.937286:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361548.937290:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361548.937315:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130851584:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361548.937322:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:3.0:1788361548.940546:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+57:2349:x1875232130851712:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 3460us (3757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361548.940561:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000001:00080000:1.0:1788361549.003593:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771272 is committed 00000001:00080000:1.0:1788361549.003610:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771271 is committed 00000001:00080000:1.0:1788361549.003617:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771279 is committed 00000001:00080000:1.0:1788361549.003651:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771273 is committed 00010000:00010000:3.0:1788361549.216375:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361549.366576:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361549.366957:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130852224 00000100:00100000:2.0:1788361549.366968:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130852224 00000100:00100000:2.0:1788361549.367035:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 469 00000100:00100000:2.0:1788361549.367044:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:39378:x1875232130852224:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:2.0:1788361549.367068:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361549.367126:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d66166f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb19 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361549.367198:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361549.367213:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361549.367224:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361549.367616:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1788361549.367635:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361549.367789:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361549.367864:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d66166f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb19 expref: 7 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361549.367939:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb19 expref: 6 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361549.367951:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:3.0:1788361549.367954:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361549.367961:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902a00, rc 0) 00000100:00100000:3.0:1788361549.368048:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:39378:x1875232130852224:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 1005us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361549.368053:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 469 00010000:00010000:3.0:1788361550.240333:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361551.013059:0:39600:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 11: Test attach fault injection with simulated PCC file path ========================================================== 11:05:50 (1788361550) 00010000:00010000:1.0:1788361551.264442:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788361551.554794:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771468 is committed 00000100:00100000:3.0:1788361551.704138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361551.704239:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130852480 00000100:00100000:1.0:1788361551.704248:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130852480 00000100:00100000:1.0:1788361551.704517:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 470 00000100:00100000:1.0:1788361551.704528:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+51:39636:x1875232130852480:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361551.704555:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361551.704576:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616704 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb20 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.704658:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661670b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.704673:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661670b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.704684:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661670b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.704697:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616712 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.704702:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616712 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.704716:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616712 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788361551.704884:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361551.705169:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6616719 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705176:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6616719 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705182:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6616719 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361551.705188:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1788361551.705351:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661670b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705357:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661670b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705361:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661670b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705365:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361551.705367:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661670b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705372:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661670b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705381:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:1.0:1788361551.705383:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361551.705390:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661670b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705394:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661670b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705402:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616712 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705406:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616712 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705409:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616712 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705412:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361551.705414:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616712 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705417:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616712 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705421:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8aa8ee1000) 00010000:00010000:1.0:1788361551.705422:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361551.705424:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616712 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705427:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616712 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705741:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616704 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb20 expref: 54 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705759:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6616719 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb20 expref: 53 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.705764:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:1.0:1788361551.705766:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361551.705768:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8600, rc 0) 00000100:00100000:1.0:1788361551.705822:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+53:39636:x1875232130852480:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1297us (1690us total) trans 30064771469 rc 0/0 00000100:00100000:1.0:1788361551.705829:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 470 00000100:00100000:2.0:1788361551.708488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361551.708641:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130852736 00000100:00100000:3.0:1788361551.708652:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130852736 00000100:00100000:2.0:1788361551.708659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361551.708749:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 471 00000100:00100000:3.0:1788361551.708760:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+53:39636:x1875232130852736:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788361551.708803:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130852608 00000100:00100000:0.0:1788361551.708822:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130852608 00000100:00100000:3.0:1788361551.708872:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+54:39636:x1875232130852736:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 113us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361551.708879:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:3.0:1788361551.708885:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 471 00000100:00100000:0.0:1788361551.708891:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+54:2351:x1875232130852608:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361551.708904:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361551.709199:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d6616719 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb20 expref: 53 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.709220:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:0.0:1788361551.709237:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361551.709275:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+52:2351:x1875232130852608:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 387us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361551.709282:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:2.0:1788361551.783055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361551.783224:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130852992 00000100:00100000:3.0:1788361551.783234:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130852992 00000100:00100000:3.0:1788361551.783295:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 472 00000100:00100000:3.0:1788361551.783305:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+52:39650:x1875232130852992:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361551.783326:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361551.783329:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788361551.783353:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d661661d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fae8 expref: 52 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.783372:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:3.0:1788361551.783376:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361551.783389:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616727 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb27 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.784528:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.784548:0:37551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb19 expref: 5 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.784568:0:37551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.784617:0:37551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb19 expref: 5 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.784633:0:37551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb19 expref: 5 pid: 37551 timeout: 1041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361551.784649:0:37551:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6abaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:37551:1875232144242432:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361551.784747:0:37551:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a88c639c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788361551.786392:0:37551:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6abaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:37551:1875232144242432:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361551.786416:0:37551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361551.786889:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361551.786932:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130853120 00000100:00100000:0.0:1788361551.786938:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130853120 00000100:00080000:3.0:1788361551.786985:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788361551.786992:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb19 expref: 6 pid: 37551 timeout: 1041 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361551.787109:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:0.0:1788361551.787124:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89810c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130853120:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361551.787136:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361551.787141:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb19 expref: 6 pid: 37551 timeout: 1041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.787150:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb19 expref: 6 pid: 37551 timeout: 1041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.787166:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d66166fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb19 expref: 6 pid: 37551 timeout: 1041 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.787177:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:0.0:1788361551.787180:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.787199:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.787204:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.787228:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361551.787273:0:37551:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.787283:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361551.787298:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89810c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130853120:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 180us (408us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361551.787307:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361551.787307:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00010000:00010000:3.0:1788361551.787320:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.787330:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361551.790049:0:37551:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcd:0x0], index 0: 0 00010000:00010000:3.0:1788361551.790576:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.790600:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.791037:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.791078:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.791316:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.791324:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.791330:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361551.791334:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.791342:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.791354:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b400) 00010000:00010000:3.0:1788361551.791358:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361551.791362:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.791367:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661672e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361551.791380:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000dd9ce5d reply state 0000000090708928 transno 30064771470 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361551.791397:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788361551.791436:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616727 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb27 expref: 54 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.791457:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb27 expref: 53 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.791464:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8a827d7900) 00010000:00010000:3.0:1788361551.791466:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361551.791469:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389600, rc 0) 00000100:00100000:3.0:1788361551.791544:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+54:39650:x1875232130852992:12345-192.168.203.60@tcp:101:bash.0 Request processed in 8240us (8496us total) trans 30064771470 rc 0/0 00000100:00100000:3.0:1788361551.791553:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 472 00010000:00010000:0.0:1788361551.793628:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.793645:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.793652:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.793658:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361551.793663:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.793671:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.793686:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff9a8a827d7e00) 00010000:00010000:0.0:1788361551.793689:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361551.793694:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.793717:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d6616735 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361551.795711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361551.796060:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130853248 00000100:00100000:1.0:1788361551.796071:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130853248 00000100:00100000:1.0:1788361551.796173:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:1.0:1788361551.796183:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130853248:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788361551.796200:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361551.796228:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d661674a lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb2e expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361551.796256:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361551.796276:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=941s v=(0 0) 00010000:00010000:1.0:1788361551.796280:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361551.796290:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d661674a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb2e expref: 11 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.796307:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d661674a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb2e expref: 11 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.796339:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:1.0:1788361551.796405:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130853248:12345-192.168.203.60@tcp:101:bash.0 Request processed in 223us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361551.796413:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00080000:3.0:1788361551.796778:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361551.799416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361551.799495:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130853376 00000100:00100000:0.0:1788361551.799505:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130853376 00000100:00100000:0.0:1788361551.799572:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 142 00000100:00100000:0.0:1788361551.799581:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+11:39650:x1875232130853376:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788361551.799598:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361551.799627:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb35 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.799660:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d661674a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb2e expref: 12 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.799669:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361551.799673:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361551.799678:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 12 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.799708:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d661674a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb2e expref: 12 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.799721:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d661674a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb2e expref: 12 pid: 35980 timeout: 1041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361551.799743:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144242560:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361551.799829:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361551.804796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361551.804930:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130853504 00000100:00100000:1.0:1788361551.804939:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130853504 00010000:00010000:1.0:1788361551.804975:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d661674a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb2e expref: 13 pid: 35980 timeout: 1041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361551.805061:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:1.0:1788361551.805072:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130853504:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361551.805116:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361551.805138:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d661674a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb2e expref: 13 pid: 35980 timeout: 1041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.805151:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d661674a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb2e expref: 13 pid: 35980 timeout: 1041 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.805176:0:35331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361551.805184:0:35331:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361551.805194:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 13 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.805204:0:35331:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 13 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.805265:0:35331:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 13 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361551.805278:0:35331:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:35331:1875232144242688:192.168.203.60@tcp:105: 00000100:00100000:1.0:1788361551.805358:0:35331:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6300 going to sleep for 11 seconds 00010000:00010000:0.0:1788361551.805623:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000537803fb/0xf6a94c97d661674a lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb2e expref: 13 pid: 35980 timeout: 1041 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361551.805641:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144242560:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361551.805665:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 12 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.805676:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45400, rc 0) 00000100:00100000:0.0:1788361551.805773:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:39650:x1875232130853376:12345-192.168.203.60@tcp:101:bash.0 Request processed in 6191us (6364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361551.805782:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 142 00000100:00100000:3.0:1788361551.809620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361551.809694:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130853760 00000100:00100000:0.0:1788361551.809704:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130853760 00000100:00100000:0.0:1788361551.809806:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:0.0:1788361551.809818:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+53:39650:x1875232130853760:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:1.0:1788361551.809852:0:35331:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986705c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:35331:1875232144242688:192.168.203.60@tcp:105: 00010000:00010000:1.0:1788361551.809875:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361551.809934:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2350:x1875232130853504:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 4863us (5156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361551.809944:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:0.0:1788361551.810185:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:39650:x1875232130853760:12345-192.168.203.60@tcp:35:bash.0 Request processed in 369us (581us total) trans 30064771471 rc 0/0 00000100:00100000:0.0:1788361551.810192:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:3.0:1788361551.839306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361551.839566:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130853888 00000100:00100000:1.0:1788361551.839576:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130853888 00000100:00100000:1.0:1788361551.839697:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 473 00000100:00100000:1.0:1788361551.839708:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+54:39653:x1875232130853888:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361551.839744:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361551.839770:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616758 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb3c expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.839835:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661675f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.839849:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661675f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.839861:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661675f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361551.839946:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:1.0:1788361551.839949:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361551.839968:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661675f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.839985:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb3c expref: 56 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.839999:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661675f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb3c expref: 55 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.840005:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:1.0:1788361551.840007:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361551.840010:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8400, rc 0) 00000100:00100000:1.0:1788361551.840059:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:39653:x1875232130853888:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 355us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361551.840064:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 473 00000040:00080000:2.0:1788361551.904723:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361551.904732:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361551.905019:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 5 00000040:00080000:2.0:1788361551.905027:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361551.977394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361551.977852:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130854144 00000100:00100000:3.0:1788361551.977863:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130854144 00000100:00100000:3.0:1788361551.977981:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 474 00000100:00100000:3.0:1788361551.977993:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:39676:x1875232130854144:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361551.978016:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361551.978036:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616766 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb43 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.978167:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d661676d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.978211:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d661676d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.978224:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d661676d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361551.978238:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:3.0:1788361551.978365:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616766 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb43 expref: 58 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.978383:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d661676d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb43 expref: 57 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.978391:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8a827d7900) 00010000:00010000:3.0:1788361551.978394:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361551.978398:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388e00, rc 0) 00000100:00100000:3.0:1788361551.978466:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+57:39676:x1875232130854144:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 475us (1080us total) trans 30064771472 rc 0/0 00000100:00100000:3.0:1788361551.978473:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 474 00000100:00100000:2.0:1788361551.982178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361551.982470:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130854400 00000100:00100000:3.0:1788361551.982480:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130854400 00000100:00100000:3.0:1788361551.982736:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 475 00000100:00100000:3.0:1788361551.982748:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+57:39676:x1875232130854400:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361551.982772:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361551.982829:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661677b lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb4a expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.982947:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616782 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.982961:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616782 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.982972:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616782 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361551.982984:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:3.0:1788361551.983121:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661677b lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb4a expref: 60 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.983139:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616782 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb4a expref: 59 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361551.983147:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8a827d7900) 00010000:00010000:3.0:1788361551.983149:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788361551.983153:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389400, rc 0) 00000100:00100000:3.0:1788361551.983225:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+59:39676:x1875232130854400:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 479us (1055us total) trans 30064771473 rc 0/0 00000100:00100000:3.0:1788361551.983232:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 475 00000100:00100000:2.0:1788361551.983310:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361551.983474:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130854528 00000100:00100000:1.0:1788361551.983480:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130854528 00000100:00100000:1.0:1788361551.983522:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1788361551.983530:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+59:2349:x1875232130854528:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361551.983540:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361551.983556:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d661676d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb43 expref: 59 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.983566:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8a827d7900) 00010000:00010000:1.0:1788361551.983582:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361551.983619:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+58:2349:x1875232130854528:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 89us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361551.983628:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1788361551.987542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361551.987863:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130854656 00000100:00100000:1.0:1788361551.987874:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130854656 00000100:00100000:1.0:1788361551.987930:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:1.0:1788361551.987940:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2351:x1875232130854656:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:1.0:1788361551.987985:0:35980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.988005:0:35980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 11 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.988014:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xcd:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788361551.988018:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361551.988023:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.988060:0:35980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 11 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361551.988076:0:35980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 11 pid: 36286 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361551.988302:0:35980:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35980:1875232144242816:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361551.988490:0:35980:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361551.994006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361551.994155:0:35980:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35980:1875232144242816:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361551.994180:0:35980:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361551.994506:0:35986:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130854784 00000100:00100000:0.0:1788361551.994514:0:35986:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130854784 00002000:00100000:0.0:1788361551.995065:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcd:0x0] (0->4) req@ffff9a8a83540380 x1875232130854784/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:612/0 lens 496/0 e 0 to 0 dl 1788361562 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361551.995076:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a83540380 with x1875232130854784 ext(0->4) 00010000:00010000:0.0:1788361551.995401:0:35986:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 12 pid: 36286 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.995434:0:35986:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 12 pid: 36286 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361551.995443:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8a83540380 00000100:00100000:0.0:1788361551.995527:0:35986:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1788361551.995547:0:35986:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:2349:x1875232130854784:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:0.0:1788361551.996065:0:35986:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130854784:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 528us (2066us total) trans 30064771211 rc 0/0 00000100:00100000:0.0:1788361551.996073:0:35986:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00002000:00100000:0.0:1788361551.996082:0:35986:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0xcd:0x0] (0->4) req@ffff9a8a83540380 x1875232130854784/t30064771211(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:612/0 lens 496/448 e 0 to 0 dl 1788361562 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361551.996130:0:35986:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a83540380 with x1875232130854784 ext(0->4) 00010000:00010000:0.0:1788361551.996137:0:35986:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 14 pid: 36286 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361551.996149:0:35986:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 14 pid: 36286 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361551.996157:0:35986:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a8a83540380 00000100:00100000:2.0:1788361552.002181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.002405:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130854912 00000100:00100000:0.0:1788361552.002415:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130854912 00010000:00010000:0.0:1788361552.002452:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 14 pid: 36286 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.002556:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:0.0:1788361552.002567:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+14:2350:x1875232130854912:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361552.002583:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788361552.002600:0:35332:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:0.0:1788361552.002615:0:35332:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb mtime from disk: 0 -> 1788361552 00002000:00010000:0.0:1788361552.002617:0:35332:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb atime from disk: 0 -> 1788361552 00002000:00010000:0.0:1788361552.002620:0:35332:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcd:0x0] updating lvb ctime from disk: 0 -> 1788361552 00010000:00010000:0.0:1788361552.002627:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 14 pid: 36286 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.002641:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 14 pid: 36286 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.002666:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca96f50a/0xf6a94c97d6616751 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb35 expref: 14 pid: 36286 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.002694:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361552.002699:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361552.002704:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.002715:0:35332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.002776:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361552.002850:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130854912:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 284us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.002859:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00010000:00010000:1.0:1788361552.003151:0:35980:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.003163:0:35980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.003187:0:35980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.003195:0:35980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.003204:0:35980:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.003212:0:35980:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361552.003216:0:35980:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.003224:0:35980:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.003248:0:35980:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.003267:0:35980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000553b6bd0/0xf6a94c97d6616790 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361552.003327:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:2351:x1875232130854656:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 15389us (15793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.003336:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:2.0:1788361552.006450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.006590:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130855168 00000100:00100000:0.0:1788361552.006600:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130855168 00000100:00100000:0.0:1788361552.006701:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:0.0:1788361552.006712:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+58:39676:x1875232130855168:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:0.0:1788361552.006786:0:35348:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x2e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616782 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb4a expref: 58 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361552.007021:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771474 00000001:00080000:0.0:1788361552.007331:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771475 00000001:00080000:0.0:1788361552.012968:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771476 00010000:00010000:0.0:1788361552.013075:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.013139:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb27 expref: 62 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.013149:0:35348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.013191:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb27 expref: 62 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.013766:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb27 expref: 62 pid: 37551 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.013792:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144242944:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361552.014000:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86477540 going to sleep for 11 seconds 00000100:00100000:0.0:1788361552.017151:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144242944:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361552.017178:0:35348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361552.017875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361552.018057:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130855296 00000100:00100000:1.0:1788361552.018064:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130855296 00010000:00010000:1.0:1788361552.018134:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb27 expref: 63 pid: 37551 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361552.018167:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:1.0:1788361552.018178:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+63:2349:x1875232130855296:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361552.018193:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361552.018200:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb27 expref: 63 pid: 37551 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.018213:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb27 expref: 63 pid: 37551 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.018234:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d661673c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb27 expref: 63 pid: 37551 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.018267:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8a827d7900) 00010000:00010000:1.0:1788361552.018273:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.018281:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.018288:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.018317:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361552.018372:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+62:2349:x1875232130855296:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 195us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.018379:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00010000:00010000:2.0:1788361552.018457:0:35348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.018466:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361552.018570:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771477 00000001:00080000:2.0:1788361552.018771:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771478 00000100:00100000:2.0:1788361552.018884:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144243072:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788361552.018932:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361552.018965:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361552.019064:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144243072 00000100:00100000:1.0:1788361552.019070:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144243072 00000100:00080000:2.0:1788361552.019132:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361552.019147:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788361552.019156:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144243072:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788361552.019384:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144243072:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 229us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.019392:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788361552.019445:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144243072:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788361552.020044:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771479 00000100:00100000:2.0:1788361552.020856:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144243200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788361552.021003:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361552.021146:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144243200 00000100:00100000:3.0:1788361552.021154:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144243200 00000100:00100000:2.0:1788361552.021168:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788361552.021195:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788361552.021204:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144243200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788361552.021393:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35348:x1875232144243200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 189us (485us total) trans 30064771212 rc 0/0 00000100:00100000:3.0:1788361552.021411:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788361552.021430:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144243200:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788361552.021488:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771480 00010000:00010000:2.0:1788361552.021599:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.021738:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.021747:0:35348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.021753:0:35348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361552.021757:0:35348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.021765:0:35348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.021781:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8a827d7900) 00010000:00010000:2.0:1788361552.021785:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788361552.021790:0:35348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.021797:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616797 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361552.022413:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x2f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788361552.022592:0:35348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].17, 64 off9496 00000004:00080000:2.0:1788361552.022692:0:35348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 942037605267ns, next at 943037515084ns, rc = 0 00000001:00080000:2.0:1788361552.022702:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771481 00010000:00010000:2.0:1788361552.022744:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8a827d7900) 00010000:00010000:2.0:1788361552.022748:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361552.022756:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616782 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb4a expref: 66 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361552.022873:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+65:39676:x1875232130855168:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 16162us (16432us total) trans 30064771482 rc 0/0 00000100:00100000:2.0:1788361552.022882:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00000020:00080000:2.0:1788361552.022886:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788361552.024752:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361552.025399:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130855424 00000100:00100000:1.0:1788361552.025409:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130855424 00000100:00100000:1.0:1788361552.025462:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 476 00000100:00100000:1.0:1788361552.025473:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+65:39676:x1875232130855424:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361552.025541:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361552.025560:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661679e lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb51 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.025639:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661679e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb51 expref: 66 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.025654:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661679e lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb51 expref: 66 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.025673:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8aa8ee1000) 00010000:00010000:1.0:1788361552.025677:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788361552.025681:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:1.0:1788361552.025793:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+66:39676:x1875232130855424:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 322us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.025800:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 476 00000100:00100000:3.0:1788361552.029699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361552.030135:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130855680 00000100:00100000:2.0:1788361552.030145:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130855680 00000100:00100000:2.0:1788361552.030212:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:2.0:1788361552.030221:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+66:39676:x1875232130855680:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361552.030523:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+67:39676:x1875232130855680:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 302us (832us total) trans 30064771483 rc 0/0 00000100:00100000:2.0:1788361552.030531:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:3.0:1788361552.032355:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144243456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361552.032419:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361552.032572:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144243584:0@lo:400:kworker.0 00000100:00100000:1.0:1788361552.032621:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361552.032633:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144243840:0@lo:400:kworker.0 00000100:00100000:1.0:1788361552.032648:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361552.032656:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144243712:0@lo:400:kworker.0 00000100:00100000:3.0:1788361552.032668:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361552.032700:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144243584 00000100:00100000:3.0:1788361552.032705:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361552.032708:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144243584 00000100:00100000:3.0:1788361552.032711:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144243328:0@lo:400:kworker.0 00000100:00100000:3.0:1788361552.032751:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361552.032752:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144243840 00000100:00100000:1.0:1788361552.032757:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144243840 00000100:00100000:1.0:1788361552.032793:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788361552.032803:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144243584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361552.032804:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144243328 00000100:00100000:3.0:1788361552.032810:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144243328 00000100:00100000:3.0:1788361552.032842:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788361552.032851:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144243328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361552.032858:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144243584:12345-0@lo:400:kworker.0 Request processed in 56us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.032867:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788361552.032903:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788361552.032905:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144243328:12345-0@lo:400:kworker.0 Request processed in 53us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361552.032914:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788361552.032915:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144243840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361552.032944:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361552.032957:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144243840:12345-0@lo:400:kworker.0 Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.032964:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788361552.032977:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144243712 00000100:00100000:3.0:1788361552.032979:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144243584:0@lo:400:kworker.0 00000100:00100000:1.0:1788361552.032982:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144243712 00000100:00100000:3.0:1788361552.033014:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144243328:0@lo:400:kworker.0 00000100:00100000:3.0:1788361552.033024:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144243840:0@lo:400:kworker.0 00000100:00100000:1.0:1788361552.033026:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788361552.033037:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144243712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361552.033078:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144243712:12345-0@lo:400:kworker.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.033120:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788361552.033199:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144243456 00000100:00100000:0.0:1788361552.033203:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144243456 00000100:00100000:0.0:1788361552.033242:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788361552.033250:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144243456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361552.033280:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00080000:2.0:1788361552.033292:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361552.033298:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361552.033323:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144243456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.033331:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788361552.033339:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771273 gen 2 00000004:00080000:2.0:1788361552.033345:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ab71b1f80, transno 30064771272 00000004:00080000:2.0:1788361552.033358:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ab71b0380, transno 30064771273 00000100:00100000:2.0:1788361552.033369:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144243456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361552.033572:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144243712:0@lo:400:kworker.0 00000100:00100000:3.0:1788361552.088592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.088837:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130855808 00000100:00100000:0.0:1788361552.088847:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130855808 00000100:00100000:0.0:1788361552.089048:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 477 00000100:00100000:0.0:1788361552.089059:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+67:39686:x1875232130855808:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1788361552.089187:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66167a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089204:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66167a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089215:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66167a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089244:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089252:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089259:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089357:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089366:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089372:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361552.089413:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089425:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66167a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089432:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66167a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089438:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66167a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089444:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361552.089448:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66167a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089463:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66167a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089474:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:0.0:1788361552.089490:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361552.089495:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66167a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089503:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d66167a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089517:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089522:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089528:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089533:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361552.089536:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089543:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089550:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361552.089553:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361552.089555:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089571:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089587:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089593:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089598:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089614:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361552.089617:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089623:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089631:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8aa8ee1000) 00010000:00010000:0.0:1788361552.089633:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361552.089636:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.089642:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167b3 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.089734:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+67:39686:x1875232130855808:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 676us (1152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.089741:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 477 00000100:00100000:1.0:1788361552.136908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361552.139260:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130856064 00000100:00100000:3.0:1788361552.139557:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130856064 00000100:00100000:3.0:1788361552.139827:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 478 00000100:00100000:3.0:1788361552.139839:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+67:39693:x1875232130856064:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1788361552.139861:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361552.139882:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d66167ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb58 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.139965:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66167c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.139979:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66167c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.139991:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66167c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140006:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d66167c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140013:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d66167c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140019:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d66167c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140161:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140170:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140177:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361552.140195:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:3.0:1788361552.140288:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66167c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140295:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66167c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140302:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66167c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140308:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361552.140312:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66167c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140320:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66167c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140330:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:3.0:1788361552.140333:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361552.140338:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66167c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140343:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66167c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140355:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d66167c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140361:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d66167c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140377:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d66167c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140382:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361552.140385:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d66167c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140392:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d66167c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140399:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff9a8a827d7900) 00010000:00010000:3.0:1788361552.140402:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361552.140405:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d66167c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140411:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d66167c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140446:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d66167ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb58 expref: 70 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140460:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb58 expref: 69 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.140467:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8aa8ee1000) 00010000:00010000:3.0:1788361552.140469:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361552.140471:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388800, rc 0) 00000100:00100000:3.0:1788361552.140542:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+69:39693:x1875232130856064:12345-192.168.203.60@tcp:101:cat.0 Request processed in 704us (3642us total) trans 30064771484 rc 0/0 00000100:00100000:3.0:1788361552.140557:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 478 00000100:00100000:2.0:1788361552.145440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.145591:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130856320 00000100:00100000:0.0:1788361552.145600:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130856320 00000100:00100000:0.0:1788361552.145665:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:0.0:1788361552.145674:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+69:39693:x1875232130856320:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:0.0:1788361552.145960:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+70:39693:x1875232130856320:12345-192.168.203.60@tcp:35:cat.0 Request processed in 287us (527us total) trans 30064771485 rc 0/0 00000100:00100000:0.0:1788361552.145968:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:2.0:1788361552.179234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361552.179394:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130856576 00000100:00100000:1.0:1788361552.179405:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130856576 00000100:00100000:1.0:1788361552.179461:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 479 00000100:00100000:1.0:1788361552.179471:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+70:39699:x1875232130856576:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361552.179495:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361552.179515:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66167dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb5f expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.179627:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.179642:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb58 expref: 71 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.179650:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.179698:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb58 expref: 71 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.179710:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb58 expref: 71 pid: 35346 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361552.179723:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144243968:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361552.179815:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6300 going to sleep for 11 seconds 00000100:00100000:2.0:1788361552.181664:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144243968:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361552.181689:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361552.181793:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361552.181846:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130856704 00000100:00100000:1.0:1788361552.181853:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130856704 00010000:00010000:1.0:1788361552.181884:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb58 expref: 72 pid: 35346 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361552.181915:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:1.0:1788361552.181924:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+72:2350:x1875232130856704:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361552.181938:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361552.181945:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb58 expref: 72 pid: 35346 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.181957:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb58 expref: 72 pid: 35346 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.181978:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66167cf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb58 expref: 72 pid: 35346 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.181992:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8aa8ee1000) 00010000:00010000:1.0:1788361552.182008:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.182016:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.182033:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.182071:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361552.182166:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+71:2350:x1875232130856704:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 242us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.182173:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00010000:00010000:3.0:1788361552.182778:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.182794:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361552.182812:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00010000:00010000:3.0:1788361552.182969:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d66167dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb5f expref: 72 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.182987:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb5f expref: 71 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.182996:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8aa8ee1000) 00010000:00010000:3.0:1788361552.182999:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788361552.183001:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8600, rc 0) 00000100:00100000:3.0:1788361552.183043:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+71:39699:x1875232130856576:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 3574us (3819us total) trans 30064771486 rc 0/0 00000100:00100000:3.0:1788361552.183052:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 479 00000100:00100000:2.0:1788361552.194589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.194782:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130856832 00000100:00100000:0.0:1788361552.194843:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130856832 00000100:00100000:0.0:1788361552.194956:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 480 00000100:00100000:0.0:1788361552.194967:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+71:39700:x1875232130856832:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1788361552.194993:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361552.195013:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb66 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195074:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195114:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195125:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195144:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616800 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195152:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195175:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195321:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195333:0:35347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb5f expref: 72 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195341:0:35347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195398:0:35347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb5f expref: 72 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.195413:0:35347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb5f expref: 72 pid: 37122 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.195426:0:35347:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144244096:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361552.195518:0:35347:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86477240 going to sleep for 11 seconds 00000100:00100000:1.0:1788361552.202663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361552.202741:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130857088 00000100:00100000:2.0:1788361552.202751:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130857088 00000100:00100000:2.0:1788361552.202811:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:2.0:1788361552.202820:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88350850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+73:35786:x1875232130857088:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788361552.203072:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88350850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+74:35786:x1875232130857088:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 252us (418us total) trans 30064771487 rc 0/0 00000100:00100000:2.0:1788361552.203080:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:0.0:1788361552.203367:0:35347:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:35347:1875232144244096:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361552.203388:0:35347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361552.206623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.206724:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130857216 00000100:00100000:0.0:1788361552.206733:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130857216 00010000:00010000:0.0:1788361552.206769:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb5f expref: 74 pid: 37122 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.206872:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:0.0:1788361552.206892:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+74:2349:x1875232130857216:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361552.206909:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361552.206917:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb5f expref: 74 pid: 37122 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.206930:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb5f expref: 74 pid: 37122 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.206952:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8600/0xf6a94c97d66167e4 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb5f expref: 74 pid: 37122 timeout: 1042 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.206969:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8aa8ee1000) 00010000:00010000:0.0:1788361552.206974:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.206984:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.206991:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.207026:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361552.207122:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+73:2349:x1875232130857216:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 203us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.207135:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00010000:00010000:3.0:1788361552.207385:0:35347:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207395:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361552.207439:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x2e:0x0]: returning size 5 00000004:00200000:3.0:1788361552.207444:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361552.207464:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207484:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207494:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207501:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207507:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207513:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361552.207516:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207523:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207532:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:3.0:1788361552.207535:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361552.207539:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207545:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66167f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207557:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207563:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616800 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207575:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616800 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207581:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361552.207584:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616800 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207591:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616800 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207599:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff9a8a890c3800) 00010000:00010000:3.0:1788361552.207611:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361552.207615:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616800 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207621:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616800 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207656:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66167f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb66 expref: 73 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207671:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb66 expref: 72 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.207678:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8aa8ee1000) 00010000:00010000:3.0:1788361552.207680:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361552.207683:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45400, rc 0) 00000100:00100000:3.0:1788361552.207726:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+72:39700:x1875232130856832:12345-192.168.203.60@tcp:101:rm.0 Request processed in 12760us (13144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361552.207749:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 480 00000100:00100000:2.0:1788361552.210639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361552.210721:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130857472 00000100:00100000:3.0:1788361552.210732:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130857472 00000100:00100000:3.0:1788361552.210795:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 481 00000100:00100000:3.0:1788361552.210805:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+72:39700:x1875232130857472:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:3.0:1788361552.210863:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788361552.210891:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616807 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb66 expref: 72 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.210914:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d661679e lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb51 expref: 71 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.210927:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8aa8ee1000) 00010000:00010000:3.0:1788361552.210942:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d661675f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb3c expref: 70 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.210950:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8aa8ee1900) 00010000:00010000:3.0:1788361552.210955:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361552.210977:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661680e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.210989:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661680e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.210997:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661680e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211008:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211027:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211034:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211159:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661681c lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211168:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661681c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211175:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661681c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211553:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211563:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211572:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211579:0:35346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211586:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211591:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211644:0:35346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361552.211665:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661681c lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211671:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661681c lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211677:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661681c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211683:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361552.211687:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661681c lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211695:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661681c lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211704:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:3.0:1788361552.211707:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788361552.211710:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661681c lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211716:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661681c lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211730:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661680e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211736:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661680e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211752:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661680e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211756:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361552.211759:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661680e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211765:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661680e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211773:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7900) 00010000:00010000:3.0:1788361552.211776:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361552.211778:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661680e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.211783:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661680e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361552.211796:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003394b402 reply state 0000000037863101 transno 30064771488 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361552.211804:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361552.211879:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+71:39700:x1875232130857472:12345-192.168.203.60@tcp:36:rm.0 Request processed in 1074us (1250us total) trans 30064771488 rc 0/0 00000100:00100000:3.0:1788361552.211888:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 481 00010000:00010000:1.0:1788361552.212029:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361552.212037:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.212043:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361552.212047:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.212053:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.212064:0:36289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x2e:0x0].0x0 (ffff9a8a827d7400) 00010000:00010000:1.0:1788361552.212066:0:36289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788361552.212069:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.212075:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616823 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.212227:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361552.212229:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361552.212231:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361552.213778:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.213801:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.213808:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.213814:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361552.213818:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.213825:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.213838:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff9a8a827d7e00) 00010000:00010000:0.0:1788361552.213841:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361552.213844:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.213849:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616815 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361552.244654:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361552.244874:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130857600 00000100:00100000:3.0:1788361552.244884:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130857600 00000100:00100000:3.0:1788361552.244940:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 482 00000100:00100000:3.0:1788361552.244948:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+70:39706:x1875232130857600:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361552.244981:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361552.245000:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661682a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb6d expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.245057:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616831 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.245070:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.245081:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361552.245564:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1788361552.245569:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361552.245595:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616831 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.245626:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d661682a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb6d expref: 72 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.245643:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616831 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb6d expref: 71 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.245652:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7900) 00010000:00010000:3.0:1788361552.245655:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361552.245658:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389800, rc 0) 00000100:00100000:3.0:1788361552.245840:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+71:39706:x1875232130857600:12345-192.168.203.60@tcp:101:bash.0 Request processed in 891us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361552.245847:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 482 00000100:00100000:2.0:1788361552.249577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361552.249674:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130857856 00000100:00100000:3.0:1788361552.249726:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130857856 00000100:00100000:3.0:1788361552.249784:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 483 00000100:00100000:3.0:1788361552.249795:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+71:39706:x1875232130857856:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361552.249815:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361552.249818:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788361552.249843:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616831 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb6d expref: 71 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.249860:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7900) 00010000:00010000:3.0:1788361552.249869:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361552.249884:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d6616838 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb74 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.249999:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661683f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250011:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661683f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250021:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661683f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250034:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250040:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250047:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361552.250818:0:35347:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xcd:0x0], index 1: 0 00010000:00010000:3.0:1788361552.250932:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d661684d lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250939:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d661684d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250946:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d661684d lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250969:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661683f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250973:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661683f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250977:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661683f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250981:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361552.250983:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661683f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250987:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661683f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.250992:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361552.250994:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361552.250996:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661683f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.251009:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661683f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361552.251016:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003df47623 reply state 00000000bb22297f transno 30064771489 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361552.251022:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788361552.251041:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d6616838 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb74 expref: 73 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.251052:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d661684d lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb74 expref: 72 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.251057:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff9a8a890fae00) 00010000:00010000:3.0:1788361552.251058:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361552.251060:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389200, rc 0) 00000100:00100000:3.0:1788361552.251286:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+73:39706:x1875232130857856:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1491us (1716us total) trans 30064771489 rc 0/0 00000100:00100000:3.0:1788361552.251293:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 483 00010000:00010000:0.0:1788361552.252549:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.252562:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.252568:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.252574:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361552.252586:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.252594:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.252616:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff9a8a827d7400) 00010000:00010000:0.0:1788361552.252619:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361552.252623:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.252628:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616846 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361552.254481:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361552.254556:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130857984 00000100:00100000:1.0:1788361552.254566:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130857984 00000100:00100000:1.0:1788361552.254648:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:1.0:1788361552.254658:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130857984:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1788361552.254675:0:35983:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361552.254701:0:35983:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d661685b lrc: 2/0,0 mode: --/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb7b expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361552.254726:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xcd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361552.254744:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=942s v=(0 0) 00010000:00010000:1.0:1788361552.254749:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361552.254758:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d661685b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb7b expref: 14 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.254776:0:35983:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d661685b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb7b expref: 14 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788361552.254788:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788361552.254788:0:35983:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:1.0:1788361552.254854:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130857984:12345-192.168.203.60@tcp:101:bash.0 Request processed in 197us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.254861:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:2.0:1788361552.267599:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.267714:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130858112 00000100:00100000:0.0:1788361552.267724:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130858112 00000100:00100000:0.0:1788361552.267782:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:0.0:1788361552.267792:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+14:39706:x1875232130858112:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788361552.267808:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361552.267827:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb82 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.267859:0:35982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d661685b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb7b expref: 15 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.270104:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361552.270116:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361552.270127:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 4/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 15 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.270201:0:35982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d661685b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb7b expref: 15 pid: 35983 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.270218:0:35982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d661685b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb7b expref: 15 pid: 35983 timeout: 1042 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.270235:0:35982:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:35982:1875232144244224:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361552.271262:0:35982:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86477240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361552.275340:0:35982:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:35982:1875232144244224:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361552.275375:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 3/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 15 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.275405:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45400, rc 0) 00000100:00100000:0.0:1788361552.275464:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:39706:x1875232130858112:12345-192.168.203.60@tcp:101:bash.0 Request processed in 7672us (7871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.275472:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:2.0:1788361552.276068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.276483:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130858240 00000100:00100000:0.0:1788361552.276489:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130858240 00010000:00010000:0.0:1788361552.276517:0:38408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d661685b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb7b expref: 15 pid: 35983 timeout: 1042 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.276917:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:0.0:1788361552.276928:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89810c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130858240:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361552.276956:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361552.276978:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d661685b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb7b expref: 15 pid: 35983 timeout: 1042 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.276992:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d661685b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb7b expref: 15 pid: 35983 timeout: 1042 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.277014:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000553b6bd0/0xf6a94c97d661685b lrc: 0/0,0 mode: --/PR res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb7b expref: 15 pid: 35983 timeout: 1042 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.277030:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361552.277034:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361552.277040:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 14 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.277047:0:38408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 14 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.277074:0:38408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 14 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.277082:0:38408:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:38408:1875232144244352:192.168.203.60@tcp:105: 00000100:00100000:0.0:1788361552.277188:0:38408:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86477240 going to sleep for 11 seconds 00000100:00100000:0.0:1788361552.279712:0:38408:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:38408:1875232144244352:192.168.203.60@tcp:105: 00010000:00010000:0.0:1788361552.279737:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361552.280007:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89810c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130858240:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3080us (3938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.280019:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1788361552.280743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361552.281076:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130858496 00000100:00100000:2.0:1788361552.281083:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130858496 00000100:00100000:2.0:1788361552.281912:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:2.0:1788361552.281926:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+72:39706:x1875232130858496:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1788361552.282221:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+73:39706:x1875232130858496:12345-192.168.203.60@tcp:35:bash.0 Request processed in 300us (1480us total) trans 30064771490 rc 0/0 00000100:00100000:2.0:1788361552.282226:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00010000:00010000:3.0:1788361552.288266:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361552.306553:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.306669:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130858624 00000100:00100000:0.0:1788361552.306679:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130858624 00000100:00100000:0.0:1788361552.306806:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 484 00000100:00100000:0.0:1788361552.306817:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+73:39710:x1875232130858624:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361552.306841:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361552.306865:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616869 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb89 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.306927:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616870 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.306940:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.306951:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361552.307008:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1788361552.307012:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361552.307033:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.307056:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb89 expref: 75 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.307074:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb89 expref: 74 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.307130:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361552.307133:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361552.307136:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44800, rc 0) 00000100:00100000:0.0:1788361552.307198:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+74:39710:x1875232130858624:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 383us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.307205:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 484 00000100:00100000:1.0:1788361552.485736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361552.485823:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130858880 00000100:00100000:3.0:1788361552.485833:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130858880 00000100:00100000:3.0:1788361552.485900:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 485 00000100:00100000:3.0:1788361552.485911:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+74:39739:x1875232130858880:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361552.485931:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361552.485951:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d6616877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb90 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.486064:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661687e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.486078:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661687e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.486118:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661687e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361552.486131:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x30:0x0]: returning size 13 00010000:00010000:3.0:1788361552.486259:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d6616877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb90 expref: 77 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.486277:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661687e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb90 expref: 76 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.486286:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff9a8a890fae00) 00010000:00010000:3.0:1788361552.486290:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361552.486293:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388000, rc 0) 00000100:00100000:3.0:1788361552.486355:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+76:39739:x1875232130858880:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 446us (629us total) trans 30064771491 rc 0/0 00000100:00100000:3.0:1788361552.486363:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 485 00000100:00100000:2.0:1788361552.490360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361552.490505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361552.490523:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130859008 00000100:00100000:1.0:1788361552.490535:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130859008 00000100:00100000:3.0:1788361552.490544:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130859264 00000100:00100000:3.0:1788361552.490547:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130859264 00000100:00100000:1.0:1788361552.490584:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1788361552.490593:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+77:2350:x1875232130859008:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361552.490623:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361552.490646:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d661687e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb90 expref: 77 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.490664:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff9a8a890fae00) 00010000:00010000:1.0:1788361552.490669:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361552.490729:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+76:2350:x1875232130859008:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 137us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.490737:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1788361552.490792:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 486 00000100:00100000:3.0:1788361552.490803:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+75:39739:x1875232130859264:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361552.490832:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361552.490851:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661688c lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb97 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.491035:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616893 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.491049:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616893 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.491058:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616893 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361552.491070:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x30:0x0]: returning size 13 00010000:00010000:3.0:1788361552.491225:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d661688c lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb97 expref: 78 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.491355:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616893 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb97 expref: 77 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.491364:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff9a8a890fae00) 00010000:00010000:3.0:1788361552.491367:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788361552.491370:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389e00, rc 0) 00000100:00100000:3.0:1788361552.491410:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+77:39739:x1875232130859264:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 610us (905us total) trans 30064771492 rc 0/0 00000100:00100000:3.0:1788361552.491416:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 486 00000100:00100000:2.0:1788361552.493697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.493982:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130859392 00000100:00100000:0.0:1788361552.493991:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130859392 00000100:00100000:0.0:1788361552.494049:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1788361552.494059:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+77:39739:x1875232130859392:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:0.0:1788361552.494077:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361552.494126:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616893 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb97 expref: 77 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.494146:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff9a8a890fae00) 00010000:00010000:0.0:1788361552.494150:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361552.494219:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+76:39739:x1875232130859392:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 161us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.494227:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:1.0:1788361552.497783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361552.497940:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130859648 00000100:00100000:3.0:1788361552.497949:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130859648 00000100:00100000:3.0:1788361552.497991:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:3.0:1788361552.497998:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+76:39739:x1875232130859648:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361552.498323:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+77:39739:x1875232130859648:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 323us (546us total) trans 30064771493 rc 0/0 00000100:00100000:3.0:1788361552.498330:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:1.0:1788361552.500458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361552.500570:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130859904 00000100:00100000:2.0:1788361552.500579:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130859904 00000100:00100000:2.0:1788361552.500642:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:2.0:1788361552.500651:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+77:39739:x1875232130859904:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361552.500875:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+78:39739:x1875232130859904:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 224us (424us total) trans 30064771494 rc 0/0 00000100:00100000:2.0:1788361552.500882:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:0.0:1788361552.546973:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361552.546997:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144244480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361552.547066:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361552.548425:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144244480 00000100:00100000:1.0:1788361552.548440:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144244480 00000100:00100000:1.0:1788361552.548580:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788361552.548592:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144244480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361552.548639:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 219742208 pending 1703936 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361552.548730:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144244480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.548737:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788361552.548836:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83540e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144244480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361552.553335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.553551:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130860160 00000100:00100000:0.0:1788361552.553561:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130860160 00000100:00100000:0.0:1788361552.553624:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 487 00000100:00100000:0.0:1788361552.553646:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+78:39746:x1875232130860160:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:0.0:1788361552.553700:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788361552.553723:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d661684d lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb74 expref: 78 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.553742:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff9a8a890fae00) 00010000:00010000:0.0:1788361552.553755:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616870 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb89 expref: 77 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.553764:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361552.553770:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361552.554196:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66168a1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554210:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66168a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554219:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66168a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554230:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554236:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554246:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554346:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168af lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554360:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168af lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554366:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168af lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788361552.554868:0:37551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].17, 64 off9568 00000004:00080000:0.0:1788361552.554878:0:37551:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 942569791123ns, next at 943569788894ns, rc = 0 00010000:00010000:0.0:1788361552.554934:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554944:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554951:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554958:0:37551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554964:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554970:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.554984:0:37551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361552.555003:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168af lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555008:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168af lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555022:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168af lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555027:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361552.555031:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168af lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555037:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168af lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555049:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361552.555051:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788361552.555055:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168af lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555061:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168af lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x30:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555077:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66168a1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555082:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66168a1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555128:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66168a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555132:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361552.555135:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66168a1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555151:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66168a1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555159:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3400) 00010000:00010000:0.0:1788361552.555162:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361552.555165:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66168a1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.555170:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d66168a1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788361552.555187:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ab9ee68 reply state 00000000c6c6b4dc transno 30064771495 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.555196:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788361552.555281:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+78:39746:x1875232130860160:12345-192.168.203.60@tcp:36:rm.0 Request processed in 1634us (1952us total) trans 30064771495 rc 0/0 00000100:00100000:0.0:1788361552.555290:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 487 00010000:00010000:1.0:1788361552.555657:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361552.555664:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.555678:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030000 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361552.555682:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.555688:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.555698:0:35335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x30:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:1.0:1788361552.555700:0:35335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788361552.555703:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.555709:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d66168b6 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x30:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.555723:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361552.555725:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361552.555727:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361552.556929:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.556941:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.556947:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.556952:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361552.556956:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.556976:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.556988:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff9a8a890c3200) 00010000:00010000:0.0:1788361552.556990:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361552.556993:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.556999:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d66168a8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361552.595005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361552.595198:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130860288 00000100:00100000:3.0:1788361552.595208:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130860288 00000100:00100000:3.0:1788361552.595369:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 488 00000100:00100000:3.0:1788361552.595380:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+77:39752:x1875232130860288:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361552.595403:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361552.595422:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66168bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fb9e expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.595487:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66168c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.595500:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66168c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.595523:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66168c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361552.595578:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:3.0:1788361552.595583:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361552.595616:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66168c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.595639:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66168bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb9e expref: 79 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.595657:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66168c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb9e expref: 78 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.595679:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:3.0:1788361552.595682:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361552.595685:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388a00, rc 0) 00000100:00100000:3.0:1788361552.595749:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+78:39752:x1875232130860288:12345-192.168.203.60@tcp:101:bash.0 Request processed in 371us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361552.595756:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 488 00000100:00100000:1.0:1788361552.597890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361552.597956:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130860544 00000100:00100000:3.0:1788361552.597965:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130860544 00000100:00100000:3.0:1788361552.598020:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 489 00000100:00100000:3.0:1788361552.598029:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+78:39752:x1875232130860544:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361552.598050:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361552.598053:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788361552.598077:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66168c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb9e expref: 78 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.598121:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:3.0:1788361552.598130:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361552.598146:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d66168cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fba5 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.598284:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66168d2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.598298:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66168d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.598313:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66168d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.598343:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.598352:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.598358:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361552.598812:0:35347:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xce:0x0], index 0: 0 00010000:00010000:3.0:1788361552.598964:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d66168e0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.598974:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d66168e0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.598981:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d66168e0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.599012:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66168d2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.599019:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66168d2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.599026:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66168d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.599031:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361552.599036:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66168d2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.599056:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66168d2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.599066:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fae00) 00010000:00010000:3.0:1788361552.599069:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361552.599073:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66168d2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.599079:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d66168d2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361552.599221:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000aab2cb8d reply state 000000007007e758 transno 30064771496 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361552.599230:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788361552.599259:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d66168cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fba5 expref: 80 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.599277:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d66168e0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fba5 expref: 79 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.599284:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361552.599286:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361552.599289:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389600, rc 0) 00000100:00100000:3.0:1788361552.599368:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+80:39752:x1875232130860544:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1339us (1484us total) trans 30064771496 rc 0/0 00000100:00100000:3.0:1788361552.599377:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 489 00010000:00010000:0.0:1788361552.601073:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.601223:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.601231:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.601238:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361552.601242:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.601249:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.601264:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff9a8a827d7400) 00010000:00010000:0.0:1788361552.601267:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361552.601271:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.601288:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d66168d9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361552.602664:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.603369:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130860672 00000100:00100000:0.0:1788361552.603382:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130860672 00000100:00100000:0.0:1788361552.603443:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 146 00000100:00100000:0.0:1788361552.603454:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130860672:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1788361552.603472:0:36286:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361552.603491:0:36286:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e860d59f/0xf6a94c97d66168ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbac expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788361552.603515:0:36286:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788361552.603535:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=942s v=(0 0) 00010000:00010000:0.0:1788361552.603540:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361552.603550:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e860d59f/0xf6a94c97d66168ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbac expref: 13 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.603568:0:36286:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e860d59f/0xf6a94c97d66168ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbac expref: 13 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.603580:0:36286:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80030200, rc 0) 00000100:00100000:0.0:1788361552.603651:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130860672:12345-192.168.203.60@tcp:101:bash.0 Request processed in 199us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.603659:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 146 00000100:00100000:1.0:1788361552.606521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361552.606621:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130860800 00000100:00100000:2.0:1788361552.606631:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130860800 00000100:00100000:2.0:1788361552.606690:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:2.0:1788361552.606701:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:39752:x1875232130860800:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1788361552.606721:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361552.606738:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbb3 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.606782:0:35980:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e860d59f/0xf6a94c97d66168ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbac expref: 14 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.606791:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361552.606795:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361552.606801:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 14 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.606837:0:35980:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e860d59f/0xf6a94c97d66168ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbac expref: 14 pid: 36286 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.606851:0:35980:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e860d59f/0xf6a94c97d66168ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbac expref: 14 pid: 36286 timeout: 1042 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361552.606865:0:35980:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1564700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35980:1875232144244608:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361552.606950:0:35980:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a883c7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361552.610731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.610821:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130860928 00000100:00100000:0.0:1788361552.610848:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130860928 00010000:00010000:0.0:1788361552.610886:0:38408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e860d59f/0xf6a94c97d66168ee lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbac expref: 15 pid: 36286 timeout: 1042 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.610929:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:0.0:1788361552.610941:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130860928:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361552.610962:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361552.610985:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e860d59f/0xf6a94c97d66168ee lrc: 5/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbac expref: 15 pid: 36286 timeout: 1042 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.611001:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e860d59f/0xf6a94c97d66168ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbac expref: 15 pid: 36286 timeout: 1042 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.611027:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361552.611032:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361552.611040:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 15 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.611050:0:38408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 15 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.611125:0:38408:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 15 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361552.611140:0:38408:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:38408:1875232144244736:192.168.203.60@tcp:105: 00000100:00100000:0.0:1788361552.611212:0:38408:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a86477540 going to sleep for 11 seconds 00010000:00010000:1.0:1788361552.611382:0:35980:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e860d59f/0xf6a94c97d66168ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbac expref: 15 pid: 36286 timeout: 1042 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361552.611398:0:35980:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1564700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:35980:1875232144244608:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361552.611425:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 14 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.611448:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903000, rc 0) 00000100:00100000:1.0:1788361552.611480:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:39752:x1875232130860800:12345-192.168.203.60@tcp:101:bash.0 Request processed in 4781us (4968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.611489:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:0.0:1788361552.616591:0:38408:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:38408:1875232144244736:192.168.203.60@tcp:105: 00010000:00010000:0.0:1788361552.616626:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361552.616686:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130860928:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 5747us (5965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.616696:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:3.0:1788361552.622426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361552.622525:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130861184 00000100:00100000:2.0:1788361552.622546:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130861184 00000100:00100000:2.0:1788361552.622618:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:2.0:1788361552.622629:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+79:39752:x1875232130861184:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1788361552.622973:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+80:39752:x1875232130861184:12345-192.168.203.60@tcp:35:bash.0 Request processed in 344us (556us total) trans 30064771497 rc 0/0 00000100:00100000:2.0:1788361552.622981:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:2.0:1788361552.647225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.647306:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130861312 00000100:00100000:0.0:1788361552.647315:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130861312 00000100:00100000:0.0:1788361552.647373:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 490 00000100:00100000:0.0:1788361552.647382:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+80:39755:x1875232130861312:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361552.647405:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361552.647426:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbba expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.647491:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616903 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.647504:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.647515:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361552.647570:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1788361552.647575:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361552.647608:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616903 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.647629:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d66168fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbba expref: 82 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.647770:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616903 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbba expref: 81 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.647779:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361552.647782:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361552.647785:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80030000, rc 0) 00000100:00100000:0.0:1788361552.647848:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+81:39755:x1875232130861312:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 466us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361552.647856:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 490 00000100:00100000:1.0:1788361552.794280:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361552.795111:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130861568 00000100:00100000:3.0:1788361552.795123:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130861568 00000100:00100000:3.0:1788361552.795185:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 491 00000100:00100000:3.0:1788361552.795195:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+81:39777:x1875232130861568:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361552.795216:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361552.795234:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d661690a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbc1 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.795326:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616911 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.795337:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616911 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.795345:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616911 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361552.795352:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x31:0x0]: returning size 20 00010000:00010000:3.0:1788361552.795456:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d661690a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbc1 expref: 84 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.795474:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616911 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbc1 expref: 83 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361552.795482:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361552.795484:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361552.795488:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388200, rc 0) 00000100:00100000:3.0:1788361552.795731:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+83:39777:x1875232130861568:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 537us (1460us total) trans 30064771498 rc 0/0 00000100:00100000:3.0:1788361552.795747:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 491 00000100:00100000:3.0:1788361552.797659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361552.797878:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130861696 00000100:00100000:1.0:1788361552.797887:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130861696 00000100:00100000:1.0:1788361552.797953:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1788361552.797962:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+83:2350:x1875232130861696:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361552.797979:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361552.798002:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616911 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbc1 expref: 83 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.798020:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:1.0:1788361552.798024:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361552.798114:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+82:2350:x1875232130861696:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 122us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361552.798123:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1788361552.798420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.798521:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130861952 00000100:00100000:0.0:1788361552.798626:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130861952 00000100:00100000:0.0:1788361552.798668:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 492 00000100:00100000:0.0:1788361552.798676:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+82:39777:x1875232130861952:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361552.798695:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361552.798710:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661691f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbc8 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.798793:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616926 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.798806:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616926 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.798816:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616926 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361552.798827:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x31:0x0]: returning size 20 00010000:00010000:0.0:1788361552.798952:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d661691f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbc8 expref: 85 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.798968:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616926 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbc8 expref: 84 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.798975:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:0.0:1788361552.798978:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788361552.798980:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45200, rc 0) 00000100:00100000:0.0:1788361552.799017:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+84:39777:x1875232130861952:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 341us (597us total) trans 30064771499 rc 0/0 00000100:00100000:0.0:1788361552.799023:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 492 00000100:00100000:3.0:1788361552.811802:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.811898:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130862080 00000100:00100000:0.0:1788361552.811908:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130862080 00000100:00100000:2.0:1788361552.812637:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:2.0:1788361552.812654:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+84:39777:x1875232130862080:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:2.0:1788361552.812728:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361552.812756:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616926 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbc8 expref: 84 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361552.812784:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:2.0:1788361552.812790:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361552.812851:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+83:39777:x1875232130862080:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 203us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361552.812859:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:3.0:1788361552.816770:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361552.816901:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130862336 00000100:00100000:2.0:1788361552.816912:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130862336 00000100:00100000:2.0:1788361552.816972:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:2.0:1788361552.816982:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+83:39777:x1875232130862336:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361552.821062:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+84:39777:x1875232130862336:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 4072us (4291us total) trans 30064771500 rc 0/0 00000100:00100000:2.0:1788361552.821076:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:1.0:1788361552.825431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.825521:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130862592 00000100:00100000:0.0:1788361552.825531:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130862592 00000100:00100000:0.0:1788361552.825592:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1788361552.825612:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88352450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+84:39777:x1875232130862592:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361552.825864:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88352450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+85:39777:x1875232130862592:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 262us (438us total) trans 30064771501 rc 0/0 00000100:00100000:0.0:1788361552.825872:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:1.0:1788361552.845286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361552.845522:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130862848 00000100:00100000:0.0:1788361552.845532:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130862848 00000100:00100000:0.0:1788361552.845595:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 493 00000100:00100000:0.0:1788361552.845613:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+85:39778:x1875232130862848:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:0.0:1788361552.845671:0:37551:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788361552.845697:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d66168e0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fba5 expref: 85 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.845727:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:0.0:1788361552.845744:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616903 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbba expref: 84 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.845753:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3e00) 00010000:00010000:0.0:1788361552.845759:0:37551:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361552.845782:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616934 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.845792:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.845801:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.845825:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.845832:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.845838:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.845946:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616942 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.845954:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616942 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.845970:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616942 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361552.846780:0:37551:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].18, 64 off9560 00010000:00010000:1.0:1788361552.846892:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.846901:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.846916:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.846924:0:37551:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.846930:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.846936:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.846953:0:37551:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788361552.846976:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361552.846981:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.846987:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361552.846990:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.846997:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847007:0:36289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:1.0:1788361552.847009:0:36289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788361552.847013:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847018:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616949 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847039:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361552.847041:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361552.847043:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361552.847057:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616942 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847062:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616942 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847068:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616942 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847073:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361552.847076:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616942 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847081:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616942 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847111:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x31:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:1.0:1788361552.847113:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788361552.847116:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616942 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847122:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616942 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847148:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616934 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847154:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616934 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847244:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616934 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847249:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361552.847252:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616934 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847259:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616934 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847267:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890c3500) 00010000:00010000:1.0:1788361552.847271:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361552.847274:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616934 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361552.847279:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616934 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361552.847293:0:37551:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000048ac1d1b reply state 000000003adde821 transno 30064771502 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361552.847302:0:37551:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361552.847383:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+85:39778:x1875232130862848:12345-192.168.203.60@tcp:36:rm.0 Request processed in 1770us (2103us total) trans 30064771502 rc 0/0 00000100:00100000:1.0:1788361552.847392:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 493 00010000:00010000:0.0:1788361552.849803:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.849829:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.849835:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.849840:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b44800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361552.849844:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.849850:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.849865:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb89e5df3 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361552.849868:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361552.849871:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361552.849876:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d661693b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb89e5df3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361553.315329:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361554.060834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361554.060879:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361554.060895:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130862976 00000100:00100000:3.0:1788361554.060905:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130862976 00000100:00100000:3.0:1788361554.060965:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:1.0:1788361554.060974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361554.060978:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130862976:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361554.061016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361554.061043:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130862976:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 68us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361554.061051:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:1.0:1788361554.061162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361554.061231:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130863488 00000100:00100000:2.0:1788361554.061236:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130863488 00000100:00100000:2.0:1788361554.061271:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130863104 00000100:00100000:2.0:1788361554.061274:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130863104 00000100:00100000:2.0:1788361554.061298:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:2.0:1788361554.061305:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130863488:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361554.061456:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130863232 00000100:00100000:0.0:1788361554.061461:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130863232 00000100:00100000:3.0:1788361554.061486:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:3.0:1788361554.061497:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+84:2352:x1875232130863104:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361554.061514:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130863360 00000100:00100000:0.0:1788361554.061520:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130863360 00000100:00100000:0.0:1788361554.061551:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:0.0:1788361554.061559:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130863232:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361554.061670:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:1.0:1788361554.061679:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2352:x1875232130863360:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361554.061847:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+84:2352:x1875232130863104:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 352us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361554.061853:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130863232:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 292us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361554.061861:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:3.0:1788361554.061871:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00080000:0.0:1788361554.061884:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361554.061889:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361554.061891:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361554.064070:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130863488:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 2757us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361554.064101:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788361554.065660:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2352:x1875232130863360:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 3977us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361554.065671:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00010000:00010000:1.0:1788361554.337206:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788361555.147241:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771211 is committed 00000001:00080000:3.0:1788361555.147260:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771212 is committed 00010000:00010000:3.0:1788361555.361035:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361555.527246:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361555.527523:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130863616 00000100:00100000:0.0:1788361555.527533:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130863616 00000100:00100000:0.0:1788361555.527597:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 494 00000100:00100000:0.0:1788361555.527609:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+84:40199:x1875232130863616:12345-192.168.203.60@tcp:101:lctl.0 00010000:00010000:0.0:1788361555.527629:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361555.527654:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbcf expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361555.527721:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616957 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361555.527735:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361555.527747:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361555.527810:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:0.0:1788361555.527814:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361555.527843:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616957 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361555.527876:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbcf expref: 86 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361555.527891:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616957 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbcf expref: 85 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361555.527900:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:0.0:1788361555.527902:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788361555.527906:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44a00, rc 0) 00000100:00100000:0.0:1788361555.527958:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+85:40199:x1875232130863616:12345-192.168.203.60@tcp:101:lctl.0 Request processed in 353us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361555.527965:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 494 00000100:00100000:3.0:1788361555.579302:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361555.579984:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130863744 00000100:00100000:0.0:1788361555.579994:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130863744 00000100:00100000:0.0:1788361555.580051:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 495 00000100:00100000:0.0:1788361555.580059:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+85:39636:x1875232130863744:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788361555.580193:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+85:39636:x1875232130863744:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 134us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361555.580200:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 495 00000100:00100000:3.0:1788361555.582195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361555.582513:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130864000 00000100:00100000:0.0:1788361555.582521:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130864000 00000100:00100000:0.0:1788361555.582571:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:0.0:1788361555.582588:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+85:39636:x1875232130864000:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788361555.584627:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+86:39636:x1875232130864000:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 2040us (2430us total) trans 30064771503 rc 0/0 00000100:00100000:0.0:1788361555.584649:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:1.0:1788361555.749182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361555.749279:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130864128 00000100:00100000:2.0:1788361555.749289:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130864128 00000100:00100000:2.0:1788361555.749347:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 496 00000100:00100000:2.0:1788361555.749356:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:40217:x1875232130864128:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:2.0:1788361555.749374:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361555.749392:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d661695e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbd6 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361555.749446:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361555.749459:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361555.749470:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361555.749531:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1788361555.749534:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 20 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361555.749559:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361555.749592:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d661695e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbd6 expref: 7 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361555.749609:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbd6 expref: 6 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361555.749618:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:2.0:1788361555.749620:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361555.749624:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903800, rc 0) 00000100:00100000:2.0:1788361555.749720:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:40217:x1875232130864128:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 363us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361555.749729:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 496 00010000:00010000:3.0:1788361556.384314:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788361556.708502:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771503 is committed 00000004:00080000:0.0:1788361556.708524:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000004:00080000:0.0:1788361556.708584:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000020:00080000:0.0:1788361556.708608:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a856f0300 refcount 2 committed 0 result 0 batchid 25769803905 00000020:00080000:0.0:1788361556.708613:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8aa8fd6700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a8bbb9a80 00000020:00080000:0.0:1788361556.708616:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8aa8fd6300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8986b12800 00000100:00100000:0.0:1788361556.708981:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144244864:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788361556.709044:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361556.709128:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361556.709135:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144244992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788361556.709158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361556.709228:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144244864 00000100:00100000:3.0:1788361556.709237:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144244864 00000100:00100000:3.0:1788361556.709287:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144244992 00000100:00100000:3.0:1788361556.709291:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144244992 00000100:00100000:3.0:1788361556.709313:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788361556.709322:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144244864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788361556.709346:0:35982:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:205 count 1 00002000:00010000:3.0:1788361556.709375:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcd:0x0] initial LVB size: 5, mtime: 0x6a983b50, atime: 0x6a983b50, ctime: 0x6a983b50, blocks: 0xb 00010000:00010000:3.0:1788361556.709383:0:35982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b009785/0xf6a94c97d661696c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.709398:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=946s v=(0 0) 00010000:00010000:3.0:1788361556.709403:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361556.709409:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b009785/0xf6a94c97d661696c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.709422:0:35982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b009785/0xf6a94c97d661696c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.709436:0:35982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b009785/0xf6a94c97d661696c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.709444:0:35982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b009785/0xf6a94c97d661696c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.709463:0:35982:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1788361556.709470:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803905 committed batchid 25769803904 00000020:00080000:1.0:1788361556.709698:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803904 00000100:00100000:1.0:1788361556.709719:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788361556.709729:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144244992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788361556.709744:0:35983:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:205 count 1 00010000:00010000:1.0:1788361556.709759:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709775:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 13 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709784:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xcd:0x0].0x0 since=4s v=(0 0) 00010000:00010000:1.0:1788361556.709787:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361556.709792:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709821:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 13 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709848:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 13 pid: 35982 timeout: 1046 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361556.709860:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144245120:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361556.709918:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a857a7a80 going to sleep for 11 seconds 00010000:00010000:1.0:1788361556.709933:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361556.709939:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b009785/0xf6a94c97d661696c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709945:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388800 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361556.709949:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b009785/0xf6a94c97d661696c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709956:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b009785/0xf6a94c97d661696c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709970:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b009785/0xf6a94c97d661696c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709978:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b009785/0xf6a94c97d661696c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361556.709997:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361556.710000:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361556.710002:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361556.713874:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144244864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4543us (4821us total) trans 30064771213 rc 0/0 00000100:00100000:3.0:1788361556.713887:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788361556.714832:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361556.714839:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361556.714947:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771212 gen 2 00000004:00080000:1.0:1788361556.714955:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771212 committed transno 30064771212 00000100:00100000:1.0:1788361556.714978:0:3313:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a898b123b80 x1875232144244864/t30064771213(30064771213) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788361572 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788361556.714990:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a898b123b80/2, rc 0, transno 30064771213 00000100:00100000:1.0:1788361556.715003:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b123b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144244864:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788361556.716308:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361556.716379:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130864256 00000100:00100000:0.0:1788361556.716387:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130864256 00010000:00010000:0.0:1788361556.716444:0:38408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 14 pid: 35982 timeout: 1046 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361556.716494:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:0.0:1788361556.716511:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130864256:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361556.716526:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361556.716532:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 14 pid: 35982 timeout: 1046 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361556.716564:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 14 pid: 35982 timeout: 1046 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361556.716600:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361556.716604:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xcd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788361556.716609:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361556.716619:0:38408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361556.716638:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361556.716698:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130864256:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 188us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361556.716705:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00080000:1.0:1788361556.716826:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788361556.717265:0:35983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca96f50a/0xf6a94c97d6616862 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fb82 expref: 13 pid: 35982 timeout: 1046 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361556.717282:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144245120:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361556.717301:0:35983:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.717311:0:35983:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.717317:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.717326:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.717333:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361556.717412:0:35983:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788361556.717612:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788361556.717619:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.717626:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:3.0:1788361556.717630:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.717639:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.717664:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.717672:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7977ad2/0xf6a94c97d6616973 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xcd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361556.717688:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361556.717689:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361556.717691:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361556.718336:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144244992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8608us (9175us total) trans 30064771280 rc 0/0 00000100:00100000:2.0:1788361556.718347:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000004:00080000:1.0:1788361556.718374:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8ac1566680/2, rc 0, transno 30064771280 00000100:00100000:1.0:1788361556.718381:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144244992:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788361557.152519:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144245376:0@lo:400:kworker.0 00000100:00100000:1.0:1788361557.152606:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361557.152629:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144245248:0@lo:400:kworker.0 00000100:00100000:1.0:1788361557.152663:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144245888:0@lo:400:kworker.0 00000100:00100000:3.0:1788361557.152683:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361557.152704:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361557.152715:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144245760:0@lo:400:kworker.0 00000100:00100000:1.0:1788361557.152745:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144245632:0@lo:400:kworker.0 00000100:00100000:3.0:1788361557.152755:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361557.152779:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361557.152799:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144245248 00000100:00100000:3.0:1788361557.152807:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144245248 00000100:00100000:1.0:1788361557.152807:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361557.152815:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144245504:0@lo:400:kworker.0 00000100:00100000:3.0:1788361557.152854:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788361557.152859:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361557.152867:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144245248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361557.152895:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144245376 00000100:00100000:1.0:1788361557.152900:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144245376 00000100:00100000:3.0:1788361557.152920:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144245248:12345-0@lo:400:kworker.0 Request processed in 55us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361557.152929:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788361557.152933:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144245504 00000100:00100000:1.0:1788361557.152937:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144245504 00000100:00100000:1.0:1788361557.152960:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788361557.152967:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144245888 00000100:00100000:1.0:1788361557.152968:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144245376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361557.152973:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144245888 00000100:00100000:3.0:1788361557.153014:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144245760 00000100:00100000:1.0:1788361557.153015:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88447450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144245376:12345-0@lo:400:kworker.0 Request processed in 47us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361557.153018:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144245760 00000100:00100000:1.0:1788361557.153031:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788361557.153041:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144245632 00000100:00100000:3.0:1788361557.153045:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144245632 00000100:00100000:3.0:1788361557.153063:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788361557.153070:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144245888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361557.153149:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144245888:12345-0@lo:400:kworker.0 Request processed in 80us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361557.153156:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788361557.153175:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788361557.153184:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144245760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361557.153215:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788361557.153220:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144245760:12345-0@lo:400:kworker.0 Request processed in 36us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361557.153228:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144245504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361557.153233:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788361557.153249:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788361557.153258:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144245632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361557.153395:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144245504:12345-0@lo:400:kworker.0 Request processed in 171us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361557.153403:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788361557.154671:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144245504:0@lo:400:kworker.0 00000100:00100000:3.0:1788361557.154722:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144245632:12345-0@lo:400:kworker.0 Request processed in 1465us (1943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361557.154731:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1788361557.154774:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361557.154795:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144245248:0@lo:400:kworker.0 00000100:00100000:3.0:1788361557.154807:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144245760:0@lo:400:kworker.0 00000100:00100000:3.0:1788361557.154880:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144245376:0@lo:400:kworker.0 00000100:00100000:3.0:1788361557.154890:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144245888:0@lo:400:kworker.0 00000100:00100000:1.0:1788361557.155264:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144245632:0@lo:400:kworker.0 00000100:00100000:0.0:1788361557.156683:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361557.156699:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144246016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361557.156751:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361557.156789:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144246016 00000100:00100000:0.0:1788361557.156795:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144246016 00000100:00100000:0.0:1788361557.156834:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788361557.156841:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144246016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361557.156873:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361557.156907:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144246016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361557.156924:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788361557.156960:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144246016:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788361557.410533:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788361557.584251:0:39801:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 12: RW-PCC attach races with concurrent HSM remove ========================================================== 11:05:57 (1788361557) 00000004:00080000:2.0:1788361557.666197:0:35368:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 947681108911ns, next at 948681106853ns, rc = 0 00000100:00100000:2.0:1788361557.666227:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144246144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361557.666289:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361557.670693:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144246144 00000100:00100000:1.0:1788361557.670703:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144246144 00000100:00100000:1.0:1788361557.670751:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361557.670759:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144246144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361557.670797:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361557.670873:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144246144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (4584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361557.670880:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788361557.671287:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144246144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361557.714193:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361557.714258:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130864512 00000100:00100000:3.0:1788361557.714269:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130864512 00000100:00100000:3.0:1788361557.714478:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 497 00000100:00080000:1.0:1788361557.714484:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361557.714496:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+51:40413:x1875232130864512:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361557.714522:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361557.714542:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d661697a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbdd expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.714636:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616981 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.714650:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616981 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.714662:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616981 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.714677:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616988 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.714685:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.714692:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.715167:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d661698f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.715177:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d661698f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.715184:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d661698f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361557.715194:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788361557.715439:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616981 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715448:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616981 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715454:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616981 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715460:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361557.715464:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616981 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715472:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616981 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715484:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:2.0:1788361557.715487:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361557.715492:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616981 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715497:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d6616981 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715508:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616988 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715515:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616988 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715521:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616988 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715531:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361557.715534:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616988 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715540:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616988 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715547:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a827d7400) 00010000:00010000:2.0:1788361557.715549:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361557.715552:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616988 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715557:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616988 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715899:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d661697a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbdd expref: 54 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715914:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d661698f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbdd expref: 53 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.715922:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361557.715924:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361557.715926:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388400, rc 0) 00000100:00100000:2.0:1788361557.715986:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+53:40413:x1875232130864512:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1499us (1802us total) trans 30064771504 rc 0/0 00000100:00100000:2.0:1788361557.715994:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 497 00000100:00100000:0.0:1788361557.718824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361557.718864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361557.718915:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130864768 00000100:00100000:3.0:1788361557.718925:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130864768 00000100:00100000:3.0:1788361557.718985:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 498 00000100:00100000:3.0:1788361557.718995:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+53:40413:x1875232130864768:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788361557.719132:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+53:40413:x1875232130864768:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 138us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361557.719141:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 498 00000100:00100000:2.0:1788361557.719255:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130864640 00000100:00100000:2.0:1788361557.719260:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130864640 00000100:00100000:2.0:1788361557.719300:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:2.0:1788361557.719308:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89810c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+53:2351:x1875232130864640:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361557.719318:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361557.719340:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388400/0xf6a94c97d661698f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbdd expref: 53 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.719358:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361557.719363:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361557.719396:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89810c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+52:2351:x1875232130864640:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 89us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361557.719404:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1788361557.770401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361557.770501:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130865024 00000100:00100000:3.0:1788361557.770510:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130865024 00000100:00100000:3.0:1788361557.770576:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 499 00000100:00100000:3.0:1788361557.770586:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+52:40246:x1875232130865024:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361557.770610:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361557.770614:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788361557.770641:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616957 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbcf expref: 52 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.770664:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:3.0:1788361557.770669:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361557.770691:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388c00/0xf6a94c97d661699d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbe4 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.771002:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.771016:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbd6 expref: 5 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.771025:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.771056:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbd6 expref: 5 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.771069:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbd6 expref: 5 pid: 37122 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361557.771082:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b121180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144246272:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361557.771708:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788361557.773116:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b121180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144246272:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361557.773140:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361557.773947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361557.774011:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130865152 00000100:00100000:2.0:1788361557.774019:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130865152 00010000:00010000:2.0:1788361557.774135:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbd6 expref: 6 pid: 37122 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361557.774175:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:2.0:1788361557.774184:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+6:2350:x1875232130865152:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361557.774197:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361557.774204:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbd6 expref: 6 pid: 37122 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.774217:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbd6 expref: 6 pid: 37122 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.774236:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616965 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbd6 expref: 6 pid: 37122 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.774251:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:2.0:1788361557.774258:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.774275:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.774283:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.774312:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361557.774359:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130865152:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 175us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361557.774366:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00010000:00010000:3.0:1788361557.774502:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.774510:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.774541:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.774599:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.774609:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788361557.774734:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788361557.775962:0:35346:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xce:0x0], index 1: 0 00010000:00010000:3.0:1788361557.776559:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776586:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776597:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776633:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776642:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776648:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776655:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361557.776658:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776670:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776679:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8984a32300) 00010000:00010000:3.0:1788361557.776681:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361557.776684:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776688:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169a4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361557.776695:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cbe466c1 reply state 000000000384287a transno 30064771505 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361557.776701:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788361557.776727:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388c00/0xf6a94c97d661699d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbe4 expref: 54 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776746:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbe4 expref: 53 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.776751:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361557.776752:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361557.776754:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389000, rc 0) 00000100:00100000:3.0:1788361557.776809:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:40246:x1875232130865024:12345-192.168.203.60@tcp:101:bash.0 Request processed in 6225us (6417us total) trans 30064771505 rc 0/0 00000100:00100000:3.0:1788361557.776814:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 499 00000100:00100000:0.0:1788361557.779417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361557.779491:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130865280 00000100:00100000:3.0:1788361557.779501:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130865280 00000100:00100000:3.0:1788361557.779555:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 150 00000100:00100000:3.0:1788361557.779577:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:40246:x1875232130865280:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1788361557.779594:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361557.779613:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbeb expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.779629:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361557.779639:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788361557.779640:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.779662:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.779669:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361557.779673:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.779682:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.779697:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff9a8a827d7400) 00010000:00010000:1.0:1788361557.779700:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361557.779705:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.779712:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388600/0xf6a94c97d66169ab lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.779803:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=947s v=(0 0) 00010000:00010000:3.0:1788361557.779818:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361557.779828:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 14 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.779993:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 14 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.780006:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388400, rc 0) 00000100:00100000:3.0:1788361557.780053:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+14:40246:x1875232130865280:12345-192.168.203.60@tcp:101:bash.0 Request processed in 488us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361557.780058:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 150 00000100:00100000:1.0:1788361557.785572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361557.785643:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130865536 00000100:00100000:2.0:1788361557.785650:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130865536 00000100:00100000:2.0:1788361557.785705:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:2.0:1788361557.785716:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+53:40246:x1875232130865536:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1788361557.786131:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+54:40246:x1875232130865536:12345-192.168.203.60@tcp:35:bash.0 Request processed in 415us (573us total) trans 30064771506 rc 0/0 00000100:00100000:2.0:1788361557.786138:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:2.0:1788361557.803911:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361557.804025:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130865664 00000100:00100000:3.0:1788361557.804035:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130865664 00000100:00100000:3.0:1788361557.804169:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 500 00000100:00100000:3.0:1788361557.804180:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+54:40424:x1875232130865664:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361557.804203:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361557.804296:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388c00/0xf6a94c97d66169c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbf2 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.804363:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d66169ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.804382:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d66169ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.804393:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d66169ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361557.804450:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1788361557.804455:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361557.804479:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d66169ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.804504:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388c00/0xf6a94c97d66169c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbf2 expref: 56 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.804523:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d66169ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbf2 expref: 55 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.804532:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:2.0:1788361557.804534:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361557.804538:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903800, rc 0) 00000100:00100000:2.0:1788361557.804613:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:40424:x1875232130865664:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 435us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361557.804622:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 500 00000100:00100000:0.0:1788361557.886561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361557.886694:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130865920 00000100:00100000:3.0:1788361557.886704:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130865920 00000100:00100000:3.0:1788361557.886803:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 501 00000100:00100000:3.0:1788361557.886813:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:40440:x1875232130865920:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361557.886832:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361557.886851:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fbf9 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.886952:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66169dc lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.886971:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66169dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.886983:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66169dc lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361557.886994:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1788361557.887137:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d66169d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbf9 expref: 58 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.887155:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66169dc lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbf9 expref: 57 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.887163:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361557.887166:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361557.887169:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388a00, rc 0) 00000100:00100000:3.0:1788361557.887243:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+57:40440:x1875232130865920:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 431us (689us total) trans 30064771507 rc 0/0 00000100:00100000:3.0:1788361557.887250:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 501 00000100:00100000:1.0:1788361557.889175:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361557.889243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361557.889294:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130866304 00000100:00100000:2.0:1788361557.889303:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130866304 00000100:00100000:2.0:1788361557.889360:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1788361557.889372:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+57:2351:x1875232130866304:12345-192.168.203.60@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788361557.889373:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130866176 00000100:00100000:3.0:1788361557.889380:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130866176 00010000:00010000:2.0:1788361557.889389:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361557.889412:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388a00/0xf6a94c97d66169dc lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbf9 expref: 58 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361557.889417:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 502 00000100:00100000:3.0:1788361557.889429:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+57:40440:x1875232130866176:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361557.889435:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:2.0:1788361557.889440:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361557.889450:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361557.889465:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d66169ea lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc00 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361557.889489:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+58:2351:x1875232130866304:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 119us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361557.889506:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00010000:00010000:3.0:1788361557.889607:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66169f1 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.889621:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66169f1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.889632:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66169f1 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361557.889644:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1788361557.889746:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d66169ea lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc00 expref: 59 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.889761:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66169f1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc00 expref: 58 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.889768:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:3.0:1788361557.889771:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788361557.889773:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389800, rc 0) 00000100:00100000:3.0:1788361557.889811:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+58:40440:x1875232130866176:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 384us (642us total) trans 30064771508 rc 0/0 00000100:00100000:3.0:1788361557.889821:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 502 00000100:00100000:1.0:1788361557.899014:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361557.899104:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130866432 00000100:00100000:2.0:1788361557.899112:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130866432 00000100:00100000:2.0:1788361557.899176:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:2.0:1788361557.899186:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130866432:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:2.0:1788361557.899226:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.899246:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 14 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.899256:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361557.899260:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361557.899265:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 4/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.899304:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 14 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.899413:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 14 pid: 35982 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361557.899430:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144246400:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361557.899572:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8815b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788361557.901848:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:35983:1875232144246400:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361557.901867:0:35983:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361557.902025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361557.902239:0:35988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130866560 00000100:00100000:1.0:1788361557.902246:0:35988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130866560 00002000:00100000:1.0:1788361557.902301:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xce:0x0] (0->23) req@ffff9a8a843e8700 x1875232130866560/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:618/0 lens 512/0 e 0 to 0 dl 1788361568 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361557.902311:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a843e8700 with x1875232130866560 ext(0->23) 00010000:00010000:1.0:1788361557.902318:0:35988:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 15 pid: 35982 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.902331:0:35988:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 15 pid: 35982 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361557.902338:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a8a843e8700 00000100:00100000:1.0:1788361557.902401:0:35988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1788361557.902408:0:35988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130866560:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:1.0:1788361557.902892:0:35988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:c05f3090-241b-43d5-9787-08721e3d4333+17:2349:x1875232130866560:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 483us (867us total) trans 30064771281 rc 0/0 00000100:00100000:1.0:1788361557.902900:0:35988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00002000:00100000:1.0:1788361557.902907:0:35988:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0xce:0x0] (0->23) req@ffff9a8a843e8700 x1875232130866560/t30064771281(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:618/0 lens 512/448 e 0 to 0 dl 1788361568 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788361557.902915:0:35988:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8a843e8700 with x1875232130866560 ext(0->23) 00010000:00010000:1.0:1788361557.902921:0:35988:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 17 pid: 35982 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.902933:0:35988:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 17 pid: 35982 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361557.902940:0:35988:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a8a843e8700 00000100:00100000:2.0:1788361557.905234:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361557.905306:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130866688 00000100:00100000:1.0:1788361557.905319:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130866688 00010000:00010000:1.0:1788361557.905353:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 17 pid: 35982 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361557.905406:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361557.905416:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+17:2352:x1875232130866688:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788361557.905430:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788361557.905448:0:36007:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb size from disk: 0 -> 24 00002000:00010000:1.0:1788361557.905451:0:36007:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb mtime from disk: 0 -> 1788361558 00002000:00010000:1.0:1788361557.905453:0:36007:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb atime from disk: 0 -> 1788361558 00002000:00010000:1.0:1788361557.905456:0:36007:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0xce:0x0] updating lvb ctime from disk: 0 -> 1788361558 00010000:00010000:1.0:1788361557.905462:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 17 pid: 35982 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.905476:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 17 pid: 35982 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.905499:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2d58434/0xf6a94c97d66169c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbeb expref: 17 pid: 35982 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.905516:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361557.905520:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788361557.905526:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.905536:0:36007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361557.905640:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788361557.905703:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+16:2352:x1875232130866688:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 288us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361557.905711:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00010000:00010000:2.0:1788361557.906047:0:35983:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.906057:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.906081:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.906127:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.906135:0:35983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.906142:0:35983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903200 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361557.906146:0:35983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.906155:0:35983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.906175:0:35983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.906182:0:35983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000917a8d6c/0xf6a94c97d66169ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361557.906281:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130866432:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 7096us (7275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361557.906289:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:2.0:1788361557.908080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361557.908183:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130866944 00000100:00100000:0.0:1788361557.908192:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130866944 00000100:00100000:0.0:1788361557.908231:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:0.0:1788361557.908236:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+58:40440:x1875232130866944:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:0.0:1788361557.908285:0:35349:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x32:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66169f1 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc00 expref: 58 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788361557.908489:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771509 00000001:00080000:0.0:1788361557.908545:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771510 00000001:00080000:0.0:1788361557.909048:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771511 00010000:00010000:0.0:1788361557.909115:0:35349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.909128:0:35349:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbe4 expref: 62 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.909142:0:35349:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.909167:0:35349:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbe4 expref: 62 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.909176:0:35349:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbe4 expref: 62 pid: 35346 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361557.909188:0:35349:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843ea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35349:1875232144246528:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361557.909239:0:35349:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90b6d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788361557.911843:0:35349:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843ea680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:35349:1875232144246528:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361557.911868:0:35349:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361557.914544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361557.914940:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130867072 00000100:00100000:0.0:1788361557.914948:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130867072 00010000:00010000:0.0:1788361557.914985:0:38408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbe4 expref: 63 pid: 35346 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361557.915027:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:0.0:1788361557.915036:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+63:2350:x1875232130867072:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361557.915055:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361557.915062:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbe4 expref: 63 pid: 35346 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.915103:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbe4 expref: 63 pid: 35346 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.915124:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389000/0xf6a94c97d66169b2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbe4 expref: 63 pid: 35346 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.915151:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:0.0:1788361557.915157:0:38408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.915165:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.915172:0:38408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.915203:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361557.915263:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+62:2350:x1875232130867072:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 227us (726us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361557.915270:0:35349:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361557.915271:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00010000:00010000:1.0:1788361557.915282:0:35349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361557.915403:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771512 00000001:00080000:1.0:1788361557.915551:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771513 00000100:00100000:1.0:1788361557.915646:0:35349:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35349:1875232144246656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788361557.916186:0:35349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361557.916214:0:35349:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361557.916643:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144246656 00000100:00100000:2.0:1788361557.916649:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144246656 00000100:00100000:2.0:1788361557.916767:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788361557.916775:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35349:x1875232144246656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788361557.917025:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:35349:x1875232144246656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 250us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361557.917033:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788361557.917134:0:35349:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35349:1875232144246656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788361557.917580:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771514 00000100:00100000:1.0:1788361557.917642:0:35349:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35349:1875232144246784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788361557.918032:0:35349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361557.918240:0:35349:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788361557.918269:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144246784 00000100:00100000:3.0:1788361557.918275:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144246784 00000100:00100000:3.0:1788361557.918352:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788361557.918361:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35349:x1875232144246784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788361557.918529:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:35349:x1875232144246784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 169us (497us total) trans 30064771282 rc 0/0 00000100:00100000:3.0:1788361557.918536:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788361557.918605:0:35349:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:35349:1875232144246784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788361557.918664:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771515 00010000:00010000:2.0:1788361557.918705:0:35349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.918714:0:35349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.918721:0:35349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.918727:0:35349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361557.918732:0:35349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.918740:0:35349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.918755:0:35349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:2.0:1788361557.918758:0:35349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788361557.918762:0:35349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.918768:0:35349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a06 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788361557.919018:0:35349:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x33:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788361557.919157:0:35349:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2a:0x0].18, 64 off9632 00000004:00080000:2.0:1788361557.919168:0:35349:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 947934081628ns, next at 948934079788ns, rc = 0 00000001:00080000:2.0:1788361557.919174:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771516 00010000:00010000:2.0:1788361557.919207:0:35349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8a827d7e00) 00010000:00010000:2.0:1788361557.919211:0:35349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361557.919217:0:35349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389800/0xf6a94c97d66169f1 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc00 expref: 66 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361557.919307:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+65:40440:x1875232130866944:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 11070us (11234us total) trans 30064771517 rc 0/0 00000100:00100000:2.0:1788361557.919316:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00000020:00080000:2.0:1788361557.919320:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788361557.921343:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361557.921946:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130867200 00000100:00100000:0.0:1788361557.921955:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130867200 00000100:00100000:0.0:1788361557.922050:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 503 00000100:00100000:0.0:1788361557.922060:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+65:40440:x1875232130867200:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361557.922081:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361557.922127:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616a0d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc07 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.922186:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616a0d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc07 expref: 66 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.922201:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616a0d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc07 expref: 66 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.922240:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361557.922244:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788361557.922247:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b44a00, rc 0) 00000100:00100000:0.0:1788361557.922317:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+66:40440:x1875232130867200:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 259us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361557.922324:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 503 00000100:00100000:0.0:1788361557.924901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361557.925392:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130867456 00000100:00100000:2.0:1788361557.925465:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130867456 00000100:00100000:2.0:1788361557.925675:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:2.0:1788361557.925685:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+66:40440:x1875232130867456:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361557.925918:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+67:40440:x1875232130867456:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 234us (1023us total) trans 30064771518 rc 0/0 00000100:00100000:2.0:1788361557.925925:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:2.0:1788361557.972786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361557.972873:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130867584 00000100:00100000:3.0:1788361557.972882:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130867584 00000100:00100000:3.0:1788361557.972935:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 504 00000100:00100000:3.0:1788361557.972945:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+67:40446:x1875232130867584:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361557.972968:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361557.972986:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc0e expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973045:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616a1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973059:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973069:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973111:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616a22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973124:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973132:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973228:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973237:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973243:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361557.973277:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:3.0:1788361557.973281:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361557.973301:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973312:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973320:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973325:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616a1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973332:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973341:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361557.973345:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973353:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616a1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973366:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:3.0:1788361557.973369:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361557.973373:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973378:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973389:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973395:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616a22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973400:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973404:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361557.973407:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973412:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616a22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973421:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff9a8a890fae00) 00010000:00010000:3.0:1788361557.973423:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361557.973426:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616a22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973431:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616a22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973456:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc0e expref: 69 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973466:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc0e expref: 68 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361557.973472:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:3.0:1788361557.973474:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788361557.973476:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389600, rc 0) 00000100:00100000:3.0:1788361557.973528:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+68:40446:x1875232130867584:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 585us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361557.973534:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 504 00000100:00100000:3.0:1788361557.977177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361557.977619:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130867840 00000100:00100000:0.0:1788361557.977629:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130867840 00000100:00100000:0.0:1788361557.977695:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 505 00000100:00100000:0.0:1788361557.977705:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+68:40446:x1875232130867840:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361557.977725:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361557.977741:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616a30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc15 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.977840:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.977855:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc0e expref: 69 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.977864:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.977897:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc0e expref: 69 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.977930:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc0e expref: 69 pid: 37551 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361557.977943:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144246912:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361557.978040:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90b6de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788361557.981742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361557.981806:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144246912:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361557.981811:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130867968 00000100:00100000:2.0:1788361557.981819:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130867968 00010000:00010000:0.0:1788361557.981828:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.981854:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc0e expref: 70 pid: 37551 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361557.981934:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:2.0:1788361557.981943:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+70:2349:x1875232130867968:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361557.981958:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361557.981964:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc0e expref: 70 pid: 37551 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.981976:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc0e expref: 70 pid: 37551 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.981999:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389600/0xf6a94c97d6616a29 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc0e expref: 70 pid: 37551 timeout: 1047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.982014:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361557.982019:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.982028:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.982036:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361557.982062:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788361557.982138:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361557.982139:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+69:2349:x1875232130867968:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 195us (404us total) trans 0 rc 0/0 00010000:00010000:0.0:1788361557.982152:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361557.982157:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000004:00200000:0.0:1788361557.982170:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:0.0:1788361557.982299:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616a30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc15 expref: 70 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.982316:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc15 expref: 69 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361557.982321:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361557.982323:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361557.982324:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8aa8b45400, rc 0) 00000100:00100000:0.0:1788361557.982358:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+69:40446:x1875232130867840:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 4655us (5190us total) trans 30064771519 rc 0/0 00000100:00100000:0.0:1788361557.982375:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 505 00000100:00100000:1.0:1788361558.003838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361558.003952:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130868224 00000100:00100000:0.0:1788361558.003962:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130868224 00000100:00100000:0.0:1788361558.004051:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 506 00000100:00100000:0.0:1788361558.004061:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+69:40449:x1875232130868224:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361558.004143:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361558.004164:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616a45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc1c expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004230:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004244:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004257:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004271:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616a53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004278:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004286:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004392:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6616a5a lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004416:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6616a5a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004422:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6616a5a lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361558.004431:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:0.0:1788361558.004509:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004515:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a4c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004521:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004527:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8aa8b45200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361558.004531:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004538:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004550:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:0.0:1788361558.004553:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361558.004556:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004579:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45200/0xf6a94c97d6616a4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004593:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616a53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004606:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616a53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004611:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004616:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a80030000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361558.004619:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616a53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004626:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616a53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004634:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff9a8984a32300) 00010000:00010000:0.0:1788361558.004637:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361558.004639:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616a53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004645:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030000/0xf6a94c97d6616a53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004690:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44800/0xf6a94c97d6616a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc1c expref: 72 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004703:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6616a5a lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc1c expref: 71 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.004710:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361558.004712:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788361558.004720:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a80030200, rc 0) 00000100:00100000:0.0:1788361558.004772:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+71:40449:x1875232130868224:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 712us (943us total) trans 30064771520 rc 0/0 00000100:00100000:0.0:1788361558.004781:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 506 00000100:00100000:2.0:1788361558.006512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361558.006553:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130868352 00000100:00100000:0.0:1788361558.006572:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130868352 00000100:00100000:0.0:1788361558.006626:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 507 00000100:00100000:0.0:1788361558.006635:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+71:40449:x1875232130868352:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:0.0:1788361558.006686:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.006699:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc15 expref: 71 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.006707:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.006736:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc15 expref: 71 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.006751:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc15 expref: 71 pid: 35346 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.006765:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144247040:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361558.006845:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90b6d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788361558.011938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361558.012128:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843e9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144247040:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361558.012157:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.012181:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130868608 00000100:00100000:2.0:1788361558.012190:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130868608 00000100:00100000:2.0:1788361558.012245:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:2.0:1788361558.012254:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88350c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+72:30910:x1875232130868608:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788361558.012462:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88350c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+73:30910:x1875232130868608:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 208us (532us total) trans 30064771521 rc 0/0 00000100:00100000:2.0:1788361558.012470:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:1.0:1788361558.019482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361558.019814:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130868736 00000100:00100000:2.0:1788361558.019823:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130868736 00010000:00010000:2.0:1788361558.019864:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc15 expref: 73 pid: 35346 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.019943:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:2.0:1788361558.019952:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+73:2350:x1875232130868736:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361558.019967:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361558.019973:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc15 expref: 73 pid: 35346 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.019983:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc15 expref: 73 pid: 35346 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.020002:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b45400/0xf6a94c97d6616a37 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc15 expref: 73 pid: 35346 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.020016:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361558.020020:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.020028:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.020034:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.020061:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361558.020139:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+72:2350:x1875232130868736:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 188us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.020146:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00010000:00010000:3.0:1788361558.020247:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.020255:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.020285:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.020291:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.020298:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.020303:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361558.020307:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.020314:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.020324:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:3.0:1788361558.020326:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788361558.020330:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.020336:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616a68 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.020374:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+71:40449:x1875232130868352:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 13740us (13879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361558.020382:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 507 00000100:00100000:0.0:1788361558.025694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361558.025782:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130868992 00000100:00100000:2.0:1788361558.025792:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130868992 00000100:00100000:2.0:1788361558.025847:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:2.0:1788361558.025857:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+71:40449:x1875232130868992:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1788361558.026071:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+72:40449:x1875232130868992:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 215us (385us total) trans 30064771522 rc 0/0 00000100:00100000:2.0:1788361558.026078:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00000040:00080000:2.0:1788361558.048514:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361558.048524:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361558.048560:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 10 count 5 00000040:00080000:2.0:1788361558.048672:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361558.102834:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361558.102982:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130869248 00000100:00100000:0.0:1788361558.102992:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130869248 00000100:00100000:0.0:1788361558.103052:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 508 00000100:00100000:0.0:1788361558.103063:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+72:40461:x1875232130869248:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1788361558.103120:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361558.103141:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6616a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc23 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103208:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616a76 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103223:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103235:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103250:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616a7d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103257:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103264:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103384:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103409:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103416:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361558.103426:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:0.0:1788361558.103518:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616a76 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103526:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616a76 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103532:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616a76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103538:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361558.103542:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616a76 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103549:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616a76 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103571:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:0.0:1788361558.103574:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361558.103579:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616a76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103585:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616a76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103601:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616a7d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103613:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616a7d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103619:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616a7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103624:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361558.103627:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616a7d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103633:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616a7d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103641:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff9a8984a32300) 00010000:00010000:0.0:1788361558.103644:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361558.103646:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616a7d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103651:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616a7d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103698:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cfa00/0xf6a94c97d6616a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc23 expref: 75 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103712:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc23 expref: 74 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.103719:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361558.103722:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788361558.103730:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf600, rc 0) 00000100:00100000:0.0:1788361558.103799:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+74:40461:x1875232130869248:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 737us (972us total) trans 30064771523 rc 0/0 00000100:00100000:0.0:1788361558.103807:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 508 00000100:00100000:1.0:1788361558.111872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361558.113571:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130869376 00000100:00100000:0.0:1788361558.113589:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130869376 00000100:00100000:0.0:1788361558.113658:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 509 00000100:00100000:0.0:1788361558.113667:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+74:40461:x1875232130869376:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:0.0:1788361558.113742:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6616a92 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.113758:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6616a92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.113773:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6616a92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.113803:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6616a92 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.113811:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6616a92 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.113817:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6616a92 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.113824:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cea00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361558.113829:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6616a92 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.113837:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6616a92 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.113864:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361558.113867:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788361558.113872:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6616a92 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361558.113879:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cea00/0xf6a94c97d6616a92 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361558.113962:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+74:40461:x1875232130869376:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 296us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361558.113970:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 509 00000100:00100000:2.0:1788361558.116495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361558.116622:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130869632 00000100:00100000:3.0:1788361558.116632:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130869632 00000100:00100000:3.0:1788361558.116683:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:3.0:1788361558.116692:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+74:40461:x1875232130869632:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361558.116897:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+75:40461:x1875232130869632:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 206us (411us total) trans 30064771524 rc 0/0 00000100:00100000:3.0:1788361558.116904:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:0.0:1788361558.137745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361558.137933:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130869888 00000100:00100000:3.0:1788361558.137943:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130869888 00000100:00100000:3.0:1788361558.138037:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 510 00000100:00100000:3.0:1788361558.138048:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+75:40467:x1875232130869888:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361558.138072:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361558.138131:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616a99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc2a expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.138226:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616aa0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.138242:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc23 expref: 76 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.138250:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616aa0 lrc: 4/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.138281:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc23 expref: 76 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.138295:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc23 expref: 76 pid: 35346 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.138312:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b122680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144247168:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361558.138399:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a856f0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788361558.140353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361558.140455:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130870016 00000100:00100000:2.0:1788361558.140463:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130870016 00010000:00010000:2.0:1788361558.140512:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 5/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc23 expref: 77 pid: 35346 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361558.140570:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b122680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144247168:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361558.140578:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00010000:00010000:3.0:1788361558.140594:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616aa0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361558.140602:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89810c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+77:2349:x1875232130870016:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361558.140617:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361558.140625:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc23 expref: 77 pid: 35346 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.140637:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc23 expref: 77 pid: 35346 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.140657:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616a84 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc23 expref: 77 pid: 35346 timeout: 1048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.140674:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361558.140678:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616aa0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.140686:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616aa0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.140694:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616aa0 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.140718:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361558.140761:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89810c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+76:2349:x1875232130870016:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 174us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.140769:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00010000:00010000:3.0:1788361558.141048:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616aa0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.141056:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616aa0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361558.141073:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:2.0:1788361558.141311:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388200/0xf6a94c97d6616a99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc2a expref: 77 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.141328:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616aa0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc2a expref: 76 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.141336:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361558.141339:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788361558.141341:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388e00, rc 0) 00000100:00100000:2.0:1788361558.141382:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+76:40467:x1875232130869888:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 3337us (3646us total) trans 30064771525 rc 0/0 00000100:00100000:2.0:1788361558.141389:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 510 00000100:00100000:0.0:1788361558.146942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361558.147050:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130870272 00000100:00100000:3.0:1788361558.147060:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130870272 00000100:00100000:3.0:1788361558.147123:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 511 00000100:00100000:3.0:1788361558.147133:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+76:40467:x1875232130870272:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361558.147158:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361558.147161:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788361558.147186:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616aa0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x32:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc2a expref: 76 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.147205:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:3.0:1788361558.147209:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361558.147220:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616aae lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc31 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.147427:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616ab5 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.147440:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616ab5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.147453:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616ab5 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361558.147464:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:3.0:1788361558.147589:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616aae lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc31 expref: 78 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.147602:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616ab5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc31 expref: 77 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361558.147610:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:3.0:1788361558.147613:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788361558.147615:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389a00, rc 0) 00000100:00100000:3.0:1788361558.147715:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+77:40467:x1875232130870272:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 583us (781us total) trans 30064771526 rc 0/0 00000100:00100000:3.0:1788361558.147722:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 511 00000100:00100000:0.0:1788361558.150484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361558.150605:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130870528 00000100:00100000:2.0:1788361558.150615:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130870528 00000100:00100000:2.0:1788361558.150679:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:2.0:1788361558.150688:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+77:40467:x1875232130870528:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:2.0:1788361558.150703:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788361558.150725:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a80030200/0xf6a94c97d6616a5a lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc1c expref: 77 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.150747:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8aa8b44a00/0xf6a94c97d6616a0d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc07 expref: 76 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.150759:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361558.150763:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361558.150823:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+75:40467:x1875232130870528:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 136us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.150831:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:0.0:1788361558.152427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361558.152784:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130870656 00000100:00100000:1.0:1788361558.152792:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130870656 00000100:00100000:1.0:1788361558.153025:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 512 00000100:00100000:1.0:1788361558.153036:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+75:40467:x1875232130870656:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:1.0:1788361558.153163:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361558.153179:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361558.153192:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788361558.153484:0:35345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].10, 136 off9552 00000100:00100000:1.0:1788361558.153580:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+75:40467:x1875232130870656:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 545us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361558.153588:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 512 00000100:00100000:1.0:1788361558.157380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361558.157455:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130870784 00000100:00100000:2.0:1788361558.157474:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130870784 00000100:00100000:2.0:1788361558.157532:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 513 00000100:00100000:2.0:1788361558.157540:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+75:40467:x1875232130870784:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361558.157572:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361558.157594:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc38 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.157652:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 2/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.157664:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 4/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 76 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.157687:0:37122:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.157700:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 76 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.157713:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361558.157716:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788361558.157721:0:37122:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 3/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 76 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361558.157728:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902a00, rc 0) 00000100:00100000:2.0:1788361558.157788:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+76:40467:x1875232130870784:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 248us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361558.157794:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 513 00010000:00010000:1.0:1788361558.432323:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361559.072316:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361559.072325:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361559.072365:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 11 count 6 00000040:00080000:2.0:1788361559.072373:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361559.072691:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144247296:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788361559.072965:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84ba33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788361559.077332:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144247296:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361559.077520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.078633:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130870912 00000100:00100000:3.0:1788361559.078643:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130870912 00000100:00100000:3.0:1788361559.078772:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 514 00000100:00100000:3.0:1788361559.078783:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+76:40469:x1875232130870912:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788361559.078814:0:35346:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788361559.078929:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+76:40469:x1875232130870912:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 148us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361559.078938:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 514 00000100:00080000:1.0:1788361559.079333:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361559.082748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.083152:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130871040 00000100:00100000:1.0:1788361559.083161:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130871040 00000100:00100000:1.0:1788361559.084020:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 515 00000100:00100000:1.0:1788361559.084033:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+76:40469:x1875232130871040:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788361559.084145:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ad1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084162:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084175:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084529:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616ad8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084537:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084544:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084579:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084589:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084596:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361559.084631:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:1.0:1788361559.084635:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361559.084647:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084717:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ad1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084724:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ad1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084730:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084746:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361559.084751:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ad1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084759:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ad1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084772:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:1.0:1788361559.084775:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361559.084780:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ad1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084786:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ad1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084799:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084805:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616ad8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084811:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084816:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361559.084818:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084824:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616ad8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084842:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x26c361d7 (ffff9a8aa8ee1f00) 00010000:00010000:1.0:1788361559.084845:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361559.084847:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616ad8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084853:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616ad8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x26c361d7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084867:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084873:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084879:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084884:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361559.084886:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084891:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084898:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:1.0:1788361559.084900:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361559.084903:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.084909:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616adf lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361559.085004:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+76:40469:x1875232130871040:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 969us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361559.085013:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 515 00000100:00100000:0.0:1788361559.090497:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361559.090762:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130871296 00000100:00100000:2.0:1788361559.090773:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130871296 00000100:00100000:2.0:1788361559.090891:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 516 00000100:00100000:2.0:1788361559.090901:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+76:40469:x1875232130871296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361559.090923:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361559.090941:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616ae6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc3f expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091034:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616aed lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091049:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616aed lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091060:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616aed lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361559.091070:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:2.0:1788361559.091341:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616aed lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091350:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616aed lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091358:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616aed lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091364:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361559.091368:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616aed lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091376:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616aed lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091389:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361559.091393:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788361559.091397:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616aed lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091402:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616aed lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091444:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616ae6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc3f expref: 78 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091464:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:2.0:1788361559.091466:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361559.091470:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616ae6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc3f expref: 78 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.091480:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902600, rc 0) 00000100:00100000:2.0:1788361559.091590:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89265f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+77:40469:x1875232130871296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 689us (1101us total) trans 30064771527 rc 301/301 00000100:00100000:2.0:1788361559.091598:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 516 00000100:00100000:0.0:1788361559.095810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.095974:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130871424 00000100:00100000:3.0:1788361559.095984:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130871424 00000100:00100000:3.0:1788361559.096078:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 517 00000100:00100000:3.0:1788361559.096137:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+77:40469:x1875232130871424:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788361559.096174:0:35346:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788361559.096276:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+77:40469:x1875232130871424:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 189us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361559.096284:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 517 00000100:00100000:0.0:1788361559.099765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.099957:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130871680 00000100:00100000:1.0:1788361559.099966:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130871680 00000100:00100000:1.0:1788361559.100020:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 518 00000100:00100000:1.0:1788361559.100029:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+77:40469:x1875232130871680:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361559.100049:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361559.100052:0:35345:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788361559.100077:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d66169ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbf2 expref: 77 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.100124:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fa300) 00010000:00010000:1.0:1788361559.100134:0:35345:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361559.100148:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616afb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc46 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788361559.100639:0:35345:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xcf:0x0], index 0: 0 00010000:00010000:1.0:1788361559.101043:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b02 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.101053:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b02 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.101061:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b02 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.101641:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616afb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc46 expref: 79 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.102102:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b02 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc46 expref: 78 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.102112:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:1.0:1788361559.102115:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361559.102118:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:1.0:1788361559.102191:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+78:40469:x1875232130871680:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2163us (2433us total) trans 30064771528 rc 0/0 00000100:00100000:1.0:1788361559.102199:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 518 00000100:00100000:1.0:1788361559.105822:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361559.105931:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130871808 00000100:00100000:2.0:1788361559.105941:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130871808 00000100:00100000:2.0:1788361559.105995:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 519 00000100:00100000:2.0:1788361559.106003:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+78:40469:x1875232130871808:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788361559.106025:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361559.106045:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616b10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc4d expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.106130:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616b17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.106145:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.106156:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361559.106212:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1788361559.106216:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361559.106238:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.106258:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616b10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc4d expref: 80 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.106273:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616b17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc4d expref: 79 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.106282:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:2.0:1788361559.106285:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361559.106287:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902200, rc 0) 00000100:00100000:2.0:1788361559.106341:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+79:40469:x1875232130871808:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 339us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361559.106348:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 519 00000100:00100000:0.0:1788361559.115027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.115235:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130872064 00000100:00100000:3.0:1788361559.115244:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130872064 00000100:00100000:3.0:1788361559.115296:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 520 00000100:00100000:3.0:1788361559.115304:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+79:40469:x1875232130872064:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788361559.115458:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788361559.115482:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b02 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc46 expref: 79 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115501:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1100) 00010000:00010000:3.0:1788361559.115515:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616b17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc4d expref: 78 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115524:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0bd00) 00010000:00010000:3.0:1788361559.115529:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361559.115552:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b1e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115641:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115651:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115665:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b25 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xce860aef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115673:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce860aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115680:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce860aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115752:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b1e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115758:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b1e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115764:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115770:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361559.115773:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b1e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115781:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b1e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115789:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a890fae00) 00010000:00010000:3.0:1788361559.115792:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361559.115796:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b1e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115802:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b1e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115813:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b25 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xce860aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115819:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b25 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xce860aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115892:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xce860aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115897:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361559.115901:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b25 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xce860aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115907:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b25 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xce860aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115914:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xce860aef (ffff9a8a890fa300) 00010000:00010000:3.0:1788361559.115916:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361559.115919:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b25 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xce860aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.115925:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b25 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xce860aef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361559.116043:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f584700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+77:40469:x1875232130872064:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 738us (1023us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788361559.116051:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 520 00000100:00100000:0.0:1788361559.118551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.119004:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130872192 00000100:00100000:1.0:1788361559.119013:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130872192 00000100:00100000:1.0:1788361559.119194:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 521 00000100:00100000:1.0:1788361559.119206:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+77:40469:x1875232130872192:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361559.119225:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361559.119245:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616b2c lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc54 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.119279:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.119292:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.119304:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.119409:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616b2c lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc54 expref: 79 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.119427:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc54 expref: 78 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.119435:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:1.0:1788361559.119438:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788361559.119441:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8a00, rc 0) 00000100:00100000:1.0:1788361559.119503:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f587800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+78:40469:x1875232130872192:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 299us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361559.119510:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 521 00000100:00100000:1.0:1788361559.122907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361559.123260:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130872448 00000100:00100000:2.0:1788361559.123270:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130872448 00000100:00100000:2.0:1788361559.123327:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 522 00000100:00100000:2.0:1788361559.123336:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+78:40469:x1875232130872448:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788361559.123477:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.123494:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.123506:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788361559.124739:0:37122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].19, 88 off9648 00000004:00080000:2.0:1788361559.124752:0:37122:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 949139665620ns, next at 950139663132ns, rc = 0 00000004:00010000:2.0:1788361559.124911:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6a4fa24 reply state 000000004bf6022a transno 30064771529 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.124922:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361559.125052:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+80:40469:x1875232130872448:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1715us (2150us total) trans 30064771529 rc 0/0 00000100:00100000:2.0:1788361559.125061:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 522 00000100:00100000:1.0:1788361559.128478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1788361559.128601:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.128621:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.128630:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.128648:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361559.128653:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.128831:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.128851:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:0.0:1788361559.128854:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788361559.128858:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.128865:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616b3a lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361559.128897:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130872576 00000100:00100000:3.0:1788361559.128907:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130872576 00000100:00100000:3.0:1788361559.128952:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 523 00000100:00100000:3.0:1788361559.128960:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+79:40469:x1875232130872576:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361559.128981:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361559.128994:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b41 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc5b expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.129045:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b41 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc5b expref: 80 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.129058:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b41 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc5b expref: 80 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.129256:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:3.0:1788361559.129260:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361559.129263:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388e00, rc 0) 00000100:00100000:3.0:1788361559.129314:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+80:40469:x1875232130872576:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 354us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361559.129321:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 523 00000100:00100000:2.0:1788361559.131331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.131436:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130872704 00000100:00100000:1.0:1788361559.131442:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130872704 00000100:00100000:1.0:1788361559.131495:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00100000:1.0:1788361559.131502:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+11:2350:x1875232130872704:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788361559.131846:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130872704:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 342us (518us total) trans 30064771214 rc 0/0 00000100:00100000:1.0:1788361559.131854:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00080000:3.0:1788361559.131949:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361559.133696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.133782:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130872960 00000100:00100000:3.0:1788361559.133789:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130872960 00000100:00100000:3.0:1788361559.133850:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:3.0:1788361559.133858:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+80:40469:x1875232130872960:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361559.134033:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+81:40469:x1875232130872960:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 175us (342us total) trans 30064771530 rc 0/0 00000100:00100000:3.0:1788361559.134041:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:0.0:1788361559.135482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.135548:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130873216 00000100:00100000:1.0:1788361559.135565:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130873216 00000100:00100000:1.0:1788361559.135613:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 524 00000100:00100000:1.0:1788361559.135620:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+81:40469:x1875232130873216:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788361559.135725:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+81:40469:x1875232130873216:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 104us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361559.135732:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 524 00000100:00100000:2.0:1788361559.137620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361559.137699:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130873344 00000100:00100000:0.0:1788361559.137706:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130873344 00000100:00100000:0.0:1788361559.137766:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 525 00000100:00100000:0.0:1788361559.137773:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+81:40469:x1875232130873344:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361559.137786:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361559.137802:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616b48 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc62 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.137864:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616b4f lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.137879:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616b4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.137902:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616b4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361559.137931:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361559.137944:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616b4f lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.137963:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616b48 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc62 expref: 83 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.137977:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616b4f lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc62 expref: 82 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.137983:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:0.0:1788361559.137985:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788361559.137988:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf800, rc 0) 00000100:00100000:0.0:1788361559.138031:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+82:40469:x1875232130873344:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 258us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361559.138038:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 525 00000100:00100000:3.0:1788361559.139955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.140062:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130873472 00000100:00100000:1.0:1788361559.140069:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130873472 00000100:00100000:1.0:1788361559.140137:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:1.0:1788361559.140145:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130873472:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361559.140159:0:35980:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361559.140175:0:35980:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6616b56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc69 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361559.140197:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a983b57, blocks: 0x1 00010000:00010000:1.0:1788361559.140212:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=949s v=(0 0) 00010000:00010000:1.0:1788361559.140217:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361559.140225:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6616b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc69 expref: 13 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.140240:0:35980:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6616b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc69 expref: 13 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.140248:0:35980:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9200, rc 0) 00000100:00100000:1.0:1788361559.140288:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130873472:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 144us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361559.140296:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:1.0:1788361559.142300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.142402:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130873728 00000100:00100000:3.0:1788361559.142411:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130873728 00000100:00100000:3.0:1788361559.142457:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 526 00000100:00100000:3.0:1788361559.142466:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+82:40469:x1875232130873728:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788361559.142573:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+82:40469:x1875232130873728:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 108us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361559.142581:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 526 00000100:00100000:2.0:1788361559.144211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361559.144356:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130873856 00000100:00100000:0.0:1788361559.144362:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130873856 00000100:00100000:0.0:1788361559.144402:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 154 00000100:00100000:0.0:1788361559.144410:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:40469:x1875232130873856:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788361559.144425:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361559.144446:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc70 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.144492:0:35982:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6616b56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc69 expref: 14 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.144500:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361559.144505:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361559.144510:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 4/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 14 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.144540:0:35982:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6616b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc69 expref: 14 pid: 35980 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.144565:0:35982:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6616b56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc69 expref: 14 pid: 35980 timeout: 1049 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361559.144580:0:35982:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:35982:1875232144247424:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361559.144655:0:35982:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90b6d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361559.147185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.147216:0:35982:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f26d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:35982:1875232144247424:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361559.147238:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130873984 00000100:00100000:2.0:1788361559.147246:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130873984 00010000:00010000:3.0:1788361559.147250:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 14 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.147272:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65ce000, rc 0) 00010000:00010000:2.0:1788361559.147289:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6616b56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc69 expref: 15 pid: 35980 timeout: 1049 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.147324:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:3.0:1788361559.147335:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:40469:x1875232130873856:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2923us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361559.147336:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130873984:12345-192.168.203.60@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788361559.147351:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 154 00010000:00010000:2.0:1788361559.147355:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361559.147451:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6616b56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc69 expref: 14 pid: 35980 timeout: 1049 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.147469:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6616b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc69 expref: 14 pid: 35980 timeout: 1049 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.147490:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7977ad2/0xf6a94c97d6616b56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc69 expref: 14 pid: 35980 timeout: 1049 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.147503:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361559.147508:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361559.147516:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 13 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.147527:0:36007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 13 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.147569:0:36007:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 13 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.147579:0:36007:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:36007:1875232144247552:192.168.203.60@tcp:105: 00000100:00100000:2.0:1788361559.147617:0:36007:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788361559.149360:0:36007:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:36007:1875232144247552:192.168.203.60@tcp:105: 00010000:00010000:2.0:1788361559.149377:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361559.149423:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130873984:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 2091us (2247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361559.149433:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:1.0:1788361559.151188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.151464:0:35987:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130874112 00000100:00100000:3.0:1788361559.151472:0:35987:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130874112 00002000:00100000:3.0:1788361559.151522:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcf:0x0] (0->23) req@ffff9a8abf0a8000 x1875232130874112/t0(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:620/0 lens 512/0 e 0 to 0 dl 1788361570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361559.151533:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf0a8000 with x1875232130874112 ext(0->23) 00002000:00010000:3.0:1788361559.151539:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf0a8000 00000100:00100000:3.0:1788361559.151579:0:35987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 362 00000100:00100000:3.0:1788361559.152172:0:35987:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130874112:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788361559.152573:0:35987:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130874112:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 985us (1389us total) trans 30064771215 rc 0/0 00000100:00100000:3.0:1788361559.152582:0:35987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 362 00002000:00100000:3.0:1788361559.152598:0:35987:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0xcf:0x0] (0->23) req@ffff9a8abf0a8000 x1875232130874112/t30064771215(0) o4->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:620/0 lens 512/448 e 0 to 0 dl 1788361570 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788361559.152608:0:35987:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8abf0a8000 with x1875232130874112 ext(0->23) 00002000:00010000:3.0:1788361559.152612:0:35987:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8abf0a8000 00000100:00100000:0.0:1788361559.155158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.155246:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130874240 00000100:00100000:3.0:1788361559.155255:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130874240 00000100:00100000:3.0:1788361559.155304:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 527 00000100:00100000:3.0:1788361559.155313:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+82:40469:x1875232130874240:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788361559.175837:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.175878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.175945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.175971:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130874496 00000100:00100000:1.0:1788361559.175980:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130874496 00000100:00100000:1.0:1788361559.176029:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:1.0:1788361559.176038:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130874496:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361559.176122:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+15:2350:x1875232130874496:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361559.176130:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00080000:1.0:1788361559.176213:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361559.176235:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130874624 00000100:00100000:1.0:1788361559.176240:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130874624 00000100:00100000:1.0:1788361559.176270:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:1.0:1788361559.176276:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130874624:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361559.176311:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130874624:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361559.176318:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00080000:1.0:1788361559.176335:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361559.176549:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130874368 00000100:00100000:0.0:1788361559.176563:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130874368 00000100:00100000:0.0:1788361559.176608:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:0.0:1788361559.176615:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130874368:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361559.176646:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130874368:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 32us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361559.176665:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 151 00000001:00080000:1.0:1788361559.181795:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771523 is committed 00000001:00080000:1.0:1788361559.181834:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771528 is committed 00000020:00080000:1.0:1788361559.181845:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a843bde40 refcount 2 committed 0 result 0 batchid 25769803906 00000020:00080000:1.0:1788361559.181851:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a898afe8400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a882fae40 00000020:00080000:1.0:1788361559.181854:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a898afe8d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a82bce800 00000020:00080000:1.0:1788361559.181867:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803905 batchid updated 00000001:00080000:1.0:1788361559.181887:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771529 is committed 00000004:00080000:1.0:1788361559.181890:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 19 committed 00000004:00080000:1.0:1788361559.181910:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000004:00080000:1.0:1788361559.181922:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000001:00080000:1.0:1788361559.181927:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771530 is committed 00000020:00080000:1.0:1788361559.181953:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803906 committed batchid 25769803905 00000020:00080000:1.0:1788361559.182148:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803905 00000100:00100000:1.0:1788361559.182310:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9086df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144247680:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788361559.182380:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361559.182423:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788361559.182428:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144247680 00000100:00100000:1.0:1788361559.182432:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144247808:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788361559.182437:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144247680 00000100:00100000:1.0:1788361559.182461:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361559.182497:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144247808 00000100:00100000:1.0:1788361559.182499:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144247936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788361559.182502:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144247808 00000100:00100000:2.0:1788361559.182530:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788361559.182535:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361559.182545:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144247680:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788361559.182576:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144247936 00000100:00100000:1.0:1788361559.182581:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144247936 00002000:00080000:2.0:1788361559.182586:0:36286:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:206 count 1 00000100:00100000:1.0:1788361559.182607:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00010000:00010000:2.0:1788361559.182612:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361559.182617:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875232144247808:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788361559.182647:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 14 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.182657:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xce:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1788361559.182661:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361559.182667:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361559.182728:0:35980:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb size from disk: 0 -> 24 00002000:00010000:1.0:1788361559.182733:0:35980:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb mtime from disk: 0 -> 1788361559 00002000:00010000:1.0:1788361559.182735:0:35980:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788361559.182737:0:35980:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb ctime from disk: 1788361559 -> 1788361559 00002000:00010000:1.0:1788361559.182740:0:35980:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788361559.182776:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3311:x1875232144247808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 161us (315us total) trans 30064771216 rc 0/0 00000100:00100000:1.0:1788361559.182783:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788361559.182800:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788361559.182816:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1875232144247936:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788361559.182827:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 14 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788361559.182830:0:35980:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:206 count 1 00010000:00010000:2.0:1788361559.182847:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 14 pid: 35980 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788361559.182856:0:35980:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xce:0x0] initial LVB size: 24, mtime: 0x6a983b56, atime: 0x6a983b56, ctime: 0x6a983b56, blocks: 0x1 00000100:00100000:2.0:1788361559.182862:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144248064:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361559.182864:0:35980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d6616b6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.182876:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=949s v=(0 0) 00010000:00010000:1.0:1788361559.182880:0:35980:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xce:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788361559.182887:0:35980:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d6616b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.182902:0:35980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d6616b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.182912:0:35980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d6616b6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.182919:0:35980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d6616b6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.182922:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9a80 going to sleep for 11 seconds 00010000:00010000:1.0:1788361559.182940:0:35980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361559.182955:0:36289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361559.182962:0:36289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d6616b6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.182971:0:36289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:2.0:1788361559.182975:0:36289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d6616b6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.182985:0:36289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d6616b6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.183001:0:36289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d6616b6b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.183008:0:36289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003627fb0/0xf6a94c97d6616b6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.183023:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361559.183025:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361559.183027:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361559.183376:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3313:x1875232144247936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 560us (843us total) trans 30064771283 rc 0/0 00000100:00100000:1.0:1788361559.183383:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000004:00080000:2.0:1788361559.183427:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a898b067800/2, rc 0, transno 30064771283 00000100:00100000:2.0:1788361559.183435:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b067800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144247936:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788361559.183506:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a8ae71c00/2, rc 0, transno 30064771216 00000100:00100000:1.0:1788361559.183512:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144247808:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788361559.183532:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361559.183536:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361559.183671:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:40469:x1875232130874240:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 28357us (28516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361559.183680:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 527 00000100:00100000:1.0:1788361559.185916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361559.185991:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130874752 00000100:00100000:2.0:1788361559.186000:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130874752 00010000:00010000:2.0:1788361559.186036:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 15 pid: 35980 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361559.186038:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144248064:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361559.186065:0:36286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.186122:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:2.0:1788361559.186134:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+15:2349:x1875232130874752:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361559.186147:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361559.186154:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 15 pid: 35980 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.186167:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 15 pid: 35980 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.186188:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022a1f657/0xf6a94c97d66168f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fbb3 expref: 15 pid: 35980 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.186203:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361559.186207:0:35332:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xce:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361559.186213:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.186222:0:35332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.186245:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361559.186260:0:36286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.186272:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.186279:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.186286:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130874752:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 152us (374us total) trans 0 rc 0/0 00010000:00010000:3.0:1788361559.186291:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.186298:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00010000:00010000:3.0:1788361559.186321:0:36286:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788361559.186605:0:35334:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788361559.186612:0:35334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.186621:0:35334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:0.0:1788361559.186752:0:35334:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.186762:0:35334:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.186774:0:35334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.186781:0:35334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.186797:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361559.186799:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361559.186801:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361559.187078:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3311:x1875232144247680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4536us (4698us total) trans 30064771217 rc 0/0 00000100:00100000:3.0:1788361559.187112:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788361559.187152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361559.187228:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130874880 00000100:00100000:0.0:1788361559.187232:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130874880 00000100:00100000:0.0:1788361559.187307:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 158 00000004:00080000:2.0:1788361559.187313:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a9086df80/2, rc 0, transno 30064771217 00000100:00100000:0.0:1788361559.187319:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+14:2349:x1875232130874880:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788361559.187324:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9086df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144247680:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788361559.205351:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771216 is committed 00000001:00080000:2.0:1788361559.205369:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771214 is committed 00000001:00080000:2.0:1788361559.205377:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771217 is committed 00000001:00080000:2.0:1788361559.205383:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771215 is committed 00000100:00100000:1.0:1788361559.205436:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130874880:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 18115us (18280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361559.205449:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:1.0:1788361559.208625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.208692:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130875136 00000100:00100000:3.0:1788361559.208701:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130875136 00000100:00100000:3.0:1788361559.208749:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 528 00000100:00100000:3.0:1788361559.208757:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:40469:x1875232130875136:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788361559.208804:0:35346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361559.208829:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616b4f lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc62 expref: 55 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.208847:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:3.0:1788361559.208851:0:35346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361559.208896:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.208915:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.208924:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361559.209056:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009fbb6005 reply state 0000000080fa0b97 transno 30064771531 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361559.209065:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361559.209169:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+56:40469:x1875232130875136:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 412us (560us total) trans 30064771531 rc 0/0 00000100:00100000:3.0:1788361559.209176:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 528 00010000:00010000:1.0:1788361559.211427:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.211441:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.211449:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.211456:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361559.211460:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.211467:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.211483:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:1.0:1788361559.211486:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361559.211491:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.211497:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616b72 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.211853:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361559.211883:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130875264 00000100:00100000:2.0:1788361559.211892:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130875264 00000100:00100000:2.0:1788361559.211933:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:2.0:1788361559.211942:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130875264:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788361559.212187:0:35982:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb size from disk: 24 -> 24 00002000:00010000:2.0:1788361559.212191:0:35982:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb mtime from disk: 1788361559 -> 1788361558 00002000:00010000:2.0:1788361559.212194:0:35982:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb atime from disk: 0 -> 1788361558 00002000:00010000:2.0:1788361559.212196:0:35982:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb ctime from disk: 1788361559 -> 1788361558 00002000:00010000:2.0:1788361559.212198:0:35982:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0xcf:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788361559.212249:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+12:2349:x1875232130875264:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 307us (399us total) trans 30064771218 rc 0/0 00000100:00100000:2.0:1788361559.212258:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:3.0:1788361559.214958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.215022:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130875520 00000100:00100000:1.0:1788361559.215032:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130875520 00000100:00100000:1.0:1788361559.215105:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 529 00000100:00100000:1.0:1788361559.215115:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:40469:x1875232130875520:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788361559.215178:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.215194:0:37122:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc54 expref: 55 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.215204:0:37122:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 4/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.215285:0:37122:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc54 expref: 55 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.215299:0:37122:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc54 expref: 55 pid: 35345 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361559.215315:0:37122:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a89858af480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144248192:192.168.203.60@tcp:104: 00000100:00100000:1.0:1788361559.215397:0:37122:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a843bd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788361559.217470:0:37122:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a89858af480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:37122:1875232144248192:192.168.203.60@tcp:104: 00010000:00010000:1.0:1788361559.217494:0:37122:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361559.221024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.221430:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130875648 00000100:00100000:3.0:1788361559.221440:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130875648 00010000:00010000:3.0:1788361559.221477:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc54 expref: 56 pid: 35345 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361559.221638:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:3.0:1788361559.221648:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+56:2349:x1875232130875648:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361559.221663:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361559.221670:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc54 expref: 56 pid: 35345 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.221683:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc54 expref: 56 pid: 35345 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.221712:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8a00/0xf6a94c97d6616b33 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x34:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc54 expref: 56 pid: 35345 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.221728:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:3.0:1788361559.221733:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.221743:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.221750:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.221815:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361559.221876:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130875648:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 229us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361559.221883:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00010000:00010000:1.0:1788361559.221923:0:37122:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.221940:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.221970:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.221977:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.221983:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.221989:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361559.221993:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.222001:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.222011:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:1.0:1788361559.222014:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788361559.222018:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.222024:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616b79 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361559.222771:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+54:40469:x1875232130875520:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 7656us (7820us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788361559.222782:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 529 00000001:00080000:1.0:1788361559.223531:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771283 is committed 00000001:00080000:1.0:1788361559.223540:0:7498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 30064771281 is committed 00000100:00100000:1.0:1788361559.224025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361559.224064:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130875776 00000100:00100000:2.0:1788361559.224071:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130875776 00000100:00100000:2.0:1788361559.224184:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 160 00000100:00100000:2.0:1788361559.224193:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+12:2349:x1875232130875776:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788361559.224233:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.224248:0:35983:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 12 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.224254:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788361559.224258:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361559.224261:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 4/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.224286:0:35983:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 12 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.224296:0:35983:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 12 pid: 35982 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.224306:0:35983:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1564700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:35983:1875232144248320:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361559.224393:0:35983:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a8bbb9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788361559.225937:0:35983:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1564700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:35983:1875232144248320:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361559.225961:0:35983:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 3/1,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361559.226295:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361559.226383:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130875904 00000100:00100000:2.0:1788361559.226394:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130875904 00010000:00010000:2.0:1788361559.226423:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 13 pid: 35982 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.226465:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:2.0:1788361559.226474:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130875904:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361559.226487:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361559.226507:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 13 pid: 35982 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.226525:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 13 pid: 35982 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.226546:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007075c01d/0xf6a94c97d6616b5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc70 expref: 13 pid: 35982 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.226575:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361559.226579:0:36007:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788361559.226583:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.226592:0:36007:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.226623:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361559.226664:0:35983:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.226667:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2349:x1875232130875904:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 193us (372us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361559.226683:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.226684:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00010000:00010000:1.0:1788361559.226714:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.226722:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.226730:0:35983:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.226738:0:35983:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903600 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361559.226742:0:35983:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.226752:0:35983:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.226765:0:35983:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.226786:0:35983:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000341dc530/0xf6a94c97d6616b80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361559.226847:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130875776:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 2655us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361559.226855:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 160 00000100:00100000:1.0:1788361559.228027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361559.228318:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130876160 00000100:00100000:3.0:1788361559.228326:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130876160 00000100:00100000:0.0:1788361559.228391:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 530 00000100:00100000:0.0:1788361559.228412:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+54:40469:x1875232130876160:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788361559.228479:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616b87 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.228494:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616b87 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.228505:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616b87 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.228836:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.228848:0:35346:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b41 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc5b expref: 55 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.228856:0:35346:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 4/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.228887:0:35346:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b41 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc5b expref: 55 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361559.228900:0:35346:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b41 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc5b expref: 55 pid: 35346 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361559.228914:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f27480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144248448:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361559.228990:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90b6da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788361559.231707:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f27480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144248448:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361559.231734:0:35346:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361559.231742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361559.231787:0:35332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130876288 00000100:00100000:2.0:1788361559.231798:0:35332:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130876288 00010000:00010000:2.0:1788361559.231833:0:35332:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b41 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc5b expref: 56 pid: 35346 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.231862:0:35332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:2.0:1788361559.231870:0:35332:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+56:2350:x1875232130876288:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361559.231887:0:35332:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361559.231894:0:35332:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b41 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc5b expref: 56 pid: 35346 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.231906:0:35332:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b41 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc5b expref: 56 pid: 35346 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.231926:0:35332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616b41 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc5b expref: 56 pid: 35346 timeout: 1049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.231940:0:35332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:2.0:1788361559.231945:0:35332:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.231955:0:35332:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.231963:0:35332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.232289:0:35346:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.232293:0:35332:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361559.232296:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.232346:0:35332:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130876288:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 476us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361559.232354:0:35332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000001:00080000:3.0:1788361559.232467:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771532 00000001:00080000:3.0:1788361559.232710:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771533 00000001:00080000:3.0:1788361559.232759:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771534 00000100:00100000:3.0:1788361559.232852:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b121500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144248576:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788361559.232896:0:35346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361559.232928:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788361559.233020:0:35351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144248576 00000100:00100000:2.0:1788361559.233025:0:35351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144248576 00000100:00100000:2.0:1788361559.233057:0:35351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788361559.233064:0:35351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35346:x1875232144248576:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788361559.233225:0:35351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:35346:x1875232144248576:12345-0@lo:1000:mdt00_001.0 Request processed in 161us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361559.233230:0:35351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788361559.233324:0:35346:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771217 gen 2 00000004:00080000:3.0:1788361559.233330:0:35346:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a898b123b80, transno 30064771213 00000004:00080000:3.0:1788361559.233344:0:35346:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a8ae71c00, transno 30064771216 00000004:00080000:3.0:1788361559.233347:0:35346:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a9086df80, transno 30064771217 00000100:00100000:3.0:1788361559.233352:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b121500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144248576:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788361559.233744:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771535 00000004:00080000:1.0:1788361559.233767:0:35367:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:3.0:1788361559.233790:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b121500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144248704:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788361559.233819:0:35346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361559.233882:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788361559.233917:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144248704 00000100:00100000:2.0:1788361559.233922:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144248704 00000100:00100000:2.0:1788361559.233956:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788361559.233964:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35346:x1875232144248704:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788361559.234273:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:35346:x1875232144248704:12345-0@lo:1000:mdt00_001.0 Request processed in 309us (452us total) trans 30064771219 rc 0/0 00000100:00100000:2.0:1788361559.234281:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788361559.234331:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b121500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:35346:1875232144248704:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788361559.234400:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771536 00010000:00010000:3.0:1788361559.234426:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234434:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234441:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234447:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361559.234451:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234459:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234472:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1f00) 00010000:00010000:3.0:1788361559.234475:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361559.234478:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234484:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce200/0xf6a94c97d6616b8e lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234512:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234518:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234524:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234529:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361559.234532:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234537:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234546:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:3.0:1788361559.234548:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361559.234566:0:35346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 59 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234577:0:35346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 59 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234585:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 59 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.234609:0:35346:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 59 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361559.234620:0:35346:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144248832:192.168.203.60@tcp:105: 00000100:00100000:3.0:1788361559.234679:0:35346:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae2e6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788361559.236430:0:35346:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986706d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:35346:1875232144248832:192.168.203.60@tcp:105: 00010000:00010000:3.0:1788361559.236457:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361559.236459:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1788361559.236468:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616ac3 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236497:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616b95 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236506:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616b95 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236516:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616b95 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236534:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616b95 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236544:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616b95 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.236547:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130876416 00010000:00010000:3.0:1788361559.236550:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616b95 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.236566:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130876416 00010000:00010000:3.0:1788361559.236569:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361559.236574:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616b95 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236582:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616b95 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236593:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:3.0:1788361559.236595:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361559.236598:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616b95 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236604:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616b95 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.236610:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:2.0:1788361559.236620:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+60:40467:x1875232130876416:12345-192.168.203.60@tcp:49:lfs.0 00010000:00010000:3.0:1788361559.236621:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616b87 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236631:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616b87 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236637:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616b87 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236643:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361559.236645:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616b87 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236651:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616b87 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236658:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:3.0:1788361559.236660:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788361559.236663:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616b87 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.236668:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf600/0xf6a94c97d6616b87 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361559.236746:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+60:40467:x1875232130876416:12345-192.168.203.60@tcp:49:lfs.0 Request processed in 128us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361559.236752:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:3.0:1788361559.236884:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+59:40469:x1875232130876160:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 8473us (8858us total) trans 30064771537 rc 0/0 00000100:00100000:3.0:1788361559.236893:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 530 00000020:00080000:3.0:1788361559.236897:0:35346:0:(tgt_main.c:784:tgt_ses_key_exit()) total 6 transactions per RPC 00000040:00080000:2.0:1788361559.237018:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361559.237023:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361559.237543:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 6 00000040:00080000:2.0:1788361559.237551:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361559.238766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361559.238850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361559.238929:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130876672 00000100:00100000:1.0:1788361559.238937:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130876672 00000100:00100000:1.0:1788361559.238977:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:1.0:1788361559.238984:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+59:40469:x1875232130876672:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361559.239549:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130876800 00000100:00100000:3.0:1788361559.239569:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130876800 00000100:00100000:3.0:1788361559.239617:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 161 00000100:00100000:3.0:1788361559.239624:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+11:40467:x1875232130876800:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361559.239644:0:35982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361559.239664:0:35982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040edcbc2/0xf6a94c97d6616b9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc77 expref: -99 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788361559.239688:0:35982:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 24, mtime: 0x6a983b56, atime: 0x6a983b56, ctime: 0x6a983b56, blocks: 0xb 00010000:00010000:3.0:1788361559.239708:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=949s v=(0 0) 00010000:00010000:3.0:1788361559.239713:0:35982:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361559.239723:0:35982:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040edcbc2/0xf6a94c97d6616b9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc77 expref: 12 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.239739:0:35982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040edcbc2/0xf6a94c97d6616b9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc77 expref: 12 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361559.239752:0:35982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389200, rc 0) 00000100:00100000:3.0:1788361559.239817:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+12:40467:x1875232130876800:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 191us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361559.239826:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 161 00000004:00080000:1.0:1788361559.239854:0:35349:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x34:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788361559.239968:0:35349:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771538 00010000:00010000:1.0:1788361559.240015:0:35349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.240031:0:35349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.240041:0:35349:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.240049:0:35349:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.240054:0:35349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 4/0,1 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.240067:0:35349:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361559.240108:0:35349:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788361559.240149:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788361559.240157:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361559.240166:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+61:40469:x1875232130876672:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1180us (1401us total) trans 30064771539 rc 0/0 00010000:00010000:2.0:1788361559.240173:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1589400) 00000100:00100000:1.0:1788361559.240177:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00010000:00010000:2.0:1788361559.240181:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788361559.240183:0:35349:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788361559.240195:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.240210:0:35335:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x34:0x0].0x0 (ffff9a8aa8ee1200) 00010000:00010000:2.0:1788361559.240214:0:35335:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788361559.240218:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 1/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.240224:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616ba3 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 35349 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361559.240242:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361559.240244:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361559.240246:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361559.241436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361559.241494:0:38204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130876928 00000100:00100000:0.0:1788361559.241501:0:38204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130876928 00002000:00100000:0.0:1788361559.241541:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcf:0x0] (0->4095) req@ffff9a8ab71b0380 x1875232130876928/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:620/0 lens 488/0 e 0 to 0 dl 1788361570 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361559.241552:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b0380 with x1875232130876928 ext(0->4095) 00002000:00010000:0.0:1788361559.241568:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab71b0380 00000100:00100000:0.0:1788361559.241600:0:38204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 363 00000100:00100000:0.0:1788361559.241610:0:38204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130876928:12345-192.168.203.60@tcp:3:lfs.0 00000100:00100000:0.0:1788361559.241802:0:38204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130876928:12345-192.168.203.60@tcp:3:lfs.0 Request processed in 193us (371us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788361559.241811:0:38204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 363 00002000:00100000:0.0:1788361559.241818:0:38204:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0xcf:0x0] (0->4095) req@ffff9a8ab71b0380 x1875232130876928/t0(0) o3->c05f3090-241b-43d5-9787-08721e3d4333@192.168.203.60@tcp:620/0 lens 488/4536 e 0 to 0 dl 1788361570 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788361559.241827:0:38204:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a8ab71b0380 with x1875232130876928 ext(0->4095) 00002000:00010000:0.0:1788361559.241831:0:38204:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a8ab71b0380 00010000:00010000:2.0:1788361559.456310:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361560.484755:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361561.145232:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361561.145645:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130877056 00000100:00100000:2.0:1788361561.145655:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130877056 00000100:00100000:2.0:1788361561.145731:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 531 00000100:00100000:2.0:1788361561.145743:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+61:40471:x1875232130877056:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361561.145766:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361561.145789:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616baa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc7e expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.145849:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616bb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.145862:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.145879:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361561.146065:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1788361561.146069:0:35347:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 21 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361561.146171:0:35347:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616bb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.146196:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902000/0xf6a94c97d6616baa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc7e expref: 63 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.146211:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc7e expref: 62 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.146219:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:2.0:1788361561.146221:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361561.146224:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902600, rc 0) 00000100:00100000:2.0:1788361561.146285:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+62:40471:x1875232130877056:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 545us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361561.146292:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 531 00000100:00080000:1.0:1788361561.146360:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361561.150244:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361561.154174:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130877184 00000100:00100000:2.0:1788361561.154190:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130877184 00000100:00100000:2.0:1788361561.154316:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 532 00000100:00100000:2.0:1788361561.154327:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+62:40471:x1875232130877184:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361561.154347:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361561.154367:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616bb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc85 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154439:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616bbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154452:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616bbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154463:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616bbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154476:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616bc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154484:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154490:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154789:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154798:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154811:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361561.154842:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00000004:00200000:2.0:1788361561.154846:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361561.154864:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154877:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154884:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616bbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154891:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616bbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154896:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616bbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154903:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361561.154907:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616bbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154913:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616bbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154931:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:2.0:1788361561.154934:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361561.154938:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154944:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903800/0xf6a94c97d6616bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154955:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154961:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154967:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154973:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361561.154975:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154980:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154987:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x49e46987 (ffff9a8a83c0b400) 00010000:00010000:2.0:1788361561.154990:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361561.154992:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616bc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.154998:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902800/0xf6a94c97d6616bc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x49e46987 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.155026:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616bb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc85 expref: 64 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.155039:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc85 expref: 63 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361561.155046:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361561.155048:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788361561.155051:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903400, rc 0) 00000100:00100000:2.0:1788361561.158407:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+63:40471:x1875232130877184:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 4072us (8162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361561.158422:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 532 00000040:00080000:2.0:1788361561.312317:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361561.312325:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361561.312696:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 11 count 4 00000040:00080000:2.0:1788361561.312705:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361561.504256:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361561.675063:0:39853:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361561.675073:0:39853:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361561.675349:0:39853:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 11 count 4 00000040:00080000:3.0:1788361561.675356:0:39853:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361561.726367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361561.726451:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130877440 00000100:00100000:1.0:1788361561.726460:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130877440 00000100:00100000:1.0:1788361561.726515:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 533 00000100:00100000:1.0:1788361561.726524:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+63:40482:x1875232130877440:12345-192.168.203.60@tcp:58:lfs.0 00000040:00080000:1.0:1788361561.726821:0:35346:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2c:0x0].11, 136 off9688 00000100:00100000:1.0:1788361561.726896:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+63:40482:x1875232130877440:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 373us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361561.726904:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 533 00000100:00100000:2.0:1788361562.272513:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361562.272554:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144248960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361562.272633:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361562.272713:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144249088:0@lo:400:kworker.0 00000100:00100000:1.0:1788361562.272788:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361562.272855:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144248960 00000100:00100000:3.0:1788361562.272864:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144248960 00000100:00100000:3.0:1788361562.272940:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788361562.272953:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144248960:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361562.273015:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144249088 00000100:00100000:2.0:1788361562.273021:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144249088 00000100:00100000:2.0:1788361562.273052:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788361562.273058:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144249088:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788361562.273185:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361562.273229:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144248960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 279us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361562.273236:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788361562.273256:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361562.273307:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 30064771283 gen 2 00000004:00080000:3.0:1788361562.273312:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8ac1566680, transno 30064771280 00000004:00080000:3.0:1788361562.273323:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771282 committed transno 30064771283 00000004:00080000:3.0:1788361562.273343:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a898b067800, transno 30064771283 00000100:00100000:3.0:1788361562.273366:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144248960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361562.273802:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144249216:0@lo:400:kworker.0 00000100:00100000:3.0:1788361562.273836:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361562.273870:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144249216 00000100:00100000:3.0:1788361562.273874:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144249216 00000100:00100000:3.0:1788361562.273908:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788361562.273915:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144249216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361562.273951:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144249216:12345-0@lo:400:kworker.0 Request processed in 37us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361562.273957:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788361562.273975:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361562.273993:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144249216:0@lo:400:kworker.0 00000100:00100000:2.0:1788361562.274546:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144249088:12345-0@lo:400:kworker.0 Request processed in 1476us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361562.274559:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788361562.274630:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144249472:0@lo:400:kworker.0 00000100:00100000:0.0:1788361562.274633:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361562.274652:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144249600:0@lo:400:kworker.0 00000100:00100000:2.0:1788361562.274670:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361562.274704:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361562.274714:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144249344:0@lo:400:kworker.0 00000100:00100000:0.0:1788361562.274727:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361562.274756:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361562.274787:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144249472 00000100:00100000:0.0:1788361562.274796:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144249472 00000100:00100000:0.0:1788361562.274872:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144249600 00000100:00100000:0.0:1788361562.274875:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144249600 00000100:00100000:3.0:1788361562.274892:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144249344 00000100:00100000:3.0:1788361562.274901:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144249344 00000100:00100000:0.0:1788361562.274914:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788361562.274928:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144249472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361562.274938:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788361562.274951:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144249600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361562.275018:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144249472:12345-0@lo:400:kworker.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361562.275028:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788361562.275037:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144249600:12345-0@lo:400:kworker.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361562.275047:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788361562.275060:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788361562.275070:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144249344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361562.275142:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144249344:12345-0@lo:400:kworker.0 Request processed in 74us (390us total) trans 0 rc 0/0 00000100:00080000:3.0:1788361562.275143:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361562.275156:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788361562.275207:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144249600:0@lo:400:kworker.0 00000100:00100000:2.0:1788361562.275271:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144249344:0@lo:400:kworker.0 00000100:00100000:2.0:1788361562.275284:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144249472:0@lo:400:kworker.0 00000100:00100000:1.0:1788361562.279001:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144249088:0@lo:400:kworker.0 00000040:00080000:2.0:1788361562.336422:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361562.336436:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361562.336500:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 5 00000040:00080000:2.0:1788361562.336509:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361562.336673:0:35380:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144249728:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788361562.336864:0:35380:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a85659480 going to sleep for 11 seconds 00000100:00100000:2.0:1788361562.341736:0:35380:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83541c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:35380:1875232144249728:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788361562.342239:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361562.342635:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130877568 00000100:00100000:3.0:1788361562.342644:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130877568 00000100:00100000:3.0:1788361562.342698:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 534 00000100:00100000:3.0:1788361562.342708:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9086df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+63:40483:x1875232130877568:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788361562.342738:0:35347:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x2000032e1:0x32:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788361562.343131:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9086df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+63:40483:x1875232130877568:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 423us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361562.343139:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 534 00000100:00100000:3.0:1788361562.347303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361562.347441:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130877824 00000100:00100000:1.0:1788361562.347452:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130877824 00000100:00100000:1.0:1788361562.347566:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 535 00000100:00100000:1.0:1788361562.347576:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+63:40483:x1875232130877824:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788361562.347607:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361562.347627:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616bd4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc8c expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347721:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616bdb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347735:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616bdb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347747:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616bdb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361562.347757:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x32:0x0]: returning size 24 00010000:00010000:1.0:1788361562.347858:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616bdb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347865:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616bdb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347872:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616bdb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347878:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361562.347882:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616bdb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347890:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616bdb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347902:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:1.0:1788361562.347909:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788361562.347913:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616bdb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347919:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616bdb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347967:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616bd4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc8c expref: 65 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347976:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:1.0:1788361562.347978:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361562.347982:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616bd4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc8c expref: 65 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361562.347990:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9200, rc 0) 00000100:00100000:1.0:1788361562.348047:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+64:40483:x1875232130877824:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 473us (754us total) trans 30064771540 rc 301/301 00000100:00100000:1.0:1788361562.348054:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 535 00000100:00100000:1.0:1788361562.351266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361562.351346:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130878080 00000100:00100000:0.0:1788361562.351355:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130878080 00000100:00100000:0.0:1788361562.351409:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 536 00000100:00100000:0.0:1788361562.351419:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+64:40483:x1875232130878080:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788361562.351505:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616be9 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.351522:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616be9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.352234:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616be9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.352419:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616be9 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.352427:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616be9 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.352447:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616be9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.352453:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361562.352457:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616be9 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.352465:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616be9 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.352477:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361562.352480:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788361562.352483:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616be9 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361562.352489:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616be9 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361562.353494:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+65:40483:x1875232130878080:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 2071us (2232us total) trans 30064771541 rc 0/0 00000100:00100000:0.0:1788361562.353506:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 536 00000040:00080000:2.0:1788361562.354501:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361562.354507:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361562.355503:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 5 00000040:00080000:2.0:1788361562.355518:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361562.357511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361562.357599:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130878336 00000100:00100000:3.0:1788361562.357608:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130878336 00000100:00100000:3.0:1788361562.357696:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:3.0:1788361562.357704:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88353050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+65:40483:x1875232130878336:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361562.357940:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88353050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+66:40483:x1875232130878336:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 235us (436us total) trans 30064771542 rc 0/0 00000100:00100000:3.0:1788361562.357959:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00010000:00010000:2.0:1788361562.529602:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361562.784358:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144249856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361562.784429:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361562.784493:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144249856 00000100:00100000:1.0:1788361562.784501:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144249856 00000100:00100000:1.0:1788361562.784736:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788361562.784749:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144249856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361562.784787:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361562.784987:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144249856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 241us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361562.784994:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788361562.785295:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144249856:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361563.552547:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361564.296497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361564.296555:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361564.296571:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130878464 00000100:00100000:2.0:1788361564.296582:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130878464 00000100:00100000:3.0:1788361564.296587:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130878592 00000100:00100000:3.0:1788361564.296592:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130878592 00000100:00100000:2.0:1788361564.296638:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:3.0:1788361564.296644:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:2.0:1788361564.296651:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130878464:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361564.296658:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+66:2352:x1875232130878592:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361564.296722:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130878464:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361564.296733:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+66:2352:x1875232130878592:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361564.296734:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:3.0:1788361564.296758:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00080000:3.0:1788361564.296824:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361564.298316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361564.298353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361564.298387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361564.298476:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130878848 00000100:00100000:3.0:1788361564.298482:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130878848 00000100:00100000:3.0:1788361564.298540:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130878720 00000100:00100000:3.0:1788361564.298543:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130878720 00000100:00100000:3.0:1788361564.298568:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1788361564.298576:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130878848:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361564.298630:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130878848:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 53us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361564.298637:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:1.0:1788361564.298652:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130878976 00000100:00100000:3.0:1788361564.298656:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:1.0:1788361564.298659:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130878976 00000100:00100000:3.0:1788361564.298685:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+12:2351:x1875232130878720:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361564.298714:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:1.0:1788361564.298726:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130878976:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361564.298741:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+12:2351:x1875232130878720:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 57us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361564.298768:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:1.0:1788361564.298773:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130878976:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361564.298783:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00080000:0.0:1788361564.298839:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361564.298861:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361564.298864:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788361564.355588:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771541 is committed 00000020:00080000:1.0:1788361564.355614:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803906 batchid updated 00000001:00080000:1.0:1788361564.355772:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771542 is committed 00000020:00080000:1.0:1788361564.355798:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8aae2e6780 refcount 2 committed 0 result 0 batchid 25769803907 00000020:00080000:1.0:1788361564.355803:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8aa95a6c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8aae2e69c0 00000020:00080000:1.0:1788361564.355807:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8aa95a6d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a898af5e400 00000020:00080000:3.0:1788361564.355854:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803907 committed batchid 25769803906 00000020:00080000:3.0:1788361564.356035:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803906 00000001:00080000:3.0:1788361564.358707:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771219 is committed 00000001:00080000:3.0:1788361564.358722:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771218 is committed 00010000:00010000:2.0:1788361564.577019:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361565.600239:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361566.625046:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361567.392744:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144250368:0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.392813:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361567.392868:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361567.392873:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144250240:0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.392895:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361567.392933:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144250368 00000100:00100000:1.0:1788361567.392941:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144250368 00000100:00100000:1.0:1788361567.392981:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788361567.392988:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144250368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.393031:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144250368:12345-0@lo:400:kworker.0 Request processed in 43us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361567.393037:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788361567.393070:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144250368:0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.393142:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361567.393151:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144250752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361567.393175:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.393292:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144249984:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.393324:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.393352:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898af37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144250496:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.393373:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.393389:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788361567.393395:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144250112:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.393416:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.393431:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144250624:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.393449:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361567.393475:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144250496 00000100:00100000:3.0:1788361567.393479:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144250496 00000100:00100000:3.0:1788361567.393524:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144250624 00000100:00100000:3.0:1788361567.393528:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144250624 00000100:00100000:0.0:1788361567.393551:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144250752 00000100:00100000:3.0:1788361567.393555:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788361567.393558:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144250752 00000100:00100000:3.0:1788361567.393565:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144250496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361567.393595:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788361567.393607:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144250496:12345-0@lo:400:kworker.0 Request processed in 44us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361567.393613:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788361567.393629:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788361567.393635:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144250624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.393661:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144250624:12345-0@lo:400:kworker.0 Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361567.393666:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788361567.393682:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144250240 00000100:00100000:3.0:1788361567.393685:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144250240 00000100:00100000:3.0:1788361567.393705:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144250112 00000100:00100000:3.0:1788361567.393708:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144250112 00000100:00100000:0.0:1788361567.393837:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144250752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361567.393850:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144249984 00000100:00100000:1.0:1788361567.393855:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144249984 00000100:00100000:1.0:1788361567.393881:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788361567.393887:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144249984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.393920:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144249984:12345-0@lo:400:kworker.0 Request processed in 32us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361567.393925:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1788361567.393979:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361567.393983:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361567.393985:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361567.394021:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788361567.394029:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144250240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.394066:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144250240:12345-0@lo:400:kworker.0 Request processed in 38us (1169us total) trans 0 rc 0/0 00002000:00000024:0.0:1788361567.394081:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361567.394140:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144250752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 537us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361567.394147:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788361567.396112:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144250624:0@lo:400:kworker.0 00000100:00100000:0.0:1788361567.396127:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8926c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144249984:0@lo:400:kworker.0 00000100:00100000:0.0:1788361567.396137:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898af37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144250496:0@lo:400:kworker.0 00000100:00100000:2.0:1788361567.396344:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788361567.396362:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144250112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361567.396445:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144250112:12345-0@lo:400:kworker.0 Request processed in 93us (3028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361567.396452:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788361567.396603:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144250752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361567.396617:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144250240:0@lo:400:kworker.0 00000100:00100000:1.0:1788361567.396710:0:3313:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771219 gen 2 00000004:00080000:1.0:1788361567.396716:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771219 committed transno 30064771219 00000100:00100000:1.0:1788361567.397592:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144250112:0@lo:400:kworker.0 00000100:00100000:3.0:1788361567.397668:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:2.0:1788361567.648357:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361567.905028:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361567.905241:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144250880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361567.905309:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361567.905483:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144250880 00000100:00100000:1.0:1788361567.905490:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144250880 00000100:00100000:1.0:1788361567.905692:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788361567.905703:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144250880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361567.905742:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361567.905801:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144250880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361567.905807:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788361567.905882:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83543480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144250880:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788361568.672628:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361569.420367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361569.420408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361569.420511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361569.420547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361569.420579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361569.420598:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130879104 00000100:00100000:3.0:1788361569.420607:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130879104 00000100:00100000:3.0:1788361569.420655:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 155 00000100:00100000:3.0:1788361569.420663:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130879104:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361569.420724:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130879104:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 62us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361569.420731:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 155 00000100:00100000:1.0:1788361569.420843:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130879616 00000100:00100000:1.0:1788361569.420847:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130879616 00000100:00100000:1.0:1788361569.420877:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130879232 00000100:00100000:1.0:1788361569.420889:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130879232 00000100:00100000:1.0:1788361569.420908:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:1.0:1788361569.420914:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130879616:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361569.420943:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130879616:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361569.420949:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:1.0:1788361569.420960:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:1.0:1788361569.420964:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+54:2351:x1875232130879232:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361569.420982:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+54:2351:x1875232130879232:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 18us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361569.420988:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00080000:1.0:1788361569.421005:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361569.421204:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130879360 00000100:00100000:0.0:1788361569.421210:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130879360 00000100:00100000:0.0:1788361569.421257:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130879488 00000100:00100000:0.0:1788361569.421260:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130879488 00000100:00100000:1.0:1788361569.421277:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:1.0:1788361569.421379:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+11:2351:x1875232130879360:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361569.421411:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:1.0:1788361569.421416:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+11:2351:x1875232130879360:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361569.421426:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1788361569.421426:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130879488:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361569.421462:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130879488:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 41us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361569.421469:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00080000:3.0:1788361569.422980:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361569.422986:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:1.0:1788361569.467673:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803907 batchid updated 00000020:00080000:3.0:1788361569.467835:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00000020:00080000:3.0:1788361569.467849:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00010000:00010000:0.0:1788361569.696499:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361570.720960:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361571.552380:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361571.552390:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361571.552732:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 4 00000040:00080000:2.0:1788361571.552739:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361571.744416:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361572.512748:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144251392:0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.512818:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.512894:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361572.512901:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144251264:0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.512928:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.512966:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144251392 00000100:00100000:1.0:1788361572.512974:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144251392 00000100:00100000:0.0:1788361572.512991:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361572.513006:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144251776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361572.513040:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788361572.513047:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361572.513054:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144251392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361572.513078:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144251776 00000100:00100000:0.0:1788361572.513117:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144251776 00000100:00100000:1.0:1788361572.513152:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf133100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144251392:12345-0@lo:400:kworker.0 Request processed in 89us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361572.513160:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788361572.513164:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788361572.513169:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144251776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361572.513198:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361572.513231:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144251776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361572.513237:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788361572.513284:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144251776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361572.513294:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144251392:0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.513759:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144251008:0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.513798:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361572.513834:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144251520:0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.513857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361572.513903:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144251008 00000100:00100000:0.0:1788361572.513908:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144251008 00000100:00100000:0.0:1788361572.513936:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788361572.513943:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144251008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361572.513965:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144251520 00000100:00100000:1.0:1788361572.513971:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144251520 00000100:00100000:1.0:1788361572.514000:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788361572.514008:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144251520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.514016:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144251136:0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.514069:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144251264 00000100:00100000:2.0:1788361572.514073:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144251264 00000100:00100000:2.0:1788361572.514124:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788361572.514132:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144251264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361572.514151:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144251008:12345-0@lo:400:kworker.0 Request processed in 208us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361572.514159:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1788361572.514216:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361572.514221:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361572.514245:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144251520:12345-0@lo:400:kworker.0 Request processed in 236us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361572.514253:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788361572.514344:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144251264:12345-0@lo:400:kworker.0 Request processed in 212us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361572.514352:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788361572.514376:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144251264:0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.514453:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144251008:0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.514482:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144251520:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.515124:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361572.515167:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144251648:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.515197:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361572.515254:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144251648 00000100:00100000:2.0:1788361572.515260:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144251648 00000100:00100000:2.0:1788361572.515305:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788361572.515313:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144251648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361572.515358:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144251648:12345-0@lo:400:kworker.0 Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361572.515365:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788361572.515382:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144251136 00000100:00100000:0.0:1788361572.515388:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144251136 00000100:00100000:0.0:1788361572.515434:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788361572.515444:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144251136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361572.515509:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144251136:12345-0@lo:400:kworker.0 Request processed in 69us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361572.515516:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788361572.515630:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361572.515635:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361572.515660:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144251136:0@lo:400:kworker.0 00000100:00100000:3.0:1788361572.515669:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144251648:0@lo:400:kworker.0 00010000:00010000:0.0:1788361572.768342:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361573.025019:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a83541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144251904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361573.025266:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361573.025441:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144251904 00000100:00100000:1.0:1788361573.025448:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144251904 00000100:00100000:1.0:1788361573.025528:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788361573.025536:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144251904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361573.025566:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361573.025610:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144251904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361573.025615:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788361573.025671:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a83541c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144251904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788361573.792257:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361574.535959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361574.536005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361574.536026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361574.536049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361574.536064:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130879744 00000100:00100000:1.0:1788361574.536072:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361574.536074:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130879744 00000100:00100000:1.0:1788361574.536122:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130879872 00000100:00100000:1.0:1788361574.536126:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130879872 00000100:00100000:2.0:1788361574.536141:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130880000 00000100:00100000:2.0:1788361574.536149:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130880000 00000100:00100000:0.0:1788361574.536150:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130880128 00000100:00100000:0.0:1788361574.536156:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130880128 00000100:00100000:3.0:1788361574.536164:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 157 00000100:00100000:3.0:1788361574.536177:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130879744:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361574.536181:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130880256 00000100:00100000:1.0:1788361574.536186:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130880256 00000100:00100000:2.0:1788361574.536197:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:2.0:1788361574.536209:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2352:x1875232130880000:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361574.536214:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:1.0:1788361574.536222:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:0.0:1788361574.536228:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130880128:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361574.536236:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+54:2351:x1875232130879872:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361574.536252:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130879744:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 76us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361574.536253:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+11:2352:x1875232130880000:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361574.536270:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1788361574.536272:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 157 00000100:00100000:0.0:1788361574.536275:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130880128:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 48us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361574.536282:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+54:2351:x1875232130879872:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 48us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361574.536290:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:1.0:1788361574.536295:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00080000:3.0:1788361574.536313:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361574.536318:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00080000:3.0:1788361574.536320:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361574.536327:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361574.536332:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130880256:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361574.536364:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130880256:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 39us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361574.536372:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00010000:00010000:2.0:1788361574.816335:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361575.840363:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361576.864237:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361577.632293:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144252032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361577.632366:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361577.632451:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144252032 00000100:00100000:3.0:1788361577.632460:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144252032 00000100:00100000:0.0:1788361577.632487:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144252160:0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.632528:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361577.632529:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361577.632539:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144252032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361577.632576:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361577.632576:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144252160 00000100:00100000:0.0:1788361577.632581:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144252160 00000100:00100000:0.0:1788361577.632612:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788361577.632620:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144252160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361577.632664:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144252160:12345-0@lo:400:kworker.0 Request processed in 44us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361577.632669:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788361577.632706:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144252160:0@lo:400:kworker.0 00000100:00080000:0.0:1788361577.632742:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361577.633567:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144252032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1027us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361577.633571:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144252032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361577.633584:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788361577.633645:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144252288:0@lo:400:kworker.0 00000100:00100000:0.0:1788361577.633681:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361577.633713:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144252288 00000100:00100000:2.0:1788361577.633717:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144252288 00000100:00100000:2.0:1788361577.633760:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788361577.633770:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144252288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.633786:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144252416:0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.633824:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361577.633858:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144252416 00000100:00100000:3.0:1788361577.633863:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144252416 00000100:00100000:3.0:1788361577.633891:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788361577.633898:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144252416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.633952:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144252416:12345-0@lo:400:kworker.0 Request processed in 54us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361577.633958:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788361577.633985:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf131c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144252416:0@lo:400:kworker.0 00000100:00080000:3.0:1788361577.634011:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361577.634568:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144252288:12345-0@lo:400:kworker.0 Request processed in 800us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361577.634573:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788361577.634607:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144252672:0@lo:400:kworker.0 00000100:00100000:1.0:1788361577.634638:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361577.634675:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144252544:0@lo:400:kworker.0 00000100:00100000:2.0:1788361577.634702:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144252672 00000100:00100000:2.0:1788361577.634706:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144252672 00000100:00100000:3.0:1788361577.634711:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361577.634724:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144252288:0@lo:400:kworker.0 00000100:00100000:2.0:1788361577.634739:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144252544 00000100:00100000:2.0:1788361577.634743:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144252544 00000100:00100000:2.0:1788361577.634771:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788361577.634780:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144252672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361577.634869:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788361577.634879:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144252544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361577.634929:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144252672:12345-0@lo:400:kworker.0 Request processed in 149us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361577.634931:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144252544:12345-0@lo:400:kworker.0 Request processed in 53us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361577.634944:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788361577.634978:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144252672:0@lo:400:kworker.0 00000100:00100000:3.0:1788361577.635002:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144252544:0@lo:400:kworker.0 00000100:00080000:2.0:1788361577.635003:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361577.635027:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00010000:2.0:1788361577.890770:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361578.146356:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144252800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361578.146441:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361578.146569:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144252800 00000100:00100000:1.0:1788361578.146578:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144252800 00000100:00100000:1.0:1788361578.146686:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788361578.146696:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144252800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361578.146730:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361578.146781:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144252800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361578.146797:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788361578.146845:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144252800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361578.912378:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361579.332199:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361579.332266:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130880384 00000100:00100000:0.0:1788361579.332275:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130880384 00000100:00080000:2.0:1788361579.332344:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361579.332356:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:0.0:1788361579.332367:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+11:2349:x1875232130880384:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:0.0:1788361579.332402:0:36286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.332430:0:36286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040edcbc2/0xf6a94c97d6616b9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc77 expref: 11 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.332437:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=20s v=(0 0) 00010000:00010000:0.0:1788361579.332440:0:36286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361579.332443:0:36286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.332487:0:36286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040edcbc2/0xf6a94c97d6616b9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc77 expref: 11 pid: 35982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.332501:0:36286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040edcbc2/0xf6a94c97d6616b9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc77 expref: 11 pid: 35982 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361579.332516:0:36286:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898af37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144252928:192.168.203.60@tcp:104: 00000100:00100000:0.0:1788361579.332591:0:36286:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9ec1480 going to sleep for 11 seconds 00000100:00100000:0.0:1788361579.337057:0:36286:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898af37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:36286:1875232144252928:192.168.203.60@tcp:104: 00010000:00010000:0.0:1788361579.337118:0:36286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361579.337300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361579.337450:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130880512 00000100:00100000:0.0:1788361579.337457:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130880512 00010000:00010000:0.0:1788361579.337490:0:38408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040edcbc2/0xf6a94c97d6616b9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc77 expref: 12 pid: 35982 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361579.337565:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:0.0:1788361579.337575:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89810c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+12:2350:x1875232130880512:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361579.337590:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361579.337612:0:38408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040edcbc2/0xf6a94c97d6616b9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc77 expref: 12 pid: 35982 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.337640:0:38408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040edcbc2/0xf6a94c97d6616b9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc77 expref: 12 pid: 35982 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.337664:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040edcbc2/0xf6a94c97d6616b9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xcf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc77 expref: 12 pid: 35982 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.337679:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361579.337683:0:38408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788361579.337688:0:38408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.337698:0:38408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.337734:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361579.337787:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89810c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+11:2350:x1875232130880512:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 209us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361579.337794:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00010000:00010000:1.0:1788361579.337888:0:36286:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.337898:0:36286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.337929:0:36286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.337937:0:36286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.337945:0:36286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.337953:0:36286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf400 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361579.337957:0:36286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.337966:0:36286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.337977:0:36286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.337986:0:36286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000442c5634/0xf6a94c97d6616bf0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 36286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361579.338034:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130880384:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 5669us (5842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361579.338044:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:2.0:1788361579.339110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361579.339213:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130880768 00000100:00100000:3.0:1788361579.339220:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130880768 00000100:00100000:3.0:1788361579.339313:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:3.0:1788361579.339321:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+54:40467:x1875232130880768:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:3.0:1788361579.339375:0:35348:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x2000032e1:0x32:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616ab5 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc31 expref: 54 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788361579.339648:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771543 00000001:00080000:3.0:1788361579.340307:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771544 00010000:00010000:3.0:1788361579.340366:0:35348:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.340381:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 57 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.340391:0:35348:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc85 expref: 57 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.340398:0:35348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 5/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.340455:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc85 expref: 57 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.340468:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc85 expref: 57 pid: 37122 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361579.340482:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae10380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144253056:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361579.340570:0:35348:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 57 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.340580:0:35348:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 57 pid: 37122 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361579.340590:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae10e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144253184:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361579.340619:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a90a339c0 going to sleep for 11 seconds 00000100:00080000:2.0:1788361579.341227:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361579.342580:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae10380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144253056:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361579.342596:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae10e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:35348:1875232144253184:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361579.342621:0:35348:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361579.344035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361579.344116:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130880896 00000100:00100000:0.0:1788361579.344125:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130880896 00000100:00100000:2.0:1788361579.344144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1788361579.344165:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc85 expref: 58 pid: 37122 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361579.344205:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130881024 00000100:00100000:0.0:1788361579.344208:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130881024 00010000:00010000:0.0:1788361579.344221:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 59 pid: 37122 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361579.344321:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:0.0:1788361579.344331:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+59:2350:x1875232130880896:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361579.344348:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361579.344360:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc85 expref: 59 pid: 37122 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.344374:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc85 expref: 59 pid: 37122 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.344395:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616bcd lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc85 expref: 59 pid: 37122 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.344410:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:0.0:1788361579.344415:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.344437:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361579.344444:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361579.344494:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+58:2350:x1875232130880896:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 162us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361579.344498:0:35333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:2.0:1788361579.344512:0:35333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+58:2349:x1875232130881024:12345-192.168.203.60@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788361579.344518:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00010000:00010000:2.0:1788361579.344523:0:35333:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361579.344530:0:35333:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 58 pid: 37122 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361579.344542:0:35333:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 57 pid: 37122 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361579.344555:0:35333:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616aca lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc38 expref: 57 pid: 37122 timeout: 1069 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361579.344565:0:35333:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:2.0:1788361579.344569:0:35333:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,1 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361579.344577:0:35333:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361579.344583:0:35333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 4/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361579.344604:0:35333:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361579.344622:0:35348:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361579.344625:0:35333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c05f3090-241b-43d5-9787-08721e3d4333+56:2349:x1875232130881024:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 116us (481us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361579.344640:0:35348:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361579.344644:0:35333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000001:00080000:1.0:1788361579.344768:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771545 00000001:00080000:1.0:1788361579.345131:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771546 00000100:00100000:1.0:1788361579.345229:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf132d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144253312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788361579.345274:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361579.345302:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aae3a2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788361579.345311:0:35350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144253312 00000100:00100000:2.0:1788361579.345317:0:35350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144253312 00000100:00100000:2.0:1788361579.345368:0:35350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788361579.345376:0:35350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144253312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1788361579.345432:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361579.345467:0:35350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf133b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144253312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361579.345475:0:35350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788361579.345495:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf132d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144253312:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788361579.345910:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771547 00000100:00100000:3.0:1788361579.345960:0:35348:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144253440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788361579.345991:0:35348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361579.346018:0:37379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144253440 00000100:00100000:3.0:1788361579.346021:0:35348:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8a84f7dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788361579.346023:0:37379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144253440 00000100:00100000:1.0:1788361579.346055:0:37379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788361579.346064:0:37379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:35348:x1875232144253440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788361579.346275:0:37379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:35348:x1875232144253440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 211us (282us total) trans 30064771220 rc 0/0 00000100:00100000:1.0:1788361579.346282:0:37379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788361579.346352:0:35348:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae12680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:35348:1875232144253440:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788361579.346391:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771548 00010000:00010000:3.0:1788361579.346438:0:35348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,1 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.346448:0:35348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 2/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.346455:0:35348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.346462:0:35348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361579.346467:0:35348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 3/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.346479:0:35348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 4/0,0 mode: EX/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.346493:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:3.0:1788361579.346496:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788361579.346500:0:35348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 2/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.346507:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616bf7 lrc: 0/0,0 mode: --/EX res: [0x2000032e1:0x32:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35348 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788361579.346707:0:35348:0:(mdd_object.c:4016:mdd_close()) Object [0x2000032e1:0x35:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788361579.346796:0:35348:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x28:0x0].20, 64 off9712 00000004:00080000:3.0:1788361579.346806:0:35348:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 969361719803ns, next at 970361717903ns, rc = 0 00000001:00080000:3.0:1788361579.346812:0:35348:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771549 00010000:00010000:3.0:1788361579.346841:0:35348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8984a32f00) 00010000:00010000:3.0:1788361579.346845:0:35348:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788361579.346851:0:35348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616ab5 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x32:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc31 expref: 60 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361579.346977:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+59:40467:x1875232130880768:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 7657us (7870us total) trans 30064771550 rc 0/0 00000100:00100000:3.0:1788361579.346990:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 131 00000020:00080000:3.0:1788361579.346994:0:35348:0:(tgt_main.c:784:tgt_ses_key_exit()) total 8 transactions per RPC 00000100:00100000:2.0:1788361579.348844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361579.348912:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130881152 00000100:00100000:3.0:1788361579.348920:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130881152 00000100:00100000:3.0:1788361579.348968:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 537 00000100:00100000:3.0:1788361579.348979:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+59:40467:x1875232130881152:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361579.349023:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361579.349044:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616bfe lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc93 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.349135:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616bfe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc93 expref: 60 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.349151:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389400/0xf6a94c97d6616bfe lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x32:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc93 expref: 60 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.349170:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x32:0x0].0x0 (ffff9a8a996efa00) 00010000:00010000:3.0:1788361579.349173:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788361579.349176:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389400, rc 0) 00000100:00100000:3.0:1788361579.349227:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+60:40467:x1875232130881152:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 250us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361579.349234:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 537 00000100:00100000:2.0:1788361579.351283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361579.351367:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130881408 00000100:00100000:1.0:1788361579.351377:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130881408 00000100:00100000:1.0:1788361579.351440:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:1.0:1788361579.351449:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+60:40467:x1875232130881408:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1788361579.351694:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+61:40467:x1875232130881408:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 245us (418us total) trans 30064771551 rc 0/0 00000100:00100000:1.0:1788361579.351701:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:0.0:1788361579.658258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361579.658489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361579.658584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361579.658730:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130881536 00000100:00100000:3.0:1788361579.658740:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130881536 00000100:00100000:3.0:1788361579.658792:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:3.0:1788361579.658802:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130881536:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361579.658879:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130881536:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 79us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361579.658887:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:1.0:1788361579.659354:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130881664 00000100:00100000:1.0:1788361579.659359:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130881664 00000100:00100000:1.0:1788361579.659412:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:1.0:1788361579.659440:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130881664:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361579.659498:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130881664:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 59us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361579.659505:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00080000:3.0:1788361579.659780:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361579.661195:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130881792 00000100:00100000:2.0:1788361579.661205:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130881792 00000100:00100000:2.0:1788361579.661319:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:2.0:1788361579.661328:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898af37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130881792:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361579.661405:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898af37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130881792:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 77us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361579.661412:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00080000:3.0:1788361579.664646:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788361579.704186:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771220 is committed 00000001:00080000:1.0:1788361579.704375:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771551 is committed 00000004:00080000:1.0:1788361579.704401:0:5819:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 20 committed 00000020:00080000:1.0:1788361579.704434:0:5819:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a8a90a333c0 refcount 2 committed 0 result 0 batchid 25769803908 00000020:00080000:1.0:1788361579.704439:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ac138c800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a8a90a33000 00000020:00080000:1.0:1788361579.704452:0:5819:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff9a8ac138c400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a898672d000 00000100:00100000:3.0:1788361579.704566:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361579.704587:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144253568:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788361579.704652:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361579.704680:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144253568 00000100:00100000:1.0:1788361579.704687:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144253568 00000100:00100000:3.0:1788361579.704756:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788361579.704764:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144253568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788361579.704786:0:35983:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:207 count 1 00000020:00080000:2.0:1788361579.704791:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 25769803908 committed batchid 25769803907 00002000:00010000:3.0:1788361579.704819:0:35983:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xcf:0x0] initial LVB size: 24, mtime: 0x6a983b56, atime: 0x6a983b56, ctime: 0x6a983b56, blocks: 0xb 00010000:00010000:3.0:1788361579.704827:0:35983:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097aa6b9c/0xf6a94c97d6616c05 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.704843:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=969s v=(0 0) 00010000:00010000:3.0:1788361579.704847:0:35983:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xcf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788361579.704854:0:35983:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097aa6b9c/0xf6a94c97d6616c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.704868:0:35983:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097aa6b9c/0xf6a94c97d6616c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.704877:0:35983:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097aa6b9c/0xf6a94c97d6616c05 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.704885:0:35983:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097aa6b9c/0xf6a94c97d6616c05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361579.704914:0:35983:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1788361579.704925:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803907 00010000:00010000:1.0:1788361579.705501:0:35335:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788361579.705509:0:35335:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097aa6b9c/0xf6a94c97d6616c05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.705518:0:35335:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389a00 already unused, calling callback (ffffffffc1589400) 00010000:00010000:1.0:1788361579.705523:0:35335:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097aa6b9c/0xf6a94c97d6616c05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.705533:0:35335:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097aa6b9c/0xf6a94c97d6616c05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.705555:0:35335:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097aa6b9c/0xf6a94c97d6616c05 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361579.705563:0:35335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097aa6b9c/0xf6a94c97d6616c05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xcf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 35983 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361579.705578:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144253568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 813us (923us total) trans 30064771221 rc 0/0 00000100:00100000:3.0:1788361579.705587:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00010000:1.0:1788361579.705587:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361579.705590:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361579.705593:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361579.705725:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771220 gen 2 00000004:00080000:0.0:1788361579.705732:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 30064771220 committed transno 30064771220 00000100:00100000:0.0:1788361579.705751:0:3311:0:(client.c:3159:ptlrpc_free_committed()) @@@ stopping search req@ffff9a8a8ae12d80 x1875232144253568/t30064771221(30064771221) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788361595 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788361579.705762:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9a8a8ae12d80/2, rc 0, transno 30064771221 00000100:00100000:0.0:1788361579.705767:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144253568:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788361579.937192:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361580.961283:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361581.792978:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361581.792985:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361581.793260:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:2.0:1788361581.793267:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361581.984443:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361582.009235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361582.009446:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130881920 00000100:00100000:0.0:1788361582.009456:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130881920 00000100:00100000:0.0:1788361582.009532:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 538 00000100:00100000:0.0:1788361582.009542:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+52:40413:x1875232130881920:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788361582.009651:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+52:40413:x1875232130881920:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 110us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361582.009658:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 538 00000100:00080000:3.0:1788361582.009858:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361582.012543:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361582.012705:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130882176 00000100:00100000:3.0:1788361582.012714:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130882176 00000100:00100000:3.0:1788361582.012764:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:3.0:1788361582.012772:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+52:40413:x1875232130882176:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788361582.013258:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+53:40413:x1875232130882176:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 485us (723us total) trans 30064771552 rc 0/0 00000100:00100000:3.0:1788361582.013353:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:1.0:1788361582.752262:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144254080:0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.752283:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144253696:0@lo:400:kworker.0 00000100:00100000:0.0:1788361582.752336:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144253824:0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.753478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361582.753521:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144254208:0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.753584:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361582.753618:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144253696 00000100:00100000:3.0:1788361582.753623:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144253696 00000100:00100000:3.0:1788361582.753654:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788361582.753659:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144253696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.753695:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144253696:12345-0@lo:400:kworker.0 Request processed in 35us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361582.753699:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788361582.753776:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144254208 00000100:00100000:3.0:1788361582.753779:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144254208 00000100:00100000:3.0:1788361582.753805:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788361582.753809:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144254208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.753915:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144254208:12345-0@lo:400:kworker.0 Request processed in 106us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361582.753920:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788361582.753935:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361582.753956:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144253696:0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.753964:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf130a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144254208:0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.754020:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144253952:0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.754038:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361582.754050:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144254464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361582.754063:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361582.754081:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144254464 00000100:00100000:3.0:1788361582.754099:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144254464 00000100:00100000:3.0:1788361582.754129:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788361582.754134:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144254464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361582.754168:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361582.754198:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144254464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361582.754203:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788361582.754215:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361582.754231:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144254464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361582.754266:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144253952 00000100:00100000:3.0:1788361582.754269:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144253952 00000100:00100000:3.0:1788361582.754288:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788361582.754293:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144253952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.754319:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144253952:12345-0@lo:400:kworker.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361582.754327:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788361582.754411:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144253952:0@lo:400:kworker.0 00000100:00100000:0.0:1788361582.758120:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361582.758195:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361582.758249:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144254080 00000100:00100000:1.0:1788361582.758257:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144254080 00000100:00100000:1.0:1788361582.758299:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788361582.758308:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144254080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361582.758345:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144254336:0@lo:400:kworker.0 00000100:00100000:1.0:1788361582.758372:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144254080:12345-0@lo:400:kworker.0 Request processed in 64us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361582.758381:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788361582.758387:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361582.758919:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144253824 00000100:00100000:3.0:1788361582.758924:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144253824 00000100:00100000:3.0:1788361582.758966:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788361582.759212:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144253824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361582.759257:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144253824:12345-0@lo:400:kworker.0 Request processed in 48us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361582.759263:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788361582.759283:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361582.759657:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144254336 00000100:00100000:1.0:1788361582.759663:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144254336 00000100:00100000:1.0:1788361582.759704:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788361582.759712:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144253824:0@lo:400:kworker.0 00000100:00100000:1.0:1788361582.759714:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144254336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361582.759768:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144254336:12345-0@lo:400:kworker.0 Request processed in 56us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361582.759776:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1788361582.759811:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361582.760484:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf131880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144254336:0@lo:400:kworker.0 00000100:00100000:0.0:1788361582.760497:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144254080:0@lo:400:kworker.0 00000001:02000400:2.0:1788361582.964260:0:40079:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 13a: Test auto RW-PCC create caching for UID/GID rule ========================================================== 11:06:22 (1788361582) 00010000:00010000:3.0:1788361583.008877:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361583.087948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361583.088110:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130882432 00000100:00100000:3.0:1788361583.088119:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130882432 00000100:00100000:3.0:1788361583.088172:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 539 00000100:00100000:3.0:1788361583.088183:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+53:41099:x1875232130882432:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788361583.088208:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361583.088228:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fc9a expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088301:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c13 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088314:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088327:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088343:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088349:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088354:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088746:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616c21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088756:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616c21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088763:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616c21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361583.088772:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788361583.088905:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088913:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c13 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088920:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088926:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361583.088931:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088942:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c13 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088953:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9a8a890fa600) 00010000:00010000:3.0:1788361583.088956:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.088960:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088965:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088974:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088979:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c1a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088985:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088990:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361583.088993:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.088998:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c1a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.089005:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9a8a996efd00) 00010000:00010000:3.0:1788361583.089007:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.089009:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c1a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.089018:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.089330:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc9a expref: 56 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.089344:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616c21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc9a expref: 55 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.089351:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:3.0:1788361583.089353:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.089355:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389a00, rc 0) 00000100:00100000:3.0:1788361583.089424:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:41099:x1875232130882432:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1243us (1484us total) trans 30064771553 rc 0/0 00000100:00100000:3.0:1788361583.089433:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 539 00000100:00100000:2.0:1788361583.095452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361583.095498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.095548:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130882688 00000100:00100000:1.0:1788361583.095558:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130882688 00000100:00100000:0.0:1788361583.095590:0:38408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130882560 00000100:00100000:0.0:1788361583.095596:0:38408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130882560 00000100:00100000:1.0:1788361583.095627:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 540 00000100:00100000:1.0:1788361583.095638:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+56:41099:x1875232130882688:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788361583.095746:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+56:41099:x1875232130882688:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 109us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361583.095753:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 540 00000100:00100000:0.0:1788361583.095821:0:38408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1788361583.095832:0:38408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130882560:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788361583.095851:0:38408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788361583.095874:0:38408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389a00/0xf6a94c97d6616c21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc9a expref: 55 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.095892:0:38408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9a8a890fa500) 00010000:00010000:0.0:1788361583.095897:0:38408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788361583.095933:0:38408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c05f3090-241b-43d5-9787-08721e3d4333+54:2350:x1875232130882560:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 104us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361583.095939:0:38408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1788361583.186639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361583.186800:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130882816 00000100:00100000:3.0:1788361583.186810:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130882816 00000100:00100000:3.0:1788361583.186876:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 541 00000100:00100000:3.0:1788361583.186886:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+54:41120:x1875232130882816:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1788361583.186905:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361583.186931:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fca1 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187003:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187018:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187030:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187043:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187050:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187056:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187365:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187374:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187381:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187387:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361583.187408:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187421:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187433:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:3.0:1788361583.187437:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.187442:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187448:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187460:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187466:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187472:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187476:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361583.187479:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187485:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187492:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff9a8a996efd00) 00010000:00010000:3.0:1788361583.187494:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.187497:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187503:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187544:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fca1 expref: 55 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187561:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:3.0:1788361583.187568:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.187573:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fca1 expref: 55 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.187583:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1389200, rc 0) 00000100:00100000:3.0:1788361583.187643:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+54:41120:x1875232130882816:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 757us (1011us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361583.187651:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 541 00000100:00100000:1.0:1788361583.196802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361583.197899:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130883072 00000100:00100000:3.0:1788361583.197911:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130883072 00000100:00100000:3.0:1788361583.197973:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 542 00000100:00100000:3.0:1788361583.197984:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+54:41120:x1875232130883072:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:3.0:1788361583.198039:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361583.198064:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902600/0xf6a94c97d6616bb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fc7e expref: 54 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.198081:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:3.0:1788361583.198159:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788361583.198410:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c44 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.198423:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.198433:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.198445:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.198451:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.198457:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361583.199450:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00010000:00010000:3.0:1788361583.199463:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.199470:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c44 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.199477:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c44 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.199483:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361583.199488:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c44 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.199495:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c44 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.199506:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a996efd00) 00010000:00010000:3.0:1788361583.199510:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.199513:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c44 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.199522:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c44 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788361583.199536:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000076d2c524 reply state 000000006f34aa42 transno 30064771554 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361583.199545:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788361583.199720:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:41120:x1875232130883072:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 1737us (2924us total) trans 30064771554 rc 0/0 00000100:00100000:3.0:1788361583.199728:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 542 00010000:00010000:0.0:1788361583.203184:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.203201:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.203207:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.203213:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361583.203218:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.203226:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.203242:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff9a8a996ef900) 00010000:00010000:0.0:1788361583.203245:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361583.203248:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.203271:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389c00/0xf6a94c97d6616c4b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361583.210039:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361583.210600:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130883200 00000100:00100000:2.0:1788361583.210610:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130883200 00000100:00100000:2.0:1788361583.210673:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 543 00000100:00100000:2.0:1788361583.210684:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+54:41121:x1875232130883200:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:2.0:1788361583.210709:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361583.210735:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616c52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fca8 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.210798:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616c59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.210812:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616c59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.210823:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616c59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361583.210879:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704 00000004:00200000:2.0:1788361583.210883:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 22 stripe count 1 MDT count 1 00000004:00010000:2.0:1788361583.210925:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616c59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.210949:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616c52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fca8 expref: 56 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.210967:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902a00/0xf6a94c97d6616c59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fca8 expref: 55 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.210977:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:2.0:1788361583.210980:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788361583.211016:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902a00, rc 0) 00000100:00100000:2.0:1788361583.211186:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:41121:x1875232130883200:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 504us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361583.211195:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 543 00000100:00100000:1.0:1788361583.213254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361583.213351:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130883328 00000100:00100000:3.0:1788361583.213359:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130883328 00000100:00100000:3.0:1788361583.213460:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 544 00000100:00100000:3.0:1788361583.213469:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:41121:x1875232130883328:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:3.0:1788361583.213486:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361583.213502:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fcaf expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213559:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213573:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213584:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213596:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213608:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213614:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213718:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616c75 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213726:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616c75 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213733:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616c75 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788361583.213767:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00000004:00200000:3.0:1788361583.213771:0:35345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788361583.213795:0:35345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616c75 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213819:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213827:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213834:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213840:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389e00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361583.213844:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213852:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213863:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:3.0:1788361583.213866:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.213870:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213875:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389e00/0xf6a94c97d6616c67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213887:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213893:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213899:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213904:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361583.213907:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213923:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213931:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff9a8a996efd00) 00010000:00010000:3.0:1788361583.213934:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.213937:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213946:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616c6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213974:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616c60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcaf expref: 57 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213987:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616c75 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcaf expref: 56 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.213994:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a996ef000) 00010000:00010000:3.0:1788361583.213996:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788361583.213999:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388e00, rc 0) 00000100:00100000:3.0:1788361583.214060:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+56:41121:x1875232130883328:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 593us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361583.214067:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 544 00000100:00100000:3.0:1788361583.216517:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.216704:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130883584 00000100:00100000:1.0:1788361583.216713:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130883584 00000100:00100000:1.0:1788361583.216819:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 545 00000100:00100000:1.0:1788361583.216829:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+56:41121:x1875232130883584:12345-192.168.203.60@tcp:36:chmod.0 00010000:00010000:1.0:1788361583.216880:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361583.216904:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388e00/0xf6a94c97d6616c75 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcaf expref: 56 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.216922:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a996ef000) 00010000:00010000:1.0:1788361583.216933:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361583.216954:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.216967:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.216976:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788361583.218172:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000b2db2dc reply state 00000000d9250ff7 transno 30064771555 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361583.218193:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788361583.218220:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00000100:00100000:1.0:1788361583.218317:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+57:41121:x1875232130883584:12345-192.168.203.60@tcp:36:chmod.0 Request processed in 1487us (1805us total) trans 30064771555 rc 0/0 00000100:00100000:1.0:1788361583.218325:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 545 00010000:00010000:1.0:1788361583.219863:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.219874:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.219879:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.219884:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.219887:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.219892:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.219903:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8aa8ee1e00) 00010000:00010000:1.0:1788361583.219905:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788361583.219908:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.219912:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616c7c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361583.226402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361583.226496:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130883712 00000100:00100000:0.0:1788361583.226503:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130883712 00000100:00100000:0.0:1788361583.226564:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 546 00000100:00100000:0.0:1788361583.226574:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+56:41122:x1875232130883712:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1788361583.226598:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788361583.226628:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf400/0xf6a94c97d6616c83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fcb6 expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226695:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616c8a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226710:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616c8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226721:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616c8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226736:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616c91 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226742:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616c91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226747:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616c91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226828:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616c98 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226845:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616c98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226849:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616c98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361583.226874:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00000004:00200000:0.0:1788361583.226876:0:37122:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788361583.226890:0:37122:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616c98 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226899:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616c8a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226903:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616c8a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226907:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616c8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226911:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65ce000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361583.226915:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616c8a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226921:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616c8a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226932:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:0.0:1788361583.226935:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361583.226940:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616c8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226956:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65ce000/0xf6a94c97d6616c8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226971:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616c91 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226975:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616c91 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226978:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616c91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226981:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ab65cf000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:0.0:1788361583.226983:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616c91 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226986:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616c91 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226991:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x43c533c2 (ffff9a8a890c3500) 00010000:00010000:0.0:1788361583.226993:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788361583.226994:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616c91 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.226998:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf000/0xf6a94c97d6616c91 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x43c533c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.227022:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf400/0xf6a94c97d6616c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcb6 expref: 58 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.227046:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ab65cf800/0xf6a94c97d6616c98 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcb6 expref: 57 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.227054:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:0.0:1788361583.227056:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788361583.227058:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ab65cf800, rc 0) 00000100:00100000:0.0:1788361583.227125:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+57:41122:x1875232130883712:12345-192.168.203.60@tcp:101:rm.0 Request processed in 551us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361583.227130:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 546 00000100:00100000:0.0:1788361583.228457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361583.228542:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130883840 00000100:00100000:3.0:1788361583.228550:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130883840 00000100:00100000:3.0:1788361583.228600:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 547 00000100:00100000:3.0:1788361583.228609:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+57:41122:x1875232130883840:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:3.0:1788361583.228625:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361583.228640:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616c9f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fcbd expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228690:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616ca6 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228701:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616ca6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228710:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616ca6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228721:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616cad lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228728:0:35345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616cad lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228735:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616cad lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228788:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616ca6 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228795:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616ca6 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228800:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616ca6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228806:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1389200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361583.228810:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616ca6 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228817:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616ca6 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228827:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:3.0:1788361583.228830:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.228834:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616ca6 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228840:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1389200/0xf6a94c97d6616ca6 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228851:0:35345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616cad lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228857:0:35345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616cad lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228863:0:35345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616cad lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228868:0:35345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8ac1388000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:3.0:1788361583.228871:0:35345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616cad lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228877:0:35345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616cad lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228884:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff9a8a996efd00) 00010000:00010000:3.0:1788361583.228886:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.228888:0:35345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616cad lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228893:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616cad lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228922:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616c9f lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcbd expref: 58 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228931:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:3.0:1788361583.228934:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788361583.228937:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616c9f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcbd expref: 58 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.228946:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388800, rc 0) 00000100:00100000:3.0:1788361583.228999:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+57:41122:x1875232130883840:12345-192.168.203.60@tcp:101:rm.0 Request processed in 392us (546us total) trans 0 rc 301/301 00000100:00100000:3.0:1788361583.229006:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 547 00000100:00100000:3.0:1788361583.230877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.230992:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130883968 00000100:00100000:1.0:1788361583.231011:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130883968 00000100:00100000:1.0:1788361583.231070:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 548 00000100:00100000:1.0:1788361583.231079:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+57:41122:x1875232130883968:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:1.0:1788361583.231118:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361583.231142:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616cb4 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fcc4 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231197:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616cbb lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231210:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616cbb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231221:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616cbb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231235:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616cc2 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231243:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616cc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231250:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616cc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231307:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616cbb lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231314:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616cbb lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231320:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616cbb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231333:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.231337:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616cbb lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231345:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616cbb lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231357:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:1.0:1788361583.231360:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.231364:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616cbb lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231371:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616cbb lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231384:0:35347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616cc2 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231388:0:35347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616cc2 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231405:0:35347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616cc2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231409:0:35347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.231411:0:35347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616cc2 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231415:0:35347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616cc2 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231427:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff9a8aa8ee1e00) 00010000:00010000:1.0:1788361583.231429:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.231431:0:35347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616cc2 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231435:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616cc2 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231461:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616cb4 lrc: 1/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcc4 expref: 58 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231471:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:1.0:1788361583.231473:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.231476:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616cb4 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcc4 expref: 58 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.231485:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9200, rc 0) 00000100:00100000:1.0:1788361583.231553:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+57:41122:x1875232130883968:12345-192.168.203.60@tcp:101:rm.0 Request processed in 475us (682us total) trans 0 rc 301/301 00000100:00100000:1.0:1788361583.231560:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 548 00000100:00100000:0.0:1788361583.259188:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361583.259384:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130884224 00000100:00100000:2.0:1788361583.259404:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130884224 00000100:00100000:2.0:1788361583.259516:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 549 00000100:00100000:2.0:1788361583.259526:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+57:41129:x1875232130884224:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:2.0:1788361583.259545:0:37122:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361583.259563:0:37122:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616cc9 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fccb expref: -99 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.259799:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616cd0 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.259815:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616cd0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.259827:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616cd0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.259841:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.259848:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.259855:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260812:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260826:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260834:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361583.260842:0:37122:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:2.0:1788361583.260865:0:37122:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616cd0 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260871:0:37122:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616cd0 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260878:0:37122:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616cd0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260884:0:37122:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:2.0:1788361583.260888:0:37122:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616cd0 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260896:0:37122:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616cd0 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260907:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:2.0:1788361583.260910:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788361583.260914:0:37122:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616cd0 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260921:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616cd0 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788361583.260938:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c4eae19b reply state 00000000428931a3 transno 30064771556 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361583.260947:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788361583.260973:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616cc9 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fccb expref: 60 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260987:0:37122:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fccb expref: 59 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.260994:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:2.0:1788361583.260997:0:37122:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788361583.260999:0:37122:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903a00, rc 0) 00000100:00100000:2.0:1788361583.261235:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+60:41129:x1875232130884224:12345-192.168.203.60@tcp:101:dd.500 Request processed in 1710us (2054us total) trans 30064771556 rc 0/0 00000100:00100000:2.0:1788361583.261244:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 549 00010000:00010000:1.0:1788361583.265762:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.265781:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.265789:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.265812:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903600 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.265816:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.265824:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.265841:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788361583.265844:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.265849:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.265855:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903600/0xf6a94c97d6616cd7 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361583.266871:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.266917:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130884480 00000100:00100000:1.0:1788361583.266927:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130884480 00000100:00100000:1.0:1788361583.266983:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:1.0:1788361583.266992:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+59:41129:x1875232130884480:12345-192.168.203.60@tcp:35:dd.500 00000100:00100000:0.0:1788361583.267156:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144254592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361583.267210:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361583.267302:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144254592 00000100:00100000:2.0:1788361583.267307:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144254592 00000100:00100000:2.0:1788361583.267460:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788361583.267475:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144254592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361583.267498:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361583.267546:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144254592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361583.267554:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788361583.267593:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144254592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361583.267731:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+60:41129:x1875232130884480:12345-192.168.203.60@tcp:35:dd.500 Request processed in 739us (865us total) trans 30064771557 rc 0/0 00000100:00100000:1.0:1788361583.267739:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:0.0:1788361583.320063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361583.320486:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130884736 00000100:00100000:2.0:1788361583.320496:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130884736 00000100:00100000:2.0:1788361583.320559:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 550 00000100:00100000:2.0:1788361583.320569:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+60:41139:x1875232130884736:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361583.320593:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361583.320613:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616cec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fcd2 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788361583.320724:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00010000:00010000:2.0:1788361583.320845:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616cec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcd2 expref: 62 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.320860:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:2.0:1788361583.320863:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788361583.320868:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903400/0xf6a94c97d6616cec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcd2 expref: 62 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.320881:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84903400, rc 0) 00000100:00100000:2.0:1788361583.320947:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+61:41139:x1875232130884736:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 378us (890us total) trans 30064771558 rc 301/301 00000100:00100000:2.0:1788361583.320954:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 550 00000100:00100000:3.0:1788361583.323025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361583.323176:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130884992 00000100:00100000:0.0:1788361583.323241:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130884992 00000100:00100000:0.0:1788361583.323332:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:0.0:1788361583.323343:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88350050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+61:41139:x1875232130884992:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1788361583.323597:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88350050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+62:41139:x1875232130884992:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 256us (578us total) trans 30064771559 rc 0/0 00000100:00100000:0.0:1788361583.323605:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:0.0:1788361583.369000:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.369208:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130885248 00000100:00100000:1.0:1788361583.369219:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130885248 00000100:00100000:1.0:1788361583.369353:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 551 00000100:00100000:1.0:1788361583.369364:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+62:41145:x1875232130885248:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:1.0:1788361583.369397:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361583.369421:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616cfa lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fcd9 expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.369512:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616d01 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.369526:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616d01 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.369538:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616d01 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361583.369549:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:1.0:1788361583.369678:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616cfa lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcd9 expref: 65 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.369707:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616d01 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcd9 expref: 64 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.369714:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:1.0:1788361583.369717:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361583.369720:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9600, rc 0) 00000100:00100000:1.0:1788361583.369781:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+64:41145:x1875232130885248:12345-192.168.203.60@tcp:101:dd.500 Request processed in 419us (790us total) trans 30064771560 rc 0/0 00000100:00100000:1.0:1788361583.369789:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 551 00000100:00100000:0.0:1788361583.372639:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361583.372741:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130885504 00000100:00100000:2.0:1788361583.372750:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130885504 00000100:00100000:2.0:1788361583.372833:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 136 00000100:00100000:2.0:1788361583.372843:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+64:41145:x1875232130885504:12345-192.168.203.60@tcp:35:dd.500 00000100:00100000:2.0:1788361583.373065:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+65:41145:x1875232130885504:12345-192.168.203.60@tcp:35:dd.500 Request processed in 222us (433us total) trans 30064771561 rc 0/0 00000100:00100000:2.0:1788361583.373072:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 136 00000100:00100000:3.0:1788361583.409386:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361583.411127:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130885760 00000100:00100000:2.0:1788361583.411140:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130885760 00000100:00100000:2.0:1788361583.411209:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 552 00000100:00100000:2.0:1788361583.411219:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+65:41151:x1875232130885760:12345-192.168.203.60@tcp:36:truncate.500 00010000:00010000:2.0:1788361583.411272:0:37122:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361583.411296:0:37122:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9600/0xf6a94c97d6616d01 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcd9 expref: 65 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.411314:0:37122:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:2.0:1788361583.411319:0:37122:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788361583.411517:0:37122:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.411530:0:37122:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.411540:0:37122:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788361583.411588:0:37122:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771562 00000004:00010000:2.0:1788361583.411610:0:37122:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bbe56081 reply state 00000000f21d9154 transno 30064771563 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361583.411618:0:37122:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788361583.411737:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+67:41151:x1875232130885760:12345-192.168.203.60@tcp:36:truncate.500 Request processed in 518us (2359us total) trans 30064771563 rc 0/0 00000100:00100000:2.0:1788361583.411745:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 552 00000020:00080000:2.0:1788361583.411750:0:37122:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788361583.415649:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.415666:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.415692:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.415698:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.415702:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.415710:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.415727:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:1.0:1788361583.415730:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.415734:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.415740:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616d0f lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 37122 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361583.444957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.445151:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130885888 00000100:00100000:1.0:1788361583.445160:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130885888 00000100:00100000:1.0:1788361583.445253:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 553 00000100:00100000:1.0:1788361583.445272:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+66:41157:x1875232130885888:12345-192.168.203.60@tcp:101:truncate.500 00010000:00010000:1.0:1788361583.445298:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361583.445324:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d16 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fce0 expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445410:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d1d lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445425:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d1d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445450:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d1d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445470:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d24 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445477:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445484:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445588:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d2b lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445594:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d2b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445599:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d2b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361583.445623:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 256 00000004:00200000:1.0:1788361583.445627:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361583.445647:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d2b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445658:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d2b lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445666:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d1d lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445681:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d1d lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445686:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d1d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445690:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.445692:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d1d lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445698:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d1d lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445706:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:1.0:1788361583.445708:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.445711:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d1d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445715:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d1d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445724:0:35346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d24 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445728:0:35346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d24 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445731:0:35346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d24 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445734:0:35346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8800 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.445741:0:35346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d24 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445745:0:35346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d24 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445751:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff9a8aa8ee1e00) 00010000:00010000:1.0:1788361583.445753:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.445756:0:35346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d24 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445761:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d24 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445790:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d16 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fce0 expref: 68 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445803:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d2b lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fce0 expref: 67 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.445809:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:1.0:1788361583.445811:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361583.445813:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:1.0:1788361583.445875:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+67:41157:x1875232130885888:12345-192.168.203.60@tcp:101:truncate.500 Request processed in 614us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361583.445882:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 553 00000100:00100000:0.0:1788361583.447463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.447531:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130886144 00000100:00100000:1.0:1788361583.447539:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130886144 00000100:00100000:1.0:1788361583.447636:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 554 00000100:00100000:1.0:1788361583.447646:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+67:41157:x1875232130886144:12345-192.168.203.60@tcp:36:truncate.500 00010000:00010000:1.0:1788361583.447710:0:35347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788361583.447732:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d2b lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fce0 expref: 67 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.447753:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:1.0:1788361583.447757:0:35347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361583.447933:0:35347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.447946:0:35347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.447955:0:35347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788361583.448017:0:35347:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771564 00000004:00010000:1.0:1788361583.448060:0:35347:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af4bc0ed reply state 0000000048b99e88 transno 30064771565 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361583.448069:0:35347:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361583.448173:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+69:41157:x1875232130886144:12345-192.168.203.60@tcp:36:truncate.500 Request processed in 525us (712us total) trans 30064771565 rc 0/0 00000100:00100000:1.0:1788361583.448180:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 554 00000020:00080000:1.0:1788361583.448185:0:35347:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788361583.449906:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.449919:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.449927:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.449944:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b8400 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.449948:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.449954:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.449964:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:1.0:1788361583.449966:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.449969:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.449973:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d32 lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35347 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361583.477012:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.477126:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130886400 00000100:00100000:1.0:1788361583.477136:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130886400 00000100:00100000:1.0:1788361583.477190:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 555 00000100:00100000:1.0:1788361583.477201:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+68:41163:x1875232130886400:12345-192.168.203.60@tcp:101:dd.500 00010000:00010000:1.0:1788361583.477225:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361583.477245:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d39 lrc: 2/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fce7 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477437:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d40 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477452:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d40 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477464:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d40 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477492:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d47 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477500:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d47 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477507:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d47 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477583:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d4e lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477593:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d4e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477600:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d4e lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361583.477610:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 2048 00010000:00010000:1.0:1788361583.477708:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d40 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477716:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d40 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477723:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d40 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477729:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9a00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.477734:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d40 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477833:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d40 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477846:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:1.0:1788361583.477849:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.477854:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d40 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477860:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d40 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477874:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d47 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477880:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d47 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477887:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d47 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477892:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9200 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.477895:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d47 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477900:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d47 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477907:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff9a8aa8ee1e00) 00010000:00010000:1.0:1788361583.477910:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.477913:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d47 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477925:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d47 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477969:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d39 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fce7 expref: 71 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477984:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d4e lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fce7 expref: 70 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.477991:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:1.0:1788361583.477993:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788361583.477996:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8800, rc 0) 00000100:00100000:1.0:1788361583.478175:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+70:41163:x1875232130886400:12345-192.168.203.60@tcp:101:dd.500 Request processed in 976us (1172us total) trans 30064771566 rc 0/0 00000100:00100000:1.0:1788361583.478183:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 555 00000100:00100000:3.0:1788361583.480798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361583.480844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.480850:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130886656 00000100:00100000:1.0:1788361583.480861:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130886656 00000100:00100000:1.0:1788361583.480932:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 556 00000100:00100000:1.0:1788361583.480942:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+70:41163:x1875232130886656:12345-192.168.203.60@tcp:36:dd.500 00000100:00100000:2.0:1788361583.481048:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130886784 00000100:00100000:2.0:1788361583.481053:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130886784 00000100:00100000:2.0:1788361583.481119:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:2.0:1788361583.481127:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+71:2350:x1875232130886784:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361583.481136:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361583.481155:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8800/0xf6a94c97d6616d4e lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fce7 expref: 71 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.481173:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:2.0:1788361583.481186:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788361583.481230:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 3/0,1 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.481246:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361583.481251:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+71:2350:x1875232130886784:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 123us (407us total) trans 0 rc 0/0 00010000:00010000:1.0:1788361583.481261:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361583.481262:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000001:00080000:1.0:1788361583.481351:0:35346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 30064771567 00000004:00010000:1.0:1788361583.481379:0:35346:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000dbd4c70e reply state 000000003a569d29 transno 30064771568 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361583.481402:0:35346:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788361583.481467:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+72:41163:x1875232130886656:12345-192.168.203.60@tcp:36:dd.500 Request processed in 526us (677us total) trans 30064771568 rc 0/0 00000100:00100000:1.0:1788361583.481474:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 556 00000020:00080000:1.0:1788361583.481478:0:35346:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788361583.482622:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 3/0,1 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.482630:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 2/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.482635:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.482639:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a841b9000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.482642:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 3/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.482646:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 4/0,0 mode: PW/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.482654:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:1.0:1788361583.482656:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.482659:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 2/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.482689:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d5c lrc: 0/0,0 mode: --/PW res: [0x2000032e1:0x37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361583.484066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361583.484348:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130887040 00000100:00100000:3.0:1788361583.484358:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130887040 00000100:00100000:3.0:1788361583.484419:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:3.0:1788361583.484429:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+71:41163:x1875232130887040:12345-192.168.203.60@tcp:35:dd.500 00000100:00100000:3.0:1788361583.484734:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0564700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+72:41163:x1875232130887040:12345-192.168.203.60@tcp:35:dd.500 Request processed in 305us (675us total) trans 30064771569 rc 0/0 00000100:00100000:3.0:1788361583.484743:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:3.0:1788361583.520905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.520993:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130887296 00000100:00100000:1.0:1788361583.521003:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130887296 00000100:00100000:1.0:1788361583.521060:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 557 00000100:00100000:1.0:1788361583.521069:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+72:41173:x1875232130887296:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1788361583.521123:0:35347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361583.521145:0:35347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fcee expref: -99 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361583.521263:0:35347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00010000:00010000:1.0:1788361583.521382:0:35347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcee expref: 74 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.521409:0:35347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a8a83c0b900) 00010000:00010000:1.0:1788361583.521413:0:35347:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788361583.521418:0:35347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcee expref: 74 pid: 35347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.521432:0:35347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9000, rc 0) 00000100:00100000:1.0:1788361583.521489:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+73:41173:x1875232130887296:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 420us (592us total) trans 30064771570 rc 301/301 00000100:00100000:1.0:1788361583.521496:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 557 00000100:00100000:0.0:1788361583.524761:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361583.524869:0:35348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130887552 00000100:00100000:3.0:1788361583.524879:0:35348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130887552 00000100:00100000:3.0:1788361583.524981:0:35348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:3.0:1788361583.524991:0:35348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+73:41173:x1875232130887552:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1788361583.525555:0:35348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0565f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c05f3090-241b-43d5-9787-08721e3d4333+74:41173:x1875232130887552:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 563us (800us total) trans 30064771571 rc 0/0 00000100:00100000:3.0:1788361583.525562:0:35348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:0.0:1788361583.568065:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.568241:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130887680 00000100:00100000:1.0:1788361583.568251:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130887680 00000100:00100000:1.0:1788361583.568308:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 558 00000100:00100000:1.0:1788361583.568461:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+74:41179:x1875232130887680:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:1.0:1788361583.568486:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361583.568508:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fcf5 expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.568581:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d78 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.568597:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.568609:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361583.568667:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x36:0x0]: returning size 512 00000004:00200000:1.0:1788361583.568671:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361583.568691:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d78 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.568714:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9000/0xf6a94c97d6616d71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcf5 expref: 76 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.568732:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b8400/0xf6a94c97d6616d78 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcf5 expref: 75 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.568739:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:1.0:1788361583.568742:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788361583.568746:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b8400, rc 0) 00000100:00100000:1.0:1788361583.568842:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0567100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+75:41179:x1875232130887680:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 513us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361583.568858:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 558 00000100:00100000:2.0:1788361583.572745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361583.572828:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130887808 00000100:00100000:1.0:1788361583.572838:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130887808 00000100:00100000:1.0:1788361583.572906:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 559 00000100:00100000:1.0:1788361583.572917:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+75:41179:x1875232130887808:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:1.0:1788361583.572937:0:35346:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788361583.572957:0:35346:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d7f lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fcfc expref: -99 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.573044:0:35346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.573059:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.573070:0:35346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361583.573146:0:35346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00000004:00200000:1.0:1788361583.573151:0:35346:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361583.573171:0:35346:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.573183:0:35346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.573203:0:35346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9200/0xf6a94c97d6616d7f lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcfc expref: 77 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.573222:0:35346:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcfc expref: 76 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.573241:0:35346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:1.0:1788361583.573244:0:35346:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361583.573248:0:35346:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a841b9a00, rc 0) 00000100:00100000:1.0:1788361583.573312:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+76:41179:x1875232130887808:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 396us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361583.573319:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 559 00000100:00100000:0.0:1788361583.577069:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361583.578145:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130888064 00000100:00100000:3.0:1788361583.578157:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130888064 00000100:00100000:3.0:1788361583.578214:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 560 00000100:00100000:3.0:1788361583.578223:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+76:41179:x1875232130888064:12345-192.168.203.60@tcp:101:lfs.500 00010000:00010000:3.0:1788361583.578244:0:35345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788361583.578264:0:35345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616d8d lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fd03 expref: -99 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.578361:0:35345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.578377:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fccb expref: 77 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.578386:0:35345:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcfc expref: 77 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.578783:0:35345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 5/0,1 mode: --/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.578822:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcfc expref: 77 pid: 35346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.578840:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcfc expref: 77 pid: 35346 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361583.579320:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae12680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144254720:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361583.579570:0:35345:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fccb expref: 77 pid: 37122 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.579581:0:35345:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fccb expref: 77 pid: 37122 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361583.579592:0:35345:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144254848:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361583.579619:0:35345:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8aa9ec13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361583.585827:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae12680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144254720:192.168.203.60@tcp:104: 00000100:00100000:3.0:1788361583.585844:0:35345:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae10e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:35345:1875232144254848:192.168.203.60@tcp:104: 00010000:00010000:3.0:1788361583.585872:0:35345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788361583.586022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361583.586172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361583.586367:0:35333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130888320 00000100:00100000:2.0:1788361583.586375:0:35333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130888320 00010000:00010000:2.0:1788361583.586421:0:35333:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcfc expref: 78 pid: 35346 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361583.586461:0:35331:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130888192 00000100:00100000:3.0:1788361583.586465:0:35331:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130888192 00010000:00010000:3.0:1788361583.586480:0:35331:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fccb expref: 79 pid: 37122 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788361583.586511:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:3.0:1788361583.586519:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+79:2350:x1875232130888320:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361583.586537:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361583.586543:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcfc expref: 79 pid: 35346 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.586555:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcfc expref: 79 pid: 35346 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.586575:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a841b9a00/0xf6a94c97d6616d86 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fcfc expref: 79 pid: 35346 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.586590:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:3.0:1788361583.586595:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.586604:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.586610:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361583.586664:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0566300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+78:2350:x1875232130888320:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 145us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361583.586672:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:3.0:1788361583.586689:0:35331:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:3.0:1788361583.586696:0:35331:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+77:2349:x1875232130888192:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788361583.586704:0:35331:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788361583.586709:0:35331:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fccb expref: 77 pid: 37122 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.586725:0:35331:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fccb expref: 77 pid: 37122 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.587334:0:35331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616cde lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fccb expref: 77 pid: 37122 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.587350:0:35331:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:3.0:1788361583.587354:0:35331:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,1 mode: --/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.587421:0:35331:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.587428:0:35331:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 4/0,1 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788361583.587457:0:35331:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788361583.587489:0:35331:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0564000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c05f3090-241b-43d5-9787-08721e3d4333+76:2349:x1875232130888192:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 792us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361583.587497:0:35331:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00010000:00010000:0.0:1788361583.588548:0:35345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.588561:0:35345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,1 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788361583.588582:0:35345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00010000:00010000:0.0:1788361583.588732:0:35345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388800/0xf6a94c97d6616d8d lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd03 expref: 77 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.588750:0:35345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd03 expref: 76 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788361583.588757:0:35345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:0.0:1788361583.588760:0:35345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788361583.588763:0:35345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8ac1388000, rc 0) 00000100:00100000:0.0:1788361583.588812:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+76:41179:x1875232130888064:12345-192.168.203.60@tcp:101:lfs.500 Request processed in 10589us (11751us total) trans 30064771572 rc 0/0 00000100:00100000:0.0:1788361583.588820:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 560 00000100:00100000:1.0:1788361583.612470:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361583.612695:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130888448 00000100:00100000:2.0:1788361583.612704:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130888448 00000100:00100000:2.0:1788361583.612754:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 561 00000100:00100000:2.0:1788361583.612762:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+76:41181:x1875232130888448:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1788361583.612783:0:37551:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788361583.612802:0:37551:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616da2 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xed6fdae0fb86fd0a expref: -99 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.612860:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d6616da9 lrc: 3/1,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.612874:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d6616da9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.612885:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d6616da9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.612898:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d6616db0 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.612904:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d6616db0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.612910:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d6616db0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.612992:0:37551:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.613001:0:37551:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 2/0,0 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd03 expref: 77 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.613008:0:37551:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 4/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.613037:0:37551:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd03 expref: 77 pid: 35345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.613049:0:37551:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd03 expref: 77 pid: 35345 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361583.613062:0:37551:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:37551:1875232144254976:192.168.203.60@tcp:104: 00000100:00100000:2.0:1788361583.613182:0:37551:0:(client.c:2705:ptlrpc_set_wait()) set ffff9a8ac0a6bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788361583.615514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361583.615633:0:37551:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:37551:1875232144254976:192.168.203.60@tcp:104: 00010000:00010000:2.0:1788361583.615656:0:37551:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788361583.616495:0:35349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130888704 00000100:00100000:1.0:1788361583.616505:0:35349:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130888704 00000100:00100000:1.0:1788361583.616568:0:35349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:1.0:1788361583.616577:0:35349:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+78:30910:x1875232130888704:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788361583.616825:0:35349:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c05f3090-241b-43d5-9787-08721e3d4333+79:30910:x1875232130888704:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 248us (1317us total) trans 30064771573 rc 0/0 00000100:00100000:1.0:1788361583.616833:0:35349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:3.0:1788361583.619561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361583.619719:0:36007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130888832 00000100:00100000:2.0:1788361583.619730:0:36007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130888832 00010000:00010000:2.0:1788361583.619775:0:36007:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd03 expref: 79 pid: 35345 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788361583.619819:0:36007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:2.0:1788361583.619828:0:36007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89810c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+79:2350:x1875232130888832:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788361583.619842:0:36007:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788361583.619849:0:36007:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 4/0,0 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd03 expref: 79 pid: 35345 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.619862:0:36007:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 3/0,0 mode: CW/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd03 expref: 79 pid: 35345 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.619884:0:36007:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8ac1388000/0xf6a94c97d6616d94 lrc: 0/0,0 mode: --/CW res: [0x2000032e1:0x37:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd03 expref: 79 pid: 35345 timeout: 1073 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.619910:0:36007:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:2.0:1788361583.619916:0:36007:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 3/1,0 mode: --/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x13/0x48 rrc: 3 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.619925:0:36007:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.619932:0:36007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 4/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788361583.619966:0:36007:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788361583.620167:0:36007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89810c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c05f3090-241b-43d5-9787-08721e3d4333+78:2350:x1875232130888832:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 339us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361583.620175:0:36007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00010000:00010000:1.0:1788361583.621409:0:37551:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621422:0:37551:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788361583.621468:0:37551:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000032e1:0x37:0x0]: returning size 0 00000004:00200000:1.0:1788361583.621473:0:37551:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788361583.621492:0:37551:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621507:0:37551:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621536:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d6616da9 lrc: 3/1,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621543:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d6616da9 lrc: 2/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621550:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d6616da9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621557:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84903000 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.621561:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d6616da9 lrc: 3/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621569:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d6616da9 lrc: 4/0,0 mode: CR/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621583:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0x0 (ffff9a8a890c3800) 00010000:00010000:1.0:1788361583.621586:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.621591:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d6616da9 lrc: 2/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621596:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903000/0xf6a94c97d6616da9 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621609:0:37551:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d6616db0 lrc: 3/1,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621616:0:37551:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d6616db0 lrc: 2/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621621:0:37551:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d6616db0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621632:0:37551:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9a8a84902c00 already unused, calling callback (ffffffffc1fc84f0) 00010000:00010000:1.0:1788361583.621635:0:37551:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d6616db0 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621642:0:37551:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d6616db0 lrc: 4/0,0 mode: PR/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621650:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x36:0x0].0xde1ac1b8 (ffff9a8a83c0bd00) 00010000:00010000:1.0:1788361583.621653:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788361583.621655:0:37551:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d6616db0 lrc: 2/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621661:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902c00/0xf6a94c97d6616db0 lrc: 0/0,0 mode: --/PR res: [0x2000032e1:0x36:0x0].0xde1ac1b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 37551 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621702:0:37551:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84903a00/0xf6a94c97d6616da2 lrc: 0/0,0 mode: --/CR res: [0x2000032e1:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd0a expref: 78 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621716:0:37551:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a8a84902200/0xf6a94c97d6616db7 lrc: 3/0,0 mode: PR/PR res: [0x2000032e1:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0xed6fdae0fb86fd0a expref: 77 pid: 37551 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788361583.621724:0:37551:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000032e1:0x37:0x0].0x0 (ffff9a8a83c0b600) 00010000:00010000:1.0:1788361583.621726:0:37551:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788361583.621729:0:37551:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a8a84902200, rc 0) 00000100:00100000:1.0:1788361583.621788:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+77:41181:x1875232130888448:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 9026us (9327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361583.621798:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 561 00000040:00080000:1.0:1788361583.841324:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361583.841344:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361583.841845:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 3 00000040:00080000:1.0:1788361583.841853:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361584.033267:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361584.085789:0:40128:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361584.085798:0:40128:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361584.085841:0:40128:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:0.0:1788361584.085846:0:40128:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361584.779756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361584.779855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361584.779893:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361584.779921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361584.779963:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130889216 00000100:00100000:3.0:1788361584.779970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361584.779973:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130889216 00000100:00100000:3.0:1788361584.779997:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130889344 00000100:00100000:3.0:1788361584.780002:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130889344 00000100:00100000:2.0:1788361584.780047:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:2.0:1788361584.780058:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130889216:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361584.780080:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130889088 00000100:00100000:1.0:1788361584.780125:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130889088 00000100:00100000:1.0:1788361584.780162:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130889472 00000100:00100000:1.0:1788361584.780167:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130889472 00000100:00100000:2.0:1788361584.780169:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130889216:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 112us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361584.780179:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:1.0:1788361584.780195:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:2.0:1788361584.780203:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788361584.780207:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+77:2350:x1875232130889088:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361584.780216:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130889344:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361584.780251:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+77:2350:x1875232130889088:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361584.780256:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130889344:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 42us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361584.780264:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:2.0:1788361584.780269:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1788361584.780284:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:1.0:1788361584.780292:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130889472:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361584.780333:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130889472:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 41us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361584.780340:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00080000:1.0:1788361584.780357:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361584.780361:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361584.780363:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361584.781073:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130888960 00000100:00100000:0.0:1788361584.781078:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130888960 00000100:00100000:0.0:1788361584.781128:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 161 00000100:00100000:0.0:1788361584.781142:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130888960:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361584.781181:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130888960:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 45us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361584.781188:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 161 00000001:00080000:3.0:1788361584.819172:0:6617:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 30064771221 is committed 00000001:00080000:1.0:1788361584.822627:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771572 is committed 00000001:00080000:1.0:1788361584.822645:0:5819:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 30064771573 is committed 00000020:00080000:1.0:1788361584.822685:0:5819:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 25769803908 batchid updated 00000020:00080000:3.0:1788361584.822899:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803908 00000020:00080000:3.0:1788361584.822910:0:35383:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 25769803908 00010000:00010000:1.0:1788361585.057192:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361585.577500:0:40182:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361585.577507:0:40182:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361585.577558:0:40182:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1788361585.577565:0:40182:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361586.080417:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361587.046831:0:40233:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361587.046840:0:40233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361587.046892:0:40233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1788361587.046898:0:40233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361587.104293:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361587.872458:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144255104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361587.872511:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144255232:0@lo:400:kworker.0 00000100:00100000:0.0:1788361587.872536:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361587.872613:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144255104 00000100:00100000:3.0:1788361587.872622:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144255104 00000100:00100000:1.0:1788361587.872672:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144255488:0@lo:400:kworker.0 00000100:00100000:3.0:1788361587.872688:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788361587.872699:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144255104:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361587.872724:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788361587.872741:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1788361587.872788:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144255744:0@lo:400:kworker.0 00000100:00100000:3.0:1788361587.872815:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0567800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144255104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361587.872823:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788361587.872870:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144255360:0@lo:400:kworker.0 00000100:00100000:3.0:1788361587.872916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361587.872990:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361587.872998:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144255232 00000100:00100000:3.0:1788361587.873003:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144255232 00000100:00100000:2.0:1788361587.873024:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361587.873031:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144255616:0@lo:400:kworker.0 00000100:00100000:3.0:1788361587.873052:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788361587.873059:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361587.873063:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144255232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361587.873117:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144255360 00000100:00100000:2.0:1788361587.873123:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144255360 00000100:00100000:3.0:1788361587.873136:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144255232:12345-0@lo:400:kworker.0 Request processed in 75us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361587.873150:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788361587.873163:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788361587.873173:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144255360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361587.873238:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144255360:12345-0@lo:400:kworker.0 Request processed in 67us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361587.873266:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788361587.873275:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf132a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144255232:0@lo:400:kworker.0 00000100:00100000:2.0:1788361587.873300:0:3311:0:(client.c:3115:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 30064771221 gen 2 00000004:00080000:2.0:1788361587.873306:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9a8a8ae12d80, transno 30064771221 00000100:00100000:2.0:1788361587.873318:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a835e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144255360:0@lo:400:kworker.0 00000100:00100000:3.0:1788361587.873393:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144255744 00000100:00100000:3.0:1788361587.873398:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144255744 00000100:00100000:3.0:1788361587.873471:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788361587.873494:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144255744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361587.873560:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144255744:12345-0@lo:400:kworker.0 Request processed in 82us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361587.873612:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788361587.873638:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144255616 00000100:00100000:3.0:1788361587.873642:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144255616 00000100:00100000:3.0:1788361587.873681:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788361587.873702:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144255616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361587.873739:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144255616:12345-0@lo:400:kworker.0 Request processed in 52us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361587.873746:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1788361587.873763:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361587.873769:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361587.873771:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361587.873790:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b062d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144255616:0@lo:400:kworker.0 00000100:00100000:3.0:1788361587.873800:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b060a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144255744:0@lo:400:kworker.0 00000100:00100000:1.0:1788361587.874038:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361587.874189:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144255104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361587.874504:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144255488 00000100:00100000:3.0:1788361587.874521:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144255488 00000100:00100000:3.0:1788361587.874586:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788361587.874596:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144255488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361587.874657:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144255488:12345-0@lo:400:kworker.0 Request processed in 62us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361587.874665:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788361587.874684:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144255488:0@lo:400:kworker.0 00010000:00010000:1.0:1788361588.129346:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361588.385520:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361588.385544:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144255872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361588.385615:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361588.385729:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144255872 00000100:00100000:2.0:1788361588.385737:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144255872 00000100:00100000:2.0:1788361588.385787:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788361588.385795:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144255872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361588.385828:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361588.385880:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0565180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144255872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361588.385887:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788361588.386185:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144255872:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788361588.543652:0:40284:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361588.543658:0:40284:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361588.543689:0:40284:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:0.0:1788361588.543697:0:40284:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361589.153905:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361589.896461:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361589.896493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361589.896514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361589.896535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361589.896555:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361589.896578:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130890112 00000100:00100000:2.0:1788361589.896584:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130889728 00000100:00100000:3.0:1788361589.896586:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130890112 00000100:00100000:2.0:1788361589.896591:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130889728 00000100:00100000:0.0:1788361589.896661:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130889600 00000100:00100000:2.0:1788361589.896667:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:0.0:1788361589.896668:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130889600 00000100:00100000:2.0:1788361589.896680:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130889728:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361589.896708:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:0.0:1788361589.896719:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130889600:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361589.896752:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130889856 00000100:00100000:1.0:1788361589.896757:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130889856 00000100:00100000:0.0:1788361589.896768:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130889600:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 50us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361589.896774:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130889728:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 85us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361589.896784:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130889984 00000100:00100000:2.0:1788361589.896787:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:1.0:1788361589.896788:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130889984 00000100:00100000:0.0:1788361589.896799:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:1.0:1788361589.896822:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:1.0:1788361589.896832:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130889856:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361589.896864:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130889856:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 35us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361589.896871:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1788361589.896878:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:0.0:1788361589.896883:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130889984:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361589.896910:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130889984:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361589.896917:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00080000:0.0:1788361589.896950:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361589.896954:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361589.896957:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361589.897546:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:3.0:1788361589.897556:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130890112:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361589.897603:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130890112:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 49us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361589.897609:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000040:00080000:3.0:1788361590.010015:0:40338:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361590.010023:0:40338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361590.010063:0:40338:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1788361590.010069:0:40338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361590.176581:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361591.008495:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361591.008504:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361591.008542:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:2.0:1788361591.008548:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361591.200351:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361591.491210:0:40389:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361591.491218:0:40389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361591.491259:0:40389:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1788361591.491265:0:40389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361592.225774:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361592.921076:0:40440:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361592.921109:0:40440:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361592.921167:0:40440:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:1.0:1788361592.921174:0:40440:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361592.992275:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361592.992302:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144256384:0@lo:400:kworker.0 00000100:00100000:2.0:1788361592.992309:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144256128:0@lo:400:kworker.0 00000100:00100000:3.0:1788361592.992402:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361592.992403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.992405:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144256512:0@lo:400:kworker.0 00000100:00100000:1.0:1788361592.992452:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.992464:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144256000:0@lo:400:kworker.0 00000100:00100000:2.0:1788361592.992468:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144256640:0@lo:400:kworker.0 00000100:00100000:1.0:1788361592.992499:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144256128 00000100:00100000:2.0:1788361592.992501:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.992508:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144256128 00000100:00100000:3.0:1788361592.992515:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361592.992531:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361592.992541:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144256256:0@lo:400:kworker.0 00000100:00100000:2.0:1788361592.992575:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361592.992581:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144256384 00000100:00100000:3.0:1788361592.992595:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144256384 00000100:00100000:1.0:1788361592.992598:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144256256 00000100:00100000:2.0:1788361592.992599:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361592.992605:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144256256 00000100:00100000:2.0:1788361592.992610:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144256768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361592.992630:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144256512 00000100:00100000:3.0:1788361592.992636:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144256512 00000100:00100000:2.0:1788361592.992642:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361592.992648:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788361592.992660:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144256128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361592.992667:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144256640 00000100:00100000:3.0:1788361592.992671:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144256640 00000100:00100000:2.0:1788361592.992685:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788361592.992696:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144256256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361592.992700:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788361592.992713:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144256384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361592.992723:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144256128:12345-0@lo:400:kworker.0 Request processed in 65us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.992733:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788361592.992744:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144256256:12345-0@lo:400:kworker.0 Request processed in 50us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361592.992753:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788361592.992772:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788361592.992777:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144256384:12345-0@lo:400:kworker.0 Request processed in 66us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.992784:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144256512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361592.992786:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788361592.992799:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788361592.992801:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144256640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361592.992827:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144256000 00000100:00100000:3.0:1788361592.992831:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144256000 00000100:00100000:1.0:1788361592.992843:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b062d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144256512:12345-0@lo:400:kworker.0 Request processed in 63us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361592.992851:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144256640:12345-0@lo:400:kworker.0 Request processed in 53us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.992852:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788361592.992864:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788361592.992865:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788361592.992877:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144256000:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788361592.992881:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361592.992887:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361592.992890:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361592.992927:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144256000:12345-0@lo:400:kworker.0 Request processed in 53us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361592.992933:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144256512:0@lo:400:kworker.0 00000100:00100000:3.0:1788361592.992938:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788361592.992972:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144256256:0@lo:400:kworker.0 00000100:00100000:1.0:1788361592.992982:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144256128:0@lo:400:kworker.0 00000100:00100000:3.0:1788361592.992993:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144256768 00000100:00100000:1.0:1788361592.992996:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144256640:0@lo:400:kworker.0 00000100:00100000:3.0:1788361592.992999:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144256768 00000100:00100000:3.0:1788361592.993034:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788361592.993042:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144256768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361592.993069:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361592.993153:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144256768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361592.993160:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788361592.993209:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144256384:0@lo:400:kworker.0 00000100:00100000:3.0:1788361592.993219:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144256000:0@lo:400:kworker.0 00000100:00100000:1.0:1788361592.993405:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144256768:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788361593.248272:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361593.504316:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144256896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361593.504399:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361593.504551:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144256896 00000100:00100000:1.0:1788361593.504558:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144256896 00000100:00100000:1.0:1788361593.504613:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788361593.504621:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144256896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361593.504665:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361593.504917:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144256896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 295us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361593.504925:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788361593.504992:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144256896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788361594.272505:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361594.395780:0:40491:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361594.395789:0:40491:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361594.395831:0:40491:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1788361594.395836:0:40491:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361595.015780:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361595.015839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361595.015954:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130890240 00000100:00100000:0.0:1788361595.015964:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130890240 00000100:00100000:0.0:1788361595.016014:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:0.0:1788361595.016023:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130890240:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361595.016147:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130890240:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 123us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361595.016153:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:1.0:1788361595.016362:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130890368 00000100:00100000:1.0:1788361595.016368:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130890368 00000100:00100000:1.0:1788361595.016419:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:1.0:1788361595.016439:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130890368:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361595.016447:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361595.016474:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130890368:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 36us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361595.016480:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:3.0:1788361595.016484:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130890624 00000100:00100000:3.0:1788361595.016490:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130890624 00000100:00100000:2.0:1788361595.016545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361595.016550:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:3.0:1788361595.016561:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130890624:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361595.016594:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130890624:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 35us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361595.016600:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:3.0:1788361595.016614:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130890496 00000100:00100000:3.0:1788361595.016618:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130890496 00000100:00100000:2.0:1788361595.016645:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361595.016657:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:3.0:1788361595.016667:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130890496:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361595.016690:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130890752 00000100:00100000:2.0:1788361595.016695:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130890752 00000100:00080000:0.0:1788361595.016717:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361595.016723:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361595.016727:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361595.016731:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:2.0:1788361595.016740:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130890752:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361595.016781:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130890752:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 42us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361595.016787:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:3.0:1788361595.016914:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130890496:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 247us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361595.016921:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00010000:00010000:3.0:1788361595.297860:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361595.849396:0:40543:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361595.849406:0:40543:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361595.849453:0:40543:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:2.0:1788361595.849459:0:40543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361596.320491:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361597.318961:0:40595:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361597.318971:0:40595:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361597.319027:0:40595:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:0.0:1788361597.319034:0:40595:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361597.345209:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361598.112509:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144257408:0@lo:400:kworker.0 00000100:00100000:0.0:1788361598.112509:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144257024:0@lo:400:kworker.0 00000100:00100000:1.0:1788361598.112522:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144257152:0@lo:400:kworker.0 00000100:00100000:2.0:1788361598.112592:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361598.112593:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361598.112599:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361598.112661:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144257664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361598.112666:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144257408 00000100:00100000:3.0:1788361598.112674:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144257408 00000100:00100000:1.0:1788361598.112691:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361598.112714:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144257792:0@lo:400:kworker.0 00000100:00100000:3.0:1788361598.112726:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788361598.112738:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144257408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361598.112746:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361598.112770:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361598.112778:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144257280:0@lo:400:kworker.0 00000100:00100000:3.0:1788361598.112798:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144257408:12345-0@lo:400:kworker.0 Request processed in 62us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.112823:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788361598.112837:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144257792 00000100:00100000:3.0:1788361598.112840:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144257792 00000100:00100000:3.0:1788361598.112871:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788361598.112878:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144257792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361598.112905:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144257792:12345-0@lo:400:kworker.0 Request processed in 28us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.112911:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1788361598.112926:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361598.112950:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144257664 00000100:00100000:3.0:1788361598.112954:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144257664 00000100:00100000:3.0:1788361598.112985:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788361598.112992:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144257664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361598.113019:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1788361598.113031:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361598.113066:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90706d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144257664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.113076:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788361598.113113:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144257024 00000100:00100000:3.0:1788361598.113117:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144257024 00000100:00100000:1.0:1788361598.113144:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144257664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361598.113146:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788361598.113161:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144257024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361598.113163:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144257792:0@lo:400:kworker.0 00000100:00100000:3.0:1788361598.113202:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144257024:12345-0@lo:400:kworker.0 Request processed in 42us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361598.113206:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144257152 00000100:00100000:3.0:1788361598.113210:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788361598.113211:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144257152 00000100:00100000:3.0:1788361598.113247:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144257280 00000100:00100000:1.0:1788361598.113252:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788361598.113253:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144257280 00000100:00100000:1.0:1788361598.113261:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144257152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361598.113286:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788361598.113304:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144257280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361598.113313:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144257152:12345-0@lo:400:kworker.0 Request processed in 53us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361598.113320:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788361598.113344:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144257280:12345-0@lo:400:kworker.0 Request processed in 40us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.113351:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788361598.113362:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144257280:0@lo:400:kworker.0 00000100:00100000:1.0:1788361598.113385:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144257152:0@lo:400:kworker.0 00000100:00080000:3.0:1788361598.113386:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361598.113392:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361598.113592:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144257024:0@lo:400:kworker.0 00000100:00100000:0.0:1788361598.113612:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144257536:0@lo:400:kworker.0 00000100:00100000:0.0:1788361598.113640:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361598.113692:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144257536 00000100:00100000:1.0:1788361598.113697:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144257536 00000100:00100000:1.0:1788361598.113746:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788361598.113754:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144257536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361598.113793:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0565c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144257536:12345-0@lo:400:kworker.0 Request processed in 40us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361598.113799:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788361598.113825:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144257536:0@lo:400:kworker.0 00000100:00100000:2.0:1788361598.114248:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144257408:0@lo:400:kworker.0 00000100:00080000:3.0:1788361598.115487:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788361598.368339:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361598.625361:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144257920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361598.625433:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361598.625525:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144257920 00000100:00100000:3.0:1788361598.625535:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144257920 00000100:00100000:3.0:1788361598.625601:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788361598.625613:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144257920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361598.625651:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788361598.625731:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144257920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361598.625738:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788361598.625845:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144257920:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788361598.788137:0:40646:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361598.788147:0:40646:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361598.788199:0:40646:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1788361598.788205:0:40646:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361599.393303:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361600.144728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361600.144768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361600.144790:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361600.144809:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361600.144829:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361600.144867:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130890880 00000100:00100000:0.0:1788361600.144878:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130890880 00000100:00100000:0.0:1788361600.144933:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:0.0:1788361600.144943:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130890880:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361600.145021:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130890880:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361600.145029:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:0.0:1788361600.145066:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130891008 00000100:00100000:0.0:1788361600.145070:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130891008 00000100:00100000:0.0:1788361600.145128:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130891392 00000100:00100000:0.0:1788361600.145132:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130891392 00000100:00100000:0.0:1788361600.145156:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:0.0:1788361600.145163:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130891008:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361600.145197:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130891008:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361600.145204:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:0.0:1788361600.145217:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:0.0:1788361600.145223:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130891392:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361600.145268:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0566680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130891392:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 45us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361600.145287:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:0.0:1788361600.145309:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130891264 00000100:00100000:0.0:1788361600.145313:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130891264 00000100:00100000:0.0:1788361600.145343:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130891136 00000100:00100000:0.0:1788361600.145346:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130891136 00000100:00100000:0.0:1788361600.145365:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:0.0:1788361600.145371:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130891264:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361600.145396:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0564380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130891264:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361600.145402:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:0.0:1788361600.145412:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:0.0:1788361600.145417:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130891136:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361600.145439:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0564e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130891136:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 22us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361600.145444:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00080000:1.0:1788361600.145792:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361600.145798:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361600.145801:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788361600.389363:0:40697:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361600.389376:0:40697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361600.389423:0:40697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:0.0:1788361600.389429:0:40697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361600.417200:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361601.248491:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361601.248503:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361601.248541:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:2.0:1788361601.248547:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361601.440414:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361601.993914:0:40748:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361601.993922:0:40748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361601.993965:0:40748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:2.0:1788361601.993970:0:40748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361602.464349:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361603.235046:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144258432:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.235128:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.235180:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361603.235189:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144258304:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.235214:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.235243:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361603.235249:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144258816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361603.235281:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.235326:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144258816 00000100:00100000:1.0:1788361603.235333:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144258816 00000100:00100000:1.0:1788361603.235387:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788361603.235396:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144258816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361603.235429:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361603.235464:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144258304 00000100:00100000:3.0:1788361603.235470:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144258304 00000100:00100000:1.0:1788361603.235472:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144258816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.235480:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788361603.235503:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144258176:0@lo:400:kworker.0 00000100:00080000:1.0:1788361603.235506:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361603.235534:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788361603.235550:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144258304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.235550:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144258816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361603.235550:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361603.235583:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144258688:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.235596:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144258432 00000100:00100000:1.0:1788361603.235600:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144258432 00000100:00100000:3.0:1788361603.235614:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144258304:12345-0@lo:400:kworker.0 Request processed in 70us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361603.235621:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361603.235628:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788361603.235632:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788361603.235641:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144258432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361603.235650:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144258176 00000100:00100000:3.0:1788361603.235655:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144258176 00000100:00100000:0.0:1788361603.235661:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788361603.235672:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144258048:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.235680:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144258432:12345-0@lo:400:kworker.0 Request processed in 40us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.235686:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788361603.235701:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144258688 00000100:00100000:1.0:1788361603.235704:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144258688 00000100:00100000:3.0:1788361603.235709:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788361603.235711:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361603.235723:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144258176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.235739:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788361603.235747:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144258560:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.235752:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144258688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361603.235770:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144258176:12345-0@lo:400:kworker.0 Request processed in 50us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361603.235778:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788361603.235783:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361603.235798:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144258688:12345-0@lo:400:kworker.0 Request processed in 50us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.235805:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788361603.235816:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144258176:0@lo:400:kworker.0 00000100:00100000:3.0:1788361603.235820:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144258560 00000100:00100000:3.0:1788361603.235826:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144258560 00000100:00100000:0.0:1788361603.235832:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144258688:0@lo:400:kworker.0 00000100:00100000:3.0:1788361603.235861:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00080000:0.0:1788361603.235868:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361603.235872:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144258560:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788361603.235874:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361603.235893:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144258304:0@lo:400:kworker.0 00000100:00100000:0.0:1788361603.235906:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144258432:0@lo:400:kworker.0 00000100:00100000:3.0:1788361603.235925:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0564a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144258560:12345-0@lo:400:kworker.0 Request processed in 55us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361603.235933:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788361603.235937:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144258560:0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.235969:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144258048 00000100:00100000:1.0:1788361603.235975:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144258048 00000100:00100000:1.0:1788361603.236008:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788361603.236014:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144258048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361603.236073:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144258048:12345-0@lo:400:kworker.0 Request processed in 58us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361603.236101:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788361603.236452:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144258048:0@lo:400:kworker.0 00010000:00010000:3.0:1788361603.489112:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361603.495226:0:40799:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361603.495234:0:40799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361603.495295:0:40799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1788361603.495301:0:40799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361603.744495:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361603.744523:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144258944:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361603.744596:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361603.744754:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144258944 00000100:00100000:3.0:1788361603.744762:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144258944 00000100:00100000:3.0:1788361603.746492:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788361603.746519:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144258944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361603.746570:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788361603.746637:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144258944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (2040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361603.746647:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788361603.746772:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144258944:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788361604.512295:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361605.020548:0:40852:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361605.020557:0:40852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361605.020606:0:40852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:0.0:1788361605.020612:0:40852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361605.257948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361605.257996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361605.258030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361605.258058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361605.258082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361605.258176:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130891520 00000100:00100000:0.0:1788361605.258186:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130891520 00000100:00100000:0.0:1788361605.258254:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:0.0:1788361605.258264:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130891520:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361605.258335:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130891520:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 73us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361605.258343:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:1.0:1788361605.258897:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130891648 00000100:00100000:1.0:1788361605.258902:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130891648 00000100:00100000:1.0:1788361605.258961:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130892032 00000100:00100000:1.0:1788361605.258964:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130892032 00000100:00100000:1.0:1788361605.258989:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:1.0:1788361605.258996:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130891648:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361605.259040:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130891648:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 44us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361605.259047:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:1.0:1788361605.259062:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:1.0:1788361605.259069:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130892032:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361605.259122:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130892032:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 54us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361605.259128:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:1.0:1788361605.259151:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130891776 00000100:00100000:1.0:1788361605.259154:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130891776 00000100:00100000:1.0:1788361605.259181:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130891904 00000100:00100000:1.0:1788361605.259183:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130891904 00000100:00100000:1.0:1788361605.259204:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:1.0:1788361605.259211:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130891776:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361605.259259:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130891776:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 48us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361605.259267:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:3.0:1788361605.259287:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:3.0:1788361605.259298:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130891904:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:0.0:1788361605.259325:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361605.259331:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130891904:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (1246us total) trans 0 rc 0/0 00000100:00080000:0.0:1788361605.259332:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361605.259337:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361605.259503:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00010000:00010000:1.0:1788361605.536322:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361606.535605:0:40903:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361606.535614:0:40903:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361606.535720:0:40903:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:1.0:1788361606.535726:0:40903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361606.561372:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361607.584465:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361608.013472:0:40954:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361608.013483:0:40954:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361608.013532:0:40954:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:1.0:1788361608.013539:0:40954:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361608.352461:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144259328:0@lo:400:kworker.0 00000100:00100000:1.0:1788361608.352541:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361608.352602:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361608.352609:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144259456:0@lo:400:kworker.0 00000100:00100000:1.0:1788361608.352636:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361608.352938:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361608.352948:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144259840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361608.352975:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361608.353003:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144259840 00000100:00100000:3.0:1788361608.353010:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144259840 00000100:00100000:3.0:1788361608.353060:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788361608.353069:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144259840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361608.353124:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361608.353160:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144259840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361608.353166:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788361608.353184:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361608.353213:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144259840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361608.353357:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144259200:0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.353386:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361608.353414:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144259712:0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.353433:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361608.353450:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788361608.353454:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144259072:0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.353477:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361608.353494:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144259584:0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.353512:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361608.353544:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144259328 00000100:00100000:0.0:1788361608.353548:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144259328 00000100:00100000:0.0:1788361608.353574:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144259200 00000100:00100000:0.0:1788361608.353577:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144259200 00000100:00100000:0.0:1788361608.353598:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788361608.353604:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144259328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.353633:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144259328:12345-0@lo:400:kworker.0 Request processed in 30us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361608.353638:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788361608.353649:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788361608.353654:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144259200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.353680:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144259200:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361608.353685:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788361608.353700:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144259456 00000100:00100000:0.0:1788361608.353715:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144259456 00000100:00100000:0.0:1788361608.353734:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144259712 00000100:00100000:0.0:1788361608.353736:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144259712 00000100:00100000:0.0:1788361608.353751:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144259584 00000100:00100000:0.0:1788361608.353753:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144259584 00000100:00100000:0.0:1788361608.353766:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1788361608.353894:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361608.353897:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361608.353927:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788361608.353935:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144259712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.353968:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0566a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144259712:12345-0@lo:400:kworker.0 Request processed in 34us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361608.353974:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788361608.353986:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788361608.353992:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144259584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.354016:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0566300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144259584:12345-0@lo:400:kworker.0 Request processed in 24us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361608.354021:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788361608.354037:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144259072 00000100:00100000:3.0:1788361608.354040:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144259072 00000100:00100000:3.0:1788361608.354064:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788361608.354069:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144259072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.354119:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144259072:12345-0@lo:400:kworker.0 Request processed in 50us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361608.354125:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788361608.354168:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144259072:0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.354178:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144259584:0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.354187:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144259200:0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.354195:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144259712:0@lo:400:kworker.0 00000100:00100000:0.0:1788361608.355754:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144259456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361608.356035:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144259328:0@lo:400:kworker.0 00000100:00100000:3.0:1788361608.356461:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144259456:12345-0@lo:400:kworker.0 Request processed in 2688us (3822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361608.356472:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788361608.356553:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144259456:0@lo:400:kworker.0 00010000:00010000:1.0:1788361608.608415:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361608.864425:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361608.864460:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144259968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361608.864563:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361608.865021:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144259968 00000100:00100000:2.0:1788361608.865032:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144259968 00000100:00100000:2.0:1788361608.865671:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788361608.865682:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144259968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361608.865718:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361608.865799:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144259968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361608.865806:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788361608.866246:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144259968:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788361609.444807:0:41005:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361609.444816:0:41005:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361609.444864:0:41005:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1788361609.444871:0:41005:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361609.637293:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361610.376892:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361610.376958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361610.376996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361610.377034:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130892416 00000100:00100000:0.0:1788361610.377048:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130892416 00000100:00100000:2.0:1788361610.377061:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361610.377174:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:0.0:1788361610.377188:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130892416:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361610.377197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361610.377251:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130892672 00000100:00080000:2.0:1788361610.377258:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361610.377268:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130892672 00000100:00100000:2.0:1788361610.377281:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130892288 00000100:00100000:2.0:1788361610.377289:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130892288 00000100:00100000:0.0:1788361610.377304:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130892416:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 118us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361610.377314:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:0.0:1788361610.377337:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130892544 00000100:00100000:0.0:1788361610.377341:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130892544 00000100:00100000:0.0:1788361610.377374:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:0.0:1788361610.377381:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130892544:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361610.377408:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130892544:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361610.377429:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:2.0:1788361610.377434:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:2.0:1788361610.377453:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130892288:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361610.377464:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:3.0:1788361610.377485:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130892672:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361610.377572:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130892160 00000100:00100000:1.0:1788361610.377579:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130892160 00000100:00100000:1.0:1788361610.377640:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:2.0:1788361610.377668:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130892288:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 224us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361610.377678:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00080000:2.0:1788361610.377742:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361610.377751:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130892672:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 264us (743us total) trans 0 rc 0/0 00000100:00080000:2.0:1788361610.377751:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361610.377772:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:1.0:1788361610.377858:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130892160:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361610.377911:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130892160:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 262us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361610.377918:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 171 00010000:00010000:3.0:1788361610.656495:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361610.922552:0:41056:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361610.922559:0:41056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361610.922606:0:41056:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1788361610.922614:0:41056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1788361611.489472:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361611.489480:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361611.489515:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:1.0:1788361611.489522:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361611.681264:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361612.441353:0:41109:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361612.441362:0:41109:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361612.441409:0:41109:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:2.0:1788361612.441415:0:41109:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361612.704336:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361613.472403:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144260352:0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.472509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361613.472571:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144260480:0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.472578:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144260736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361613.472632:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361613.472652:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361613.472688:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144260736 00000100:00100000:1.0:1788361613.472698:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144260736 00000100:00100000:3.0:1788361613.472723:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144260480 00000100:00100000:3.0:1788361613.472731:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144260480 00000100:00100000:1.0:1788361613.472777:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788361613.472792:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144260736:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361613.472797:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788361613.472823:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144260480:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788361613.472830:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361613.472899:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144260480:12345-0@lo:400:kworker.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361613.472910:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144260736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361613.472916:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788361613.472930:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788361613.473000:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144260736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361613.473045:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144260224:0@lo:400:kworker.0 00000100:00100000:2.0:1788361613.473115:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144260096:0@lo:400:kworker.0 00000100:00100000:3.0:1788361613.473178:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144260480:0@lo:400:kworker.0 00000100:00080000:3.0:1788361613.473241:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361613.473270:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361613.473313:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144260352 00000100:00100000:1.0:1788361613.473314:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144260864:0@lo:400:kworker.0 00000100:00100000:3.0:1788361613.473319:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144260352 00000100:00100000:1.0:1788361613.473354:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361613.473360:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144260224 00000100:00100000:3.0:1788361613.473366:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144260224 00000100:00100000:3.0:1788361613.473407:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788361613.473416:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144260352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.473424:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144260864 00000100:00100000:1.0:1788361613.473432:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144260864 00000100:00100000:3.0:1788361613.473480:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144260352:12345-0@lo:400:kworker.0 Request processed in 62us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361613.473480:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788361613.473495:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788361613.473497:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144260864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361613.473518:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788361613.473528:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144260224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.473563:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144260864:12345-0@lo:400:kworker.0 Request processed in 69us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361613.473573:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788361613.473581:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144260224:12345-0@lo:400:kworker.0 Request processed in 54us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361613.473590:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1788361613.473618:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361613.473624:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361613.473626:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144260224:0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.473642:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144260864:0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.473682:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144260352:0@lo:400:kworker.0 00000100:00100000:2.0:1788361613.474525:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361613.474626:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144260608:0@lo:400:kworker.0 00000100:00100000:2.0:1788361613.474664:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361613.474731:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144260096 00000100:00100000:3.0:1788361613.474736:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144260096 00000100:00100000:3.0:1788361613.474777:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788361613.474785:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144260096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361613.474820:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144260608 00000100:00100000:1.0:1788361613.474825:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144260608 00000100:00100000:3.0:1788361613.474837:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144260096:12345-0@lo:400:kworker.0 Request processed in 51us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361613.474845:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788361613.474874:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788361613.474884:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144260608:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361613.474899:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361613.474924:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144260608:12345-0@lo:400:kworker.0 Request processed in 43us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361613.474931:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788361613.474964:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144260096:0@lo:400:kworker.0 00000100:00100000:2.0:1788361613.474975:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144260608:0@lo:400:kworker.0 00010000:00010000:3.0:1788361613.728301:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361613.907642:0:41160:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361613.907653:0:41160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361613.907696:0:41160:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:2.0:1788361613.907702:0:41160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361613.984229:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361613.984252:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144260992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361613.984315:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361613.984420:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144260992 00000100:00100000:1.0:1788361613.984427:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144260992 00000100:00100000:1.0:1788361613.984511:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788361613.984526:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144260992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361613.984562:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361613.984621:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0564000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144260992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361613.984628:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788361613.984700:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144260992:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361614.752320:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361615.388440:0:41211:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361615.388454:0:41211:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361615.388515:0:41211:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:1.0:1788361615.388522:0:41211:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361615.499562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361615.499605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361615.499628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361615.499656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361615.499691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361615.499724:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130893312 00000100:00100000:2.0:1788361615.499735:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130893312 00000100:00100000:2.0:1788361615.499798:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130892928 00000100:00100000:2.0:1788361615.499802:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130892928 00000100:00100000:2.0:1788361615.499826:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:2.0:1788361615.499836:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130893312:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361615.499922:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130893312:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 87us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361615.499930:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:2.0:1788361615.499949:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:2.0:1788361615.499954:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130892928:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361615.499985:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130892928:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361615.499992:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:2.0:1788361615.500011:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130893056 00000100:00100000:2.0:1788361615.500015:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130893056 00000100:00100000:2.0:1788361615.500050:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130893184 00000100:00100000:2.0:1788361615.500053:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130893184 00000100:00100000:2.0:1788361615.500079:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:2.0:1788361615.500110:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130893056:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361615.500111:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130892800 00000100:00100000:1.0:1788361615.500119:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130892800 00000100:00100000:2.0:1788361615.500142:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130893056:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 56us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361615.500149:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1788361615.500167:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:2.0:1788361615.500181:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:1.0:1788361615.500192:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130892800:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361615.500194:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130893184:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361615.500234:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130892800:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361615.500241:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:2.0:1788361615.500590:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88446c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130893184:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 398us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361615.500598:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00080000:2.0:1788361615.500831:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361615.500836:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361615.500838:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361615.777841:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361616.803818:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361616.836684:0:41262:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361616.836693:0:41262:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361616.836738:0:41262:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:3.0:1788361616.836744:0:41262:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361617.824450:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361618.276268:0:41313:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361618.276275:0:41313:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361618.276313:0:41313:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:0.0:1788361618.276320:0:41313:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361618.592309:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144261248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361618.592344:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144261376:0@lo:400:kworker.0 00000100:00100000:3.0:1788361618.592380:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361618.592385:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144261120:0@lo:400:kworker.0 00000100:00100000:1.0:1788361618.592394:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361618.592432:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144261760:0@lo:400:kworker.0 00000100:00100000:2.0:1788361618.592438:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361618.592441:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144261888:0@lo:400:kworker.0 00000100:00100000:2.0:1788361618.592474:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144261632:0@lo:400:kworker.0 00000100:00100000:1.0:1788361618.592475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361618.592484:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144261504:0@lo:400:kworker.0 00000100:00100000:2.0:1788361618.592515:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361618.592523:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361618.592558:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144261760 00000100:00100000:3.0:1788361618.592564:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144261248 00000100:00100000:2.0:1788361618.592566:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144261760 00000100:00100000:3.0:1788361618.592570:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144261248 00000100:00100000:2.0:1788361618.592615:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144261632 00000100:00100000:2.0:1788361618.592620:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144261632 00000100:00100000:2.0:1788361618.592641:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788361618.592649:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144261760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361618.592700:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144261760:12345-0@lo:400:kworker.0 Request processed in 51us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361618.592707:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788361618.592722:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788361618.592728:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144261632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361618.592757:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144261632:12345-0@lo:400:kworker.0 Request processed in 30us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361618.592763:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788361618.592979:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144261376 00000100:00100000:1.0:1788361618.592984:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144261376 00000100:00100000:3.0:1788361618.593223:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788361618.593232:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144261248:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361618.593270:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144261120 00000100:00100000:0.0:1788361618.593276:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144261120 00000100:00100000:0.0:1788361618.593305:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788361618.593312:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144261120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361618.593349:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144261120:12345-0@lo:400:kworker.0 Request processed in 38us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361618.593356:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788361618.593448:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144261120:0@lo:400:kworker.0 00000100:00100000:0.0:1788361618.593461:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144261632:0@lo:400:kworker.0 00000100:00100000:0.0:1788361618.593489:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144261760:0@lo:400:kworker.0 00000100:00100000:0.0:1788361618.593517:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144261504 00000100:00100000:0.0:1788361618.593520:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144261504 00000100:00100000:0.0:1788361618.593544:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788361618.593550:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144261504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361618.593589:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144261504:12345-0@lo:400:kworker.0 Request processed in 39us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361618.593595:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788361618.593627:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361618.593661:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144261888 00000100:00100000:0.0:1788361618.593665:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144261888 00000100:00100000:0.0:1788361618.593690:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788361618.593697:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144261888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361618.593733:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0564380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144261888:12345-0@lo:400:kworker.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361618.593739:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788361618.593765:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144261888:0@lo:400:kworker.0 00000100:00080000:2.0:1788361618.593895:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361618.593899:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361618.593902:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361618.593935:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788361618.593943:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144261376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361618.594004:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144261376:12345-0@lo:400:kworker.0 Request processed in 61us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361618.594014:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144261504:0@lo:400:kworker.0 00000100:00100000:1.0:1788361618.594014:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00002000:00000024:3.0:1788361618.594025:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1788361618.594054:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144261376:0@lo:400:kworker.0 00000100:00100000:3.0:1788361618.594343:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144261248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1111us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361618.594352:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788361618.594651:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144261248:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788361618.848277:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361619.104607:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144262016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361619.104677:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361619.104729:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144262016 00000100:00100000:3.0:1788361619.104746:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144262016 00000100:00100000:3.0:1788361619.104799:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788361619.104809:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144262016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361619.104843:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788361619.105415:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144262016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 606us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361619.105424:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788361619.105502:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144262016:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788361619.701344:0:41365:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361619.701352:0:41365:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361619.701401:0:41365:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:0.0:1788361619.701407:0:41365:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361619.872309:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361620.616667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361620.616715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361620.616760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361620.616862:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130893568 00000100:00100000:0.0:1788361620.616872:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130893568 00000100:00100000:1.0:1788361620.616916:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130893824 00000100:00100000:1.0:1788361620.616931:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130893824 00000100:00100000:0.0:1788361620.616962:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:0.0:1788361620.616979:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130893568:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361620.617013:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:1.0:1788361620.617027:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130893824:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361620.617145:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130893568:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 161us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361620.617154:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130893824:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 125us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361620.617166:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:1.0:1788361620.617173:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00080000:0.0:1788361620.617425:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361620.617431:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361620.619383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361620.619427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361620.619525:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130893440 00000100:00100000:3.0:1788361620.619536:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130893440 00000100:00100000:2.0:1788361620.619609:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 175 00000100:00100000:2.0:1788361620.619629:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130893440:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361620.619637:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130893696 00000100:00100000:1.0:1788361620.619651:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130893696 00000100:00100000:2.0:1788361620.619707:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130893440:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 87us (2945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361620.619716:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 175 00000100:00080000:3.0:1788361620.620014:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361620.620059:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:1.0:1788361620.620070:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130893696:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361620.620185:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130893696:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 116us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361620.620193:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:0.0:1788361620.620677:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130893952 00000100:00100000:0.0:1788361620.620696:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130893952 00000100:00100000:0.0:1788361620.620982:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 154 00000100:00100000:0.0:1788361620.620996:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130893952:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361620.621069:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130893952:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 76us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361620.621076:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 154 00000100:00080000:2.0:1788361620.624227:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361620.897271:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361621.129553:0:41416:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361621.129564:0:41416:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361621.129613:0:41416:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 3 00000040:00080000:1.0:1788361621.129619:0:41416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1788361621.729526:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361621.729535:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361621.729889:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 2 00000040:00080000:1.0:1788361621.729895:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361621.920251:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361622.593453:0:41467:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361622.593462:0:41467:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361622.593508:0:41467:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 2 00000040:00080000:2.0:1788361622.593514:0:41467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361622.944418:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361623.712390:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144262144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361623.712458:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361623.712555:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144262144 00000100:00100000:3.0:1788361623.712563:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144262144 00000100:00080000:2.0:1788361623.712608:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361623.712621:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788361623.712630:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144262144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361623.712661:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361623.712729:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8867d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144262144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361623.712737:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788361623.713036:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144262144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361623.713263:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144262400:0@lo:400:kworker.0 00000100:00100000:2.0:1788361623.713299:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361623.713348:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361623.713354:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144262528:0@lo:400:kworker.0 00000100:00100000:2.0:1788361623.713379:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361623.713411:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144262400 00000100:00100000:2.0:1788361623.713415:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144262400 00000100:00100000:2.0:1788361623.713454:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788361623.713461:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144262400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361623.713502:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144262400:12345-0@lo:400:kworker.0 Request processed in 41us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361623.713509:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788361623.713604:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144262528 00000100:00100000:2.0:1788361623.713609:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144262528 00000100:00100000:2.0:1788361623.713640:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788361623.713647:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144262528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.713748:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144262272:0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.713780:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361623.713803:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144262784:0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.713823:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361623.713838:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361623.713843:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144262656:0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.713862:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361623.713882:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144262272 00000100:00100000:1.0:1788361623.713886:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144262272 00000100:00100000:1.0:1788361623.713916:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788361623.713924:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144262272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.713956:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144262272:12345-0@lo:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361623.713962:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788361623.713984:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144262784 00000100:00100000:1.0:1788361623.713987:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144262784 00000100:00100000:1.0:1788361623.714008:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144262656 00000100:00100000:1.0:1788361623.714011:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144262656 00000100:00100000:1.0:1788361623.714026:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788361623.714032:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144262784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.714060:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144262784:12345-0@lo:400:kworker.0 Request processed in 28us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361623.714075:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788361623.714108:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788361623.714125:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144262656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.714155:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144262656:12345-0@lo:400:kworker.0 Request processed in 41us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361623.714160:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788361623.714197:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144262656:0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.714205:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144262272:0@lo:400:kworker.0 00000100:00100000:1.0:1788361623.714213:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144262784:0@lo:400:kworker.0 00000100:00080000:1.0:1788361623.714249:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361623.714253:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361623.714292:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144262400:0@lo:400:kworker.0 00000100:00100000:2.0:1788361623.714382:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144262528:12345-0@lo:400:kworker.0 Request processed in 735us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361623.714388:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788361623.714521:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144262528:0@lo:400:kworker.0 00010000:00010000:1.0:1788361623.968861:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361624.068908:0:41518:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361624.068917:0:41518:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361624.068959:0:41518:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 2 00000040:00080000:0.0:1788361624.068965:0:41518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361624.225270:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144262912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361624.225342:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361624.225490:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144262912 00000100:00100000:3.0:1788361624.225499:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144262912 00000100:00100000:3.0:1788361624.225565:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788361624.225576:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144262912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361624.225611:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788361624.225665:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144262912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361624.225672:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788361624.225795:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144262912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361624.992312:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361625.499963:0:41569:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361625.499972:0:41569:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361625.500003:0:41569:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 2 00000040:00080000:0.0:1788361625.500007:0:41569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361625.737621:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361625.737670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361625.737789:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130894208 00000100:00100000:1.0:1788361625.737803:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130894208 00000100:00100000:1.0:1788361625.737878:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:1.0:1788361625.737889:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130894208:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361625.737962:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130894208:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 75us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361625.737970:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00080000:2.0:1788361625.737983:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361625.738228:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130894464 00000100:00100000:0.0:1788361625.738232:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130894464 00000100:00100000:1.0:1788361625.738402:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:1.0:1788361625.738422:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130894464:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361625.738458:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130894464:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 37us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361625.738465:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00080000:2.0:1788361625.738470:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361625.738549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361625.738593:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130894080 00000100:00100000:0.0:1788361625.738598:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130894080 00000100:00100000:0.0:1788361625.738627:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 177 00000100:00100000:0.0:1788361625.738634:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130894080:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361625.738665:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130894080:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 32us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361625.738672:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 177 00000100:00100000:3.0:1788361625.738919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361625.738953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361625.739010:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130894592 00000100:00100000:1.0:1788361625.739015:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130894592 00000100:00100000:2.0:1788361625.739019:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130894336 00000100:00100000:2.0:1788361625.739025:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130894336 00000100:00100000:2.0:1788361625.739073:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:1.0:1788361625.739073:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:2.0:1788361625.739082:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130894336:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361625.739119:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130894592:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361625.739150:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130894336:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361625.739156:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:1.0:1788361625.739162:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130894592:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361625.739168:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00080000:3.0:1788361625.739195:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361625.739199:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788361626.016519:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361626.926352:0:41622:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361626.926358:0:41622:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361626.926405:0:41622:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 2 00000040:00080000:0.0:1788361626.926412:0:41622:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361627.040324:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361628.064262:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361628.378382:0:41673:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361628.378389:0:41673:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361628.378430:0:41673:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 2 00000040:00080000:1.0:1788361628.378436:0:41673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361628.832316:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144263040:0@lo:400:kworker.0 00000100:00100000:1.0:1788361628.832317:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144263424:0@lo:400:kworker.0 00000100:00100000:1.0:1788361628.833509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361628.833628:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144263296:0@lo:400:kworker.0 00000100:00100000:1.0:1788361628.833671:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361628.833697:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788361628.833704:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144263168:0@lo:400:kworker.0 00000100:00100000:1.0:1788361628.833728:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361628.833744:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144263680:0@lo:400:kworker.0 00000100:00100000:1.0:1788361628.833786:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361628.833860:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144263296 00000100:00100000:3.0:1788361628.833861:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361628.833867:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144263296 00000100:00100000:3.0:1788361628.833874:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144263808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361628.833910:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361628.833936:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144263168 00000100:00100000:1.0:1788361628.833940:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144263168 00000100:00080000:3.0:1788361628.833946:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361628.833953:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361628.833967:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144263808 00000100:00100000:3.0:1788361628.833972:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144263808 00000100:00100000:1.0:1788361628.833976:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788361628.834003:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144263296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361628.834010:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788361628.834020:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144263808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361628.834049:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1788361628.834065:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144263296:12345-0@lo:400:kworker.0 Request processed in 65us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361628.834073:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788361628.834118:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788361628.834125:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144263168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361628.834470:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144263424 00000100:00100000:2.0:1788361628.834476:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144263424 00000100:00100000:2.0:1788361628.834506:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144263680 00000100:00100000:2.0:1788361628.834509:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144263680 00000100:00100000:2.0:1788361628.834530:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788361628.834537:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144263424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361628.837156:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144263168:12345-0@lo:400:kworker.0 Request processed in 3022us (3418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361628.837167:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788361628.837221:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788361628.837235:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144263680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361628.837236:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144263808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3213us (3321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361628.837247:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788361628.837296:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144263680:12345-0@lo:400:kworker.0 Request processed in 67us (3507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361628.837303:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788361628.837307:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361628.837349:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144263040 00000100:00100000:1.0:1788361628.837356:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144263040 00000100:00100000:0.0:1788361628.837361:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144263552:0@lo:400:kworker.0 00000100:00100000:1.0:1788361628.837394:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788361628.837402:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144263040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361628.837409:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144263808:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788361628.837439:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361628.837497:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144263168:0@lo:400:kworker.0 00000100:00100000:3.0:1788361628.837507:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144263680:0@lo:400:kworker.0 00000100:00100000:3.0:1788361628.837515:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144263296:0@lo:400:kworker.0 00000100:00100000:1.0:1788361628.838070:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144263040:12345-0@lo:400:kworker.0 Request processed in 667us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361628.838127:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788361628.838277:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361628.838324:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144263040:0@lo:400:kworker.0 00000100:00100000:1.0:1788361628.838615:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144263552 00000100:00100000:1.0:1788361628.838621:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144263552 00000100:00100000:1.0:1788361628.838672:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788361628.838680:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144263552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361628.838729:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0564e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144263552:12345-0@lo:400:kworker.0 Request processed in 50us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361628.838735:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788361628.838773:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144263552:0@lo:400:kworker.0 00000100:00080000:0.0:1788361628.838835:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361628.839252:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144263424:12345-0@lo:400:kworker.0 Request processed in 4714us (5746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361628.839260:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788361628.839298:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144263424:0@lo:400:kworker.0 00010000:00010000:3.0:1788361629.088843:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361629.344337:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144263936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361629.344413:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361629.344922:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144263936 00000100:00100000:3.0:1788361629.344930:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144263936 00000100:00100000:3.0:1788361629.344994:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788361629.345004:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144263936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361629.345039:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788361629.345126:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144263936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361629.345135:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788361629.345154:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144263936:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788361629.858001:0:41724:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361629.858009:0:41724:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361629.858048:0:41724:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 2 00000040:00080000:3.0:1788361629.858055:0:41724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361630.115139:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361630.855994:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361630.856133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361630.856173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361630.856202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361630.856228:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361630.856270:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130894720 00000100:00100000:0.0:1788361630.856281:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130894720 00000100:00100000:3.0:1788361630.856297:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130895104 00000100:00100000:3.0:1788361630.856303:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130895104 00000100:00100000:3.0:1788361630.856349:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130894976 00000100:00100000:3.0:1788361630.856352:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130894976 00000100:00100000:3.0:1788361630.856376:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:3.0:1788361630.856386:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130895104:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361630.856439:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00100000:0.0:1788361630.856450:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130894720:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361630.856458:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130895104:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 72us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.856466:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:0.0:1788361630.856486:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130894720:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 37us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.856488:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:3.0:1788361630.856503:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130894976:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361630.856503:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00100000:3.0:1788361630.856554:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130894976:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 56us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361630.856562:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00080000:0.0:1788361630.856575:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361630.856580:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361630.856685:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130894848 00000100:00100000:1.0:1788361630.856691:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130894848 00000100:00080000:2.0:1788361630.856715:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361630.856737:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130895232 00000100:00100000:1.0:1788361630.856741:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130895232 00000100:00100000:1.0:1788361630.856815:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:1.0:1788361630.856822:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130894848:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361630.856858:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130894848:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 37us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361630.856864:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:1.0:1788361630.856883:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 164 00000100:00100000:1.0:1788361630.856889:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130895232:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361630.856912:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130895232:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 24us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361630.856934:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 164 00000100:00080000:2.0:1788361630.857599:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361631.136562:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361631.311875:0:41776:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361631.311885:0:41776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361631.311932:0:41776:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 12 count 2 00000040:00080000:3.0:1788361631.311938:0:41776:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1788361631.969257:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361631.969267:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361631.969544:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 11 count 1 00000040:00080000:1.0:1788361631.969551:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361632.160444:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361632.754066:0:41827:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361632.754074:0:41827:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361632.754881:0:41827:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361632.754892:0:41827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361633.184297:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361633.952303:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361633.952362:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144264064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361633.952413:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361633.952458:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144264064 00000100:00100000:3.0:1788361633.952466:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144264064 00000100:00080000:2.0:1788361633.952494:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361633.952515:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788361633.952523:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144264064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361633.952553:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361633.952606:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144264064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361633.952613:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788361633.952695:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144264064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361633.954554:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144264192:0@lo:400:kworker.0 00000100:00100000:3.0:1788361633.954612:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361633.954826:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144264320:0@lo:400:kworker.0 00000100:00100000:1.0:1788361633.954861:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361633.954911:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144264320 00000100:00100000:1.0:1788361633.954917:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144264320 00000100:00100000:1.0:1788361633.954971:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788361633.954975:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144264704:0@lo:400:kworker.0 00000100:00100000:1.0:1788361633.954983:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144264320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361633.955019:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361633.955055:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144264320:12345-0@lo:400:kworker.0 Request processed in 64us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361633.955062:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:1.0:1788361633.955115:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361633.955128:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144264576:0@lo:400:kworker.0 00000100:00100000:0.0:1788361633.955141:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144264192 00000100:00100000:0.0:1788361633.955148:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144264192 00000100:00100000:1.0:1788361633.955156:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361633.955184:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788361633.955187:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788361633.955195:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144264192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361633.955198:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144264448:0@lo:400:kworker.0 00000100:00100000:3.0:1788361633.955210:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144264704 00000100:00100000:3.0:1788361633.955217:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144264704 00000100:00100000:1.0:1788361633.955237:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361633.955257:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144264192:12345-0@lo:400:kworker.0 Request processed in 63us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361633.955266:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788361633.955271:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144264576 00000100:00100000:3.0:1788361633.955276:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144264576 00000100:00100000:1.0:1788361633.955278:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144264448 00000100:00100000:1.0:1788361633.955284:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144264448 00000100:00100000:3.0:1788361633.955319:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788361633.955321:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144264192:0@lo:400:kworker.0 00000100:00100000:3.0:1788361633.955331:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144264704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361633.955376:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788361633.955384:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788361633.955389:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144264704:12345-0@lo:400:kworker.0 Request processed in 58us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361633.955390:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144264576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361633.955399:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144264448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361633.955408:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788361633.955440:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144264576:12345-0@lo:400:kworker.0 Request processed in 56us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361633.955448:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788361633.955464:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144264448:12345-0@lo:400:kworker.0 Request processed in 68us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361633.955473:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788361633.955489:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144264704:0@lo:400:kworker.0 00000100:00080000:1.0:1788361633.955497:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361633.955521:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0567b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144264320:0@lo:400:kworker.0 00000100:00100000:0.0:1788361633.955537:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144264448:0@lo:400:kworker.0 00000100:00100000:0.0:1788361633.955550:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144264576:0@lo:400:kworker.0 00000040:00080000:1.0:1788361634.200195:0:41879:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361634.200204:0:41879:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361634.200749:0:41879:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361634.200759:0:41879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361634.208374:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361634.464355:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144264832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361634.464428:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361634.464613:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144264832 00000100:00100000:3.0:1788361634.464621:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144264832 00000100:00100000:3.0:1788361634.464724:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788361634.464735:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144264832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361634.464773:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788361634.464833:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144264832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361634.464840:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788361634.464915:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144264832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788361635.232302:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361635.669871:0:41930:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361635.669885:0:41930:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361635.670640:0:41930:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361635.670650:0:41930:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361635.976287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361635.976357:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130895360 00000100:00100000:0.0:1788361635.976366:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130895360 00000100:00100000:0.0:1788361635.976426:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:0.0:1788361635.976436:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130895360:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361635.976557:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130895360:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 121us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361635.976564:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:2.0:1788361635.978450:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361635.978513:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130895488 00000100:00100000:1.0:1788361635.978521:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130895488 00000100:00100000:1.0:1788361635.978629:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:1.0:1788361635.978638:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130895488:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361635.978705:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130895488:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 67us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361635.978712:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00080000:0.0:1788361635.978894:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361635.978934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361635.978978:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361635.979011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361635.979053:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130895616 00000100:00100000:2.0:1788361635.979057:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130895616 00000100:00100000:2.0:1788361635.979106:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130895744 00000100:00100000:2.0:1788361635.979109:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130895744 00000100:00100000:0.0:1788361635.979118:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130895872 00000100:00100000:0.0:1788361635.979121:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130895872 00000100:00100000:2.0:1788361635.979130:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:2.0:1788361635.979137:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130895616:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361635.979146:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:0.0:1788361635.979151:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130895872:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361635.979169:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130895616:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361635.979173:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab71b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130895872:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 22us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361635.979177:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:0.0:1788361635.979178:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:2.0:1788361635.979202:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00080000:0.0:1788361635.979204:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361635.979207:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361635.979208:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130895744:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:0.0:1788361635.979209:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361635.979246:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130895744:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361635.979252:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00010000:00010000:1.0:1788361636.256316:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361637.081400:0:41981:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361637.081410:0:41981:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361637.081923:0:41981:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361637.081933:0:41981:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361637.282163:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361638.304237:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361638.483207:0:42032:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361638.483217:0:42032:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361638.483795:0:42032:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361638.483803:0:42032:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361639.072341:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144264960:0@lo:400:kworker.0 00000100:00100000:1.0:1788361639.072416:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361639.072517:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144264960 00000100:00100000:2.0:1788361639.072525:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144264960 00000100:00100000:3.0:1788361639.072581:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361639.072581:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361639.072591:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788361639.072594:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144265088:0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.072598:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144265216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361639.072605:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144264960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.072639:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361639.072653:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361639.072677:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144265216 00000100:00100000:3.0:1788361639.072682:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144265216 00000100:00100000:2.0:1788361639.072689:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7472050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144264960:12345-0@lo:400:kworker.0 Request processed in 86us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361639.072697:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0565180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144264960:0@lo:400:kworker.0 00000100:00100000:2.0:1788361639.072700:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788361639.072729:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788361639.072736:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144265088 00000100:00100000:3.0:1788361639.072741:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144265216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361639.072742:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144265088 00002000:00000024:3.0:1788361639.072777:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1788361639.072784:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788361639.072793:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144265088:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361639.072820:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361639.072825:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144265216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (185us total) trans 0 rc 0/0 00000100:00080000:2.0:1788361639.072827:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361639.072835:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788361639.072846:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144265088:12345-0@lo:400:kworker.0 Request processed in 53us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361639.072855:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788361639.072872:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144265216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361639.072912:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144265088:0@lo:400:kworker.0 00000100:00100000:1.0:1788361639.073493:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361639.073503:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144265344:0@lo:400:kworker.0 00000100:00100000:1.0:1788361639.073535:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361639.073535:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144265600:0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.073541:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144265472:0@lo:400:kworker.0 00000100:00100000:1.0:1788361639.073574:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144265344 00000100:00100000:1.0:1788361639.073581:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144265344 00000100:00100000:0.0:1788361639.073581:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361639.073606:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144265600 00000100:00100000:3.0:1788361639.073611:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144265600 00000100:00100000:1.0:1788361639.073624:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788361639.073634:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144265344:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788361639.073651:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361639.073655:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788361639.073665:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144265600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361639.073700:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144265344:12345-0@lo:400:kworker.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361639.073709:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0565180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144265600:12345-0@lo:400:kworker.0 Request processed in 44us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361639.073711:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788361639.073721:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788361639.073736:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144265600:0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.073750:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361639.073760:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144265344:0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.073788:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144265472 00000100:00100000:3.0:1788361639.073793:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144265472 00000100:00100000:3.0:1788361639.073829:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00080000:0.0:1788361639.073834:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361639.073837:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144265472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361639.073874:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144265472:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361639.073881:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788361639.073899:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0565500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144265472:0@lo:400:kworker.0 00010000:00010000:1.0:1788361639.329553:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361639.585108:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361639.585140:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144265728:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361639.585209:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361639.585263:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144265728 00000100:00100000:1.0:1788361639.585272:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144265728 00000100:00100000:1.0:1788361639.585364:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788361639.585375:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144265728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361639.585419:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361639.585467:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144265728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361639.585475:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788361639.585740:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144265728:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788361639.913877:0:42083:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361639.913884:0:42083:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361639.915279:0:42083:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361639.915291:0:42083:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361640.352721:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361641.096664:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361641.096703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361641.096749:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361641.096773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361641.096824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361641.096853:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130896512 00000100:00100000:3.0:1788361641.096862:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130896512 00000100:00100000:2.0:1788361641.096883:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130896256 00000100:00100000:2.0:1788361641.096890:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130896256 00000100:00100000:2.0:1788361641.096927:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130896384 00000100:00100000:2.0:1788361641.096930:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130896384 00000100:00100000:3.0:1788361641.096933:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130896128 00000100:00100000:3.0:1788361641.096939:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130896128 00000100:00100000:2.0:1788361641.096957:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:2.0:1788361641.096971:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130896256:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361641.096976:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:3.0:1788361641.096990:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130896512:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361641.097059:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130896512:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 72us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361641.097074:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130896000 00000100:00100000:3.0:1788361641.097078:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:1.0:1788361641.097081:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130896000 00000100:00100000:3.0:1788361641.097125:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:3.0:1788361641.097139:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130896128:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361641.097151:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 183 00000100:00100000:1.0:1788361641.097161:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130896000:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361641.100166:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130896256:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 3189us (3451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361641.100182:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:3.0:1788361641.100200:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:3.0:1788361641.100215:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130896384:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:2.0:1788361641.100261:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361641.100267:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130896384:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 56us (3441us total) trans 0 rc 0/0 00000100:00080000:2.0:1788361641.100268:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361641.100273:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361641.100278:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:2.0:1788361641.100292:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130896128:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 3154us (3517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361641.100301:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:2.0:1788361641.101116:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130896000:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 3954us (4468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361641.101125:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 183 00000040:00080000:1.0:1788361641.184398:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361641.184407:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361641.184985:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361641.185006:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:0.0:1788361641.339106:0:42135:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361641.339116:0:42135:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361641.340343:0:42135:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361641.340358:0:42135:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361641.376459:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361642.401297:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361642.747698:0:42186:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361642.747708:0:42186:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361642.748275:0:42186:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361642.748285:0:42186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361643.425939:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361644.193134:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144265856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361644.193210:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361644.193287:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144265856 00000100:00100000:0.0:1788361644.193295:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144265856 00000100:00100000:0.0:1788361644.193358:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788361644.193368:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144265856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361644.193402:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361644.193448:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0565500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144265856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.193455:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788361644.193503:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144265856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361644.194102:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144265984:0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.194142:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144266240:0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.194144:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361644.194182:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8aa9cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144266496:0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.194189:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361644.194215:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361644.194221:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361644.194222:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361644.194231:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144266368:0@lo:400:kworker.0 00000100:00100000:2.0:1788361644.194246:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144265984 00000100:00100000:2.0:1788361644.194252:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144265984 00000100:00100000:1.0:1788361644.194265:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361644.194268:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361644.194288:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788361644.194297:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144265984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.194303:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144266240 00000100:00100000:1.0:1788361644.194309:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144266240 00000100:00100000:1.0:1788361644.194343:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144266496 00000100:00100000:1.0:1788361644.194346:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144266496 00000100:00100000:1.0:1788361644.194375:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144266368 00000100:00100000:1.0:1788361644.194378:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144266368 00000100:00100000:0.0:1788361644.194396:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144266112:0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.194400:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788361644.194410:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144266240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361644.194465:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144265984:12345-0@lo:400:kworker.0 Request processed in 168us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361644.194480:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788361644.194481:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361644.194488:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144266240:12345-0@lo:400:kworker.0 Request processed in 76us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361644.194497:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788361644.194518:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788361644.194523:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144265984:0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.194530:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144266496:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788361644.194543:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361644.194558:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788361644.194569:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144266368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.194576:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144266496:12345-0@lo:400:kworker.0 Request processed in 48us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361644.194584:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788361644.194612:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144266368:12345-0@lo:400:kworker.0 Request processed in 45us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.194619:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788361644.194624:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144266368:0@lo:400:kworker.0 00000100:00100000:1.0:1788361644.194639:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144266240:0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.194649:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144266112 00000100:00100000:0.0:1788361644.194655:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144266112 00000100:00100000:1.0:1788361644.194690:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8aa9cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144266496:0@lo:400:kworker.0 00000100:00080000:2.0:1788361644.194694:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361644.194699:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788361644.194708:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144266112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361644.194765:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144266112:12345-0@lo:400:kworker.0 Request processed in 59us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361644.194771:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788361644.194854:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144266112:0@lo:400:kworker.0 00000040:00080000:1.0:1788361644.220333:0:42238:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361644.220341:0:42238:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361644.221318:0:42238:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361644.221329:0:42238:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361644.448298:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361644.705464:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab7142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144266624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361644.705523:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361644.705658:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144266624 00000100:00100000:1.0:1788361644.705664:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144266624 00000100:00100000:1.0:1788361644.705703:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788361644.705709:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144266624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361644.705737:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361644.705815:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144266624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361644.705822:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788361644.705945:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab7142680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144266624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361645.472235:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361645.641894:0:42289:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361645.641902:0:42289:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361645.642423:0:42289:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361645.642433:0:42289:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361646.217212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361646.217261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361646.217303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361646.217335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361646.217364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361646.217392:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130896896 00000100:00100000:3.0:1788361646.217400:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130896896 00000100:00100000:3.0:1788361646.217444:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130897024 00000100:00100000:3.0:1788361646.217446:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130897024 00000100:00100000:3.0:1788361646.217480:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:3.0:1788361646.217491:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130896896:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361646.217567:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130896896:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 78us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361646.217575:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:3.0:1788361646.217600:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:3.0:1788361646.217607:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130897024:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361646.217628:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130897024:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 23us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361646.217634:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:2.0:1788361646.217867:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130896640 00000100:00100000:2.0:1788361646.217871:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130896640 00000100:00100000:2.0:1788361646.217905:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00100000:2.0:1788361646.217912:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130896640:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361646.217945:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130896640:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361646.217952:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00080000:2.0:1788361646.217984:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361646.217988:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361646.218173:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130897152 00000100:00100000:1.0:1788361646.218177:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130897152 00000100:00100000:1.0:1788361646.218219:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130896768 00000100:00100000:1.0:1788361646.218222:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130896768 00000100:00100000:1.0:1788361646.218245:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00100000:1.0:1788361646.218252:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130897152:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361646.218311:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130897152:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 58us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361646.218317:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00100000:1.0:1788361646.218331:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00100000:1.0:1788361646.218336:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130896768:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361646.218357:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130896768:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 21us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361646.218363:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00080000:2.0:1788361646.218562:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361646.496329:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361647.068870:0:42340:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361647.068879:0:42340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361647.069447:0:42340:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361647.069458:0:42340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361647.520965:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361648.527844:0:42392:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361648.527853:0:42392:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361648.528820:0:42392:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361648.528831:0:42392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361648.549026:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361649.314533:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144267008:0@lo:400:kworker.0 00000100:00100000:1.0:1788361649.314550:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144266752:0@lo:400:kworker.0 00000100:00100000:2.0:1788361649.314636:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144266880:0@lo:400:kworker.0 00000100:00100000:3.0:1788361649.314813:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144267136:0@lo:400:kworker.0 00000100:00100000:0.0:1788361649.314870:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361649.314876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361649.314935:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144267520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361649.314973:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361649.314977:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144267264:0@lo:400:kworker.0 00000100:00100000:1.0:1788361649.315010:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361649.315018:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144267520 00000100:00100000:0.0:1788361649.315027:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144267520 00000100:00100000:1.0:1788361649.315048:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144266752 00000100:00100000:1.0:1788361649.315053:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144266752 00000100:00100000:0.0:1788361649.315075:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788361649.315098:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144267520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361649.315125:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361649.315156:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b121500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144267520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361649.315161:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788361649.315194:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b060000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144267520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361649.315225:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144267264 00000100:00100000:0.0:1788361649.315228:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144267264 00000100:00100000:0.0:1788361649.315255:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788361649.315260:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144267264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361649.315291:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144267264:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361649.315297:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788361649.315321:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788361649.315327:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144266752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361649.315350:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144266752:12345-0@lo:400:kworker.0 Request processed in 23us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361649.315354:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788361649.315385:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144266752:0@lo:400:kworker.0 00000100:00100000:0.0:1788361649.315393:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144267264:0@lo:400:kworker.0 00000100:00100000:0.0:1788361649.315418:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144267008 00000100:00100000:0.0:1788361649.315421:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144267008 00000100:00100000:0.0:1788361649.315441:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788361649.315445:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144267008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361649.315473:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144267008:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361649.315478:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788361649.315502:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144267008:0@lo:400:kworker.0 00000100:00080000:0.0:1788361649.315531:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361649.315535:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361649.316846:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361649.316890:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898b120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144267392:0@lo:400:kworker.0 00000100:00100000:2.0:1788361649.316924:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361649.317028:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144266880 00000100:00100000:0.0:1788361649.317035:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144266880 00000100:00100000:0.0:1788361649.317149:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788361649.317157:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144266880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361649.317209:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144266880:12345-0@lo:400:kworker.0 Request processed in 53us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361649.317216:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788361649.317296:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144267392 00000100:00100000:1.0:1788361649.317302:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144267392 00000100:00080000:2.0:1788361649.317458:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361649.317463:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361649.317490:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144266880:0@lo:400:kworker.0 00000100:00100000:3.0:1788361649.317577:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361649.317690:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144267136 00000100:00100000:2.0:1788361649.317694:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144267136 00000100:00100000:2.0:1788361649.317767:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788361649.317774:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144267136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361649.317817:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b060000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144267136:12345-0@lo:400:kworker.0 Request processed in 44us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361649.317824:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788361649.317879:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144267136:0@lo:400:kworker.0 00000100:00100000:0.0:1788361649.318220:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788361649.318229:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144267392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361649.318279:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144267392:12345-0@lo:400:kworker.0 Request processed in 52us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361649.318285:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788361649.318348:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898b120a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144267392:0@lo:400:kworker.0 00010000:00010000:1.0:1788361649.568557:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361649.826680:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a843eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144267648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361649.826751:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361649.827030:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144267648 00000100:00100000:3.0:1788361649.827038:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144267648 00000100:00100000:3.0:1788361649.827129:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788361649.827140:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144267648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361649.827176:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788361649.827220:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b120a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144267648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361649.827228:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788361649.827765:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a843eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144267648:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788361649.946490:0:42443:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361649.946496:0:42443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361649.947027:0:42443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361649.947037:0:42443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361650.592807:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361651.335058:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361651.335123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361651.335219:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130897280 00000100:00100000:0.0:1788361651.335227:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130897280 00000100:00100000:1.0:1788361651.335243:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130897408 00000100:00100000:1.0:1788361651.335249:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130897408 00000100:00100000:0.0:1788361651.335266:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 187 00000100:00100000:0.0:1788361651.335275:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130897280:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361651.335298:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 183 00000100:00100000:1.0:1788361651.335309:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130897408:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361651.335332:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130897280:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 59us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361651.335338:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 187 00000100:00100000:1.0:1788361651.335349:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130897408:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 41us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361651.335358:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 183 00000100:00080000:1.0:1788361651.335381:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361651.335439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361651.335463:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130897536 00000100:00100000:0.0:1788361651.335467:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130897536 00000100:00100000:3.0:1788361651.335473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361651.335501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361651.335510:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130897664 00000100:00100000:0.0:1788361651.335515:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130897664 00000100:00100000:3.0:1788361651.335526:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130897792 00000100:00100000:3.0:1788361651.335532:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130897792 00000100:00100000:0.0:1788361651.335544:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 136 00000100:00100000:3.0:1788361651.335572:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:3.0:1788361651.335580:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130897792:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361651.335612:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130897792:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361651.335619:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:3.0:1788361651.335638:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:3.0:1788361651.335644:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130897664:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361651.335669:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130897664:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 24us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361651.335675:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:0.0:1788361651.335724:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130897536:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361651.335755:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130897536:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 204us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361651.335761:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 136 00000100:00080000:0.0:1788361651.335787:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361651.335790:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361651.335792:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788361651.350945:0:42494:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361651.350954:0:42494:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361651.351480:0:42494:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361651.351489:0:42494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1788361651.426069:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361651.426078:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361651.426646:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361651.426656:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361651.616484:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361652.640221:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361652.755913:0:42545:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361652.757834:0:42545:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361652.758534:0:42545:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361652.758548:0:42545:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361653.664593:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361654.175833:0:42596:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361654.175842:0:42596:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361654.176677:0:42596:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361654.176687:0:42596:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361654.434946:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898afdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144267776:0@lo:400:kworker.0 00000100:00100000:1.0:1788361654.434961:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144267904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361654.435022:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361654.435023:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361654.435106:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144267904 00000100:00100000:3.0:1788361654.435115:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144267904 00000100:00100000:3.0:1788361654.435169:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788361654.435179:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8aa9cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144267904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361654.435212:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1788361654.435411:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a870b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144268032:0@lo:400:kworker.0 00000100:00100000:1.0:1788361654.435716:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144268416:0@lo:400:kworker.0 00000100:00100000:1.0:1788361654.435747:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361654.435767:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788361654.435773:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144268288:0@lo:400:kworker.0 00000100:00100000:1.0:1788361654.435794:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361654.435819:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144268416 00000100:00100000:1.0:1788361654.435824:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144268416 00000100:00100000:1.0:1788361654.435852:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144268288 00000100:00100000:1.0:1788361654.435855:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144268288 00000100:00100000:1.0:1788361654.435872:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788361654.435878:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89921c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144268416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361654.435921:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89921c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144268416:12345-0@lo:400:kworker.0 Request processed in 42us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361654.435928:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788361654.435943:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788361654.435948:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89859cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144268288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361654.435972:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89859cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144268288:12345-0@lo:400:kworker.0 Request processed in 24us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361654.435976:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788361654.436009:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144268288:0@lo:400:kworker.0 00000100:00100000:1.0:1788361654.436017:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144268416:0@lo:400:kworker.0 00000100:00080000:1.0:1788361654.436040:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361654.436044:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361654.436055:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144268160:0@lo:400:kworker.0 00000100:00100000:1.0:1788361654.436075:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361654.436130:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144267776 00000100:00100000:1.0:1788361654.436133:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144267776 00000100:00100000:1.0:1788361654.436152:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788361654.436157:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144267776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361654.436201:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7473050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144267776:12345-0@lo:400:kworker.0 Request processed in 44us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361654.436207:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788361654.436249:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144268160 00000100:00100000:1.0:1788361654.436252:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144268160 00000100:00100000:1.0:1788361654.436273:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788361654.436278:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144268160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361654.436306:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144268160:12345-0@lo:400:kworker.0 Request processed in 28us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361654.436311:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788361654.436328:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8986704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144268160:0@lo:400:kworker.0 00000100:00100000:3.0:1788361654.436997:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8aa9cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144267904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1816us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361654.437008:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788361654.437017:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361654.437021:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898afdc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144267776:0@lo:400:kworker.0 00000100:00100000:2.0:1788361654.437048:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144268544:0@lo:400:kworker.0 00000100:00100000:0.0:1788361654.437051:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144268032 00000100:00100000:0.0:1788361654.437057:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144268032 00000100:00100000:2.0:1788361654.437076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361654.437120:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788361654.437128:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144268032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361654.437173:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144268032:12345-0@lo:400:kworker.0 Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00080000:3.0:1788361654.437174:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361654.437183:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788361654.437224:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144267904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361654.437471:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a870b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144268032:0@lo:400:kworker.0 00000100:00100000:2.0:1788361654.437490:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144268544 00000100:00100000:2.0:1788361654.437493:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144268544 00000100:00100000:0.0:1788361654.437551:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788361654.437560:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144268544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361654.437596:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144268544:12345-0@lo:400:kworker.0 Request processed in 38us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361654.437602:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:3.0:1788361654.437794:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361654.437922:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144268544:0@lo:400:kworker.0 00010000:00010000:0.0:1788361654.688330:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361654.944419:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144268672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361654.944484:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361654.944651:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144268672 00000100:00100000:0.0:1788361654.944660:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144268672 00000100:00100000:0.0:1788361654.944716:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788361654.944726:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144268672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361654.944761:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788361654.944929:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144268672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361654.944938:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788361654.945009:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144268672:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788361655.577747:0:42648:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361655.577755:0:42648:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361655.578403:0:42648:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361655.578412:0:42648:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361655.712625:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361656.457080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361656.457168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361656.457218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361656.457255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361656.457259:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130898304 00000100:00100000:3.0:1788361656.457268:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130898304 00000100:00100000:0.0:1788361656.457282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361656.457406:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130898048 00000100:00100000:1.0:1788361656.457411:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130898048 00000100:00100000:3.0:1788361656.457416:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130898176 00000100:00100000:3.0:1788361656.457422:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130898176 00000100:00100000:1.0:1788361656.457447:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130898432 00000100:00100000:1.0:1788361656.457451:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130898432 00000100:00100000:2.0:1788361656.457474:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130897920 00000100:00100000:2.0:1788361656.457480:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130897920 00000100:00100000:1.0:1788361656.457484:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:1.0:1788361656.457496:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898afdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130898048:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361656.457539:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:2.0:1788361656.457549:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130897920:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361656.457579:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898afdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130898048:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 85us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361656.457583:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130897920:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361656.457594:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:2.0:1788361656.457595:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:1.0:1788361656.457619:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:1.0:1788361656.457627:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130898432:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:2.0:1788361656.457641:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361656.457647:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361656.457650:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361656.457660:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130898432:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361656.457667:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:0.0:1788361656.458698:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 140 00000100:00100000:0.0:1788361656.458711:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130898304:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361656.458817:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130898304:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 110us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361656.458824:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 140 00000100:00100000:0.0:1788361656.458843:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:0.0:1788361656.458851:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130898176:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361656.458877:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130898176:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361656.458883:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 141 00010000:00010000:1.0:1788361656.736347:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361657.062940:0:42699:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361657.062948:0:42699:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361657.063467:0:42699:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361657.063480:0:42699:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361657.760898:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361658.506494:0:42750:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361658.506504:0:42750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361658.507055:0:42750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361658.507066:0:42750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361658.784317:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361659.552383:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144268800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361659.552427:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144268928:0@lo:400:kworker.0 00000100:00100000:2.0:1788361659.552493:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361659.552519:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361659.552577:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144269312:0@lo:400:kworker.0 00000100:00100000:1.0:1788361659.552606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361659.552637:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144269056:0@lo:400:kworker.0 00000100:00100000:1.0:1788361659.552664:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361659.552683:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361659.552689:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898705e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144269184:0@lo:400:kworker.0 00000100:00100000:1.0:1788361659.552712:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361659.552783:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144268800 00000100:00100000:3.0:1788361659.552791:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144268800 00000100:00100000:0.0:1788361659.552798:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144269056 00000100:00100000:3.0:1788361659.552858:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788361659.552866:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144269056 00000100:00100000:3.0:1788361659.552868:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144268800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361659.552909:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144269184 00000100:00100000:0.0:1788361659.552912:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144269184 00002000:00000024:3.0:1788361659.552932:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361659.552942:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788361659.552951:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144269056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361659.552987:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144268800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361659.552995:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788361659.553000:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144269056:12345-0@lo:400:kworker.0 Request processed in 48us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361659.553008:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788361659.553024:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788361659.553038:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144269184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361659.553070:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144269184:12345-0@lo:400:kworker.0 Request processed in 39us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361659.553141:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144269184:0@lo:400:kworker.0 00000100:00100000:1.0:1788361659.553153:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0564000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144269056:0@lo:400:kworker.0 00000100:00100000:0.0:1788361659.553163:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144269312 00000100:00100000:0.0:1788361659.553168:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144269312 00000100:00100000:1.0:1788361659.553184:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144269568:0@lo:400:kworker.0 00000100:00100000:0.0:1788361659.553199:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788361659.553207:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89923c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144269312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361659.553214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361659.553250:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89923c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144269312:12345-0@lo:400:kworker.0 Request processed in 44us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361659.553257:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144269568 00000100:00100000:0.0:1788361659.553259:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788361659.553262:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144269568 00000100:00100000:0.0:1788361659.553284:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144268928 00000100:00100000:0.0:1788361659.553290:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144268928 00000100:00100000:1.0:1788361659.553293:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788361659.553302:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144269568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361659.553321:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788361659.553331:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144268928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361659.553340:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0564000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144269568:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361659.553350:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788361659.553368:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7470850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144268928:12345-0@lo:400:kworker.0 Request processed in 39us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361659.553376:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788361659.553384:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144269568:0@lo:400:kworker.0 00000100:00100000:1.0:1788361659.553415:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898705fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144269312:0@lo:400:kworker.0 00000100:00080000:0.0:1788361659.553426:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361659.553431:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144268800:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788361659.553432:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361659.553436:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361659.553447:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361659.553455:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab6ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144269440:0@lo:400:kworker.0 00000100:00100000:1.0:1788361659.553478:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361659.553524:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144269440 00000100:00100000:0.0:1788361659.553528:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144269440 00000100:00100000:3.0:1788361659.553549:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788361659.553567:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788361659.553575:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144269440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361659.553616:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144269440:12345-0@lo:400:kworker.0 Request processed in 42us (137us total) trans 0 rc 0/0 00000100:00080000:1.0:1788361659.553617:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361659.553625:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788361659.553652:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab6ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144269440:0@lo:400:kworker.0 00000100:00100000:2.0:1788361659.554348:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144268928:0@lo:400:kworker.0 00010000:00010000:1.0:1788361659.809206:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361659.903846:0:42801:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361659.903854:0:42801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361659.904438:0:42801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361659.904446:0:42801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361660.064409:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144269696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361660.064691:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361660.064771:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144269696 00000100:00100000:1.0:1788361660.064782:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144269696 00000100:00100000:1.0:1788361660.064838:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788361660.064848:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144269696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361660.064946:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361660.065000:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144269696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361660.065009:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788361660.065047:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144269696:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361660.832341:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361661.462368:0:42852:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361661.462377:0:42852:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361661.464043:0:42852:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361661.464058:0:42852:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361661.575768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361661.575813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361661.575848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361661.575884:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130898944 00000100:00100000:2.0:1788361661.575893:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130898688 00000100:00100000:1.0:1788361661.575894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361661.575894:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130898944 00000100:00100000:2.0:1788361661.575901:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130898688 00000100:00100000:1.0:1788361661.575954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361661.575968:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130899072 00000100:00100000:2.0:1788361661.575972:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130899072 00000100:00100000:1.0:1788361661.575990:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130898816 00000100:00100000:1.0:1788361661.575996:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130898816 00000100:00100000:2.0:1788361661.576011:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:2.0:1788361661.576025:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898705e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130898688:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361661.576045:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:1.0:1788361661.576057:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130898816:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361661.576107:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:0.0:1788361661.576119:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130898944:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361661.576176:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130898816:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 122us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361661.576183:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00080000:1.0:1788361661.576204:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361661.576208:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361661.576210:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361661.576222:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 194 00000100:00100000:1.0:1788361661.576229:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130899072:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361661.576272:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130898560 00000100:00100000:3.0:1788361661.576277:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130898560 00000100:00100000:3.0:1788361661.576307:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 191 00000100:00100000:3.0:1788361661.576314:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130898560:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361661.577117:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898705e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130898688:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1094us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361661.577119:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130898944:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1002us (1303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361661.577129:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:0.0:1788361661.577134:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:1.0:1788361661.577149:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130899072:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 917us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361661.577158:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 194 00000100:00100000:3.0:1788361661.577338:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7471850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130898560:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1023us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361661.577348:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 191 00000040:00080000:2.0:1788361661.664392:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361661.664401:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361661.665178:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361661.665188:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361661.856308:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361662.880368:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361662.969230:0:42904:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361662.969239:0:42904:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361662.969818:0:42904:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361662.969827:0:42904:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361663.904480:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361664.461224:0:42955:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361664.461232:0:42955:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361664.461790:0:42955:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361664.461799:0:42955:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361664.672887:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144269824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361664.672965:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361664.673017:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144269824 00000100:00100000:3.0:1788361664.673026:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144269824 00000100:00080000:1.0:1788361664.673063:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361664.673126:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788361664.673148:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144269824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361664.673643:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361664.673703:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144269824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 567us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361664.673711:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788361664.673903:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144269824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361664.674030:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361664.674043:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144270336:0@lo:400:kworker.0 00000100:00100000:3.0:1788361664.674057:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144270080:0@lo:400:kworker.0 00000100:00100000:1.0:1788361664.674081:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361664.674118:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361664.674145:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144269952:0@lo:400:kworker.0 00000100:00100000:3.0:1788361664.674150:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361664.674159:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144270208:0@lo:400:kworker.0 00000100:00100000:1.0:1788361664.674177:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361664.674227:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144270336 00000100:00100000:2.0:1788361664.674233:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144270336 00000100:00100000:2.0:1788361664.674272:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788361664.674279:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144270336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361664.675634:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361664.675643:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144270464:0@lo:400:kworker.0 00000100:00100000:0.0:1788361664.675685:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361664.675742:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144270080 00000100:00100000:0.0:1788361664.675746:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144269952 00000100:00100000:1.0:1788361664.675749:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144270080 00000100:00100000:0.0:1788361664.675753:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144269952 00000100:00100000:0.0:1788361664.675795:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788361664.675801:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788361664.675807:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144269952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361664.675867:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144269952:12345-0@lo:400:kworker.0 Request processed in 64us (1691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361664.675875:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788361664.675930:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144270080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361664.675967:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144270080:12345-0@lo:400:kworker.0 Request processed in 157us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361664.675973:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788361664.676016:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144270080:0@lo:400:kworker.0 00000100:00100000:1.0:1788361664.676058:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1566d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144269952:0@lo:400:kworker.0 00000100:00100000:2.0:1788361664.676769:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144270336:12345-0@lo:400:kworker.0 Request processed in 2487us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361664.676777:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788361664.677787:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144270208 00000100:00100000:3.0:1788361664.677796:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144270208 00000100:00100000:3.0:1788361664.677849:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144270464 00000100:00100000:3.0:1788361664.677852:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144270464 00000100:00100000:3.0:1788361664.677874:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788361664.677883:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144270208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361664.677913:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788361664.677925:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144270464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361664.677953:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144270208:12345-0@lo:400:kworker.0 Request processed in 71us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361664.677961:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788361664.677980:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab6ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144270464:12345-0@lo:400:kworker.0 Request processed in 57us (2293us total) trans 0 rc 0/0 00000100:00080000:3.0:1788361664.677987:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361664.677988:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00080000:3.0:1788361664.677994:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361664.678042:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144270208:0@lo:400:kworker.0 00000100:00100000:3.0:1788361664.678070:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1564a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144270336:0@lo:400:kworker.0 00000100:00100000:3.0:1788361664.678123:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1567800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144270464:0@lo:400:kworker.0 00010000:00010000:1.0:1788361664.928447:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361665.184436:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144270592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361665.184506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361665.184811:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144270592 00000100:00100000:0.0:1788361665.184820:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144270592 00000100:00100000:0.0:1788361665.186210:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788361665.186224:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144270592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361665.186263:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788361665.186682:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144270592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 462us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361665.186691:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788361665.186767:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144270592:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788361665.879651:0:43006:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361665.879659:0:43006:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361665.880182:0:43006:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361665.880190:0:43006:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361665.955605:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361666.698927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361666.698976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361666.699014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361666.699044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361666.699071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361666.699126:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130899328 00000100:00100000:1.0:1788361666.699136:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130899328 00000100:00100000:1.0:1788361666.699186:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130899712 00000100:00100000:1.0:1788361666.699189:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130899712 00000100:00100000:1.0:1788361666.699211:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 198 00000100:00100000:1.0:1788361666.699218:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130899328:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361666.699289:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130899328:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 70us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361666.699297:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 198 00000100:00100000:1.0:1788361666.699314:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:1.0:1788361666.699321:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130899712:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361666.699347:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130899712:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 27us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361666.699353:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00080000:3.0:1788361666.699509:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361666.699842:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130899456 00000100:00100000:2.0:1788361666.699848:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130899456 00000100:00100000:2.0:1788361666.699887:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130899584 00000100:00100000:2.0:1788361666.699890:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130899584 00000100:00100000:2.0:1788361666.699914:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:2.0:1788361666.699922:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130899456:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361666.699955:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130899456:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.699961:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:2.0:1788361666.699976:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:2.0:1788361666.699983:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130899584:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361666.700008:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130899584:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361666.700014:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:0.0:1788361666.700712:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130899200 00000100:00100000:0.0:1788361666.700719:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130899200 00000100:00100000:0.0:1788361666.700764:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:0.0:1788361666.700772:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130899200:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361666.700806:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7243c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130899200:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 36us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361666.700813:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00080000:3.0:1788361666.700993:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361666.700998:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788361666.977532:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361667.276012:0:43057:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361667.276021:0:43057:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361667.276632:0:43057:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361667.276642:0:43057:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361668.000374:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361668.658068:0:43108:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361668.658077:0:43108:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361668.658579:0:43108:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361668.658588:0:43108:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361669.024375:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361669.792310:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361669.792331:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144270720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361669.792365:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144270848:0@lo:400:kworker.0 00000100:00100000:1.0:1788361669.792422:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361669.792422:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361669.792518:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144271232:0@lo:400:kworker.0 00000100:00100000:2.0:1788361669.792556:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361669.792606:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144270976:0@lo:400:kworker.0 00000100:00100000:1.0:1788361669.792609:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144271104:0@lo:400:kworker.0 00000100:00100000:0.0:1788361669.792614:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144271360:0@lo:400:kworker.0 00000100:00100000:3.0:1788361669.792655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361669.792670:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361669.792679:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144270720 00000100:00100000:3.0:1788361669.792688:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144271488:0@lo:400:kworker.0 00000100:00100000:1.0:1788361669.792688:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144270720 00000100:00100000:3.0:1788361669.792721:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361669.792725:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144270848 00000100:00100000:0.0:1788361669.792730:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144270848 00000100:00100000:1.0:1788361669.792775:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788361669.792775:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788361669.792777:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144270976 00000100:00100000:3.0:1788361669.792784:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144270976 00000100:00100000:1.0:1788361669.792795:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144270720:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361669.792795:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144270848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361669.792835:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00002000:00000024:1.0:1788361669.792842:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361669.792846:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144270976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361669.792866:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144270848:12345-0@lo:400:kworker.0 Request processed in 77us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361669.792874:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788361669.792899:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144270976:12345-0@lo:400:kworker.0 Request processed in 56us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361669.792908:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788361669.792914:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90705500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144270720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361669.792923:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788361669.792942:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144270848:0@lo:400:kworker.0 00000100:00100000:1.0:1788361669.792949:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144271232 00000100:00100000:1.0:1788361669.792954:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144271232 00000100:00100000:3.0:1788361669.792958:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144270976:0@lo:400:kworker.0 00000100:00100000:2.0:1788361669.792958:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144271360 00000100:00100000:2.0:1788361669.792963:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144271360 00000100:00100000:1.0:1788361669.792986:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144271488 00000100:00100000:3.0:1788361669.792989:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361669.792990:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144271488 00000100:00100000:0.0:1788361669.793000:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788361669.793010:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788361669.793012:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144271232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361669.793022:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144271360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361669.793026:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788361669.793027:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144270720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361669.793038:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144271488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361669.793051:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144271104 00000100:00100000:3.0:1788361669.793056:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144271104 00000100:00100000:0.0:1788361669.793070:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1567800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144271232:12345-0@lo:400:kworker.0 Request processed in 60us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361669.793079:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788361669.793108:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144271360:12345-0@lo:400:kworker.0 Request processed in 64us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361669.793111:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788361669.793122:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788361669.793123:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144271104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361669.793124:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144271488:12345-0@lo:400:kworker.0 Request processed in 85us (400us total) trans 0 rc 0/0 00000100:00080000:0.0:1788361669.793125:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361669.793133:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361669.793138:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1788361669.793138:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361669.793163:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144271232:0@lo:400:kworker.0 00000100:00100000:3.0:1788361669.793173:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144271104:12345-0@lo:400:kworker.0 Request processed in 54us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361669.793181:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788361669.793183:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144271488:0@lo:400:kworker.0 00000100:00100000:2.0:1788361669.793198:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144271360:0@lo:400:kworker.0 00000100:00100000:3.0:1788361669.793211:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144271104:0@lo:400:kworker.0 00010000:00010000:1.0:1788361670.048370:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361670.055817:0:43160:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361670.055831:0:43160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361670.057138:0:43160:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361670.057154:0:43160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361670.304414:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788361670.304449:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144271616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361670.304543:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361670.304593:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144271616 00000100:00100000:0.0:1788361670.304606:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144271616 00000100:00100000:0.0:1788361670.304672:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788361670.304683:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144271616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361670.304729:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788361670.304790:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1564a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144271616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361670.304808:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788361670.304859:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144271616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361671.072466:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361671.474987:0:43211:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361671.474997:0:43211:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361671.475764:0:43211:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361671.475776:0:43211:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361671.816752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361671.816805:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361671.816837:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130899840 00000100:00100000:0.0:1788361671.816847:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130899840 00000100:00100000:2.0:1788361671.816885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361671.816908:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:0.0:1788361671.816918:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130899840:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361671.816984:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130899840:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 67us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361671.816992:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:0.0:1788361671.817057:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130900352 00000100:00100000:0.0:1788361671.817061:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130900352 00000100:00100000:0.0:1788361671.817119:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:0.0:1788361671.817127:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130900352:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361671.817160:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130900352:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361671.817167:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130900096 00000100:00100000:0.0:1788361671.817167:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:3.0:1788361671.817175:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130900096 00000100:00080000:0.0:1788361671.817191:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361671.817196:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361671.817229:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:3.0:1788361671.817238:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130900096:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361671.817267:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130900096:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 31us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361671.817273:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:2.0:1788361671.817349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361671.817403:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130899968 00000100:00100000:0.0:1788361671.817408:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130899968 00000100:00100000:0.0:1788361671.817453:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:0.0:1788361671.817460:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130899968:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:3.0:1788361671.817945:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361671.817992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361671.818121:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1565880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130899968:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 660us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361671.818130:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:1.0:1788361671.819419:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130900224 00000100:00100000:1.0:1788361671.819429:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130900224 00000100:00100000:1.0:1788361671.819503:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00100000:1.0:1788361671.819513:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130900224:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361671.819585:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130900224:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 73us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361671.819592:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00080000:3.0:1788361671.819669:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788361671.904402:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361671.904410:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361671.905596:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361671.905610:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361672.096573:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361672.928257:0:43262:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361672.928266:0:43262:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361672.928926:0:43262:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361672.928937:0:43262:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361673.120290:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361674.144360:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361674.338278:0:43313:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361674.338287:0:43313:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361674.338836:0:43313:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361674.338845:0:43313:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361674.912732:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144271872:0@lo:400:kworker.0 00000100:00100000:2.0:1788361674.912789:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144271744:0@lo:400:kworker.0 00000100:00100000:3.0:1788361674.912814:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361674.912848:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144272128:0@lo:400:kworker.0 00000100:00100000:1.0:1788361674.912902:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144272000:0@lo:400:kworker.0 00000100:00100000:3.0:1788361674.914060:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144272384:0@lo:400:kworker.0 00000100:00100000:0.0:1788361674.914078:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361674.914128:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144271872 00000100:00100000:3.0:1788361674.914136:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144271872 00000100:00100000:0.0:1788361674.914166:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144272128 00000100:00100000:0.0:1788361674.914172:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144272128 00000100:00100000:3.0:1788361674.914210:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788361674.914212:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788361674.914224:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144271872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361674.914225:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144272128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361674.914286:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144271872:12345-0@lo:400:kworker.0 Request processed in 65us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361674.914295:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788361674.914301:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144272128:12345-0@lo:400:kworker.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361674.914309:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:3.0:1788361674.914329:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361674.914351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361674.914355:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144272128:0@lo:400:kworker.0 00000100:00100000:3.0:1788361674.914394:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144271872:0@lo:400:kworker.0 00000100:00100000:0.0:1788361674.914398:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144272384 00000100:00100000:0.0:1788361674.914403:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144272384 00000100:00080000:3.0:1788361674.914430:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361674.914444:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788361674.914453:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144272384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361674.914489:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144272384:12345-0@lo:400:kworker.0 Request processed in 37us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361674.914497:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788361674.914519:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361674.914559:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144272512:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361674.914585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361674.914619:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144272512 00000100:00100000:1.0:1788361674.914623:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144272512 00000100:00100000:3.0:1788361674.914631:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144272384:0@lo:400:kworker.0 00000100:00080000:3.0:1788361674.914661:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361674.914665:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144272000 00000100:00100000:0.0:1788361674.914670:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144272000 00000100:00100000:1.0:1788361674.914688:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788361674.914700:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144272512:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361674.914706:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788361674.914713:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361674.914718:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144272000:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788361674.914731:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1788361674.914763:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144272256:0@lo:400:kworker.0 00000100:00100000:2.0:1788361674.914808:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361674.914840:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144271744 00000100:00100000:2.0:1788361674.914844:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144271744 00000100:00100000:2.0:1788361674.914871:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788361674.914877:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144271744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361674.914921:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7243850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144271744:12345-0@lo:400:kworker.0 Request processed in 41us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361674.914930:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788361674.914957:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144272256 00000100:00100000:2.0:1788361674.914961:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144272256 00000100:00100000:2.0:1788361674.914989:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788361674.914994:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a870b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144272256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361674.915023:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a870b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144272256:12345-0@lo:400:kworker.0 Request processed in 28us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361674.915028:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788361674.915065:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144271744:0@lo:400:kworker.0 00000100:00100000:2.0:1788361674.915075:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144272256:0@lo:400:kworker.0 00000100:00080000:3.0:1788361674.915999:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361674.916041:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144272512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1343us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361674.916051:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788361674.916122:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144272000:12345-0@lo:400:kworker.0 Request processed in 1406us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361674.916130:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788361674.916187:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144272000:0@lo:400:kworker.0 00000100:00100000:1.0:1788361674.916199:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144272512:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788361675.168626:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361675.425699:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361675.425722:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144272640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361675.425799:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361675.425868:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144272640 00000100:00100000:3.0:1788361675.425876:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144272640 00000100:00100000:3.0:1788361675.425921:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788361675.425930:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144272640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361675.425964:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788361675.426008:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144272640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361675.426014:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788361675.426058:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144272640:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788361675.759124:0:43364:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361675.759134:0:43364:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361675.759911:0:43364:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361675.759923:0:43364:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361676.192568:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361676.936036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361676.936080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361676.936145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361676.936151:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130900608 00000100:00100000:1.0:1788361676.936155:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130900480 00000100:00100000:0.0:1788361676.936161:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130900608 00000100:00100000:1.0:1788361676.936162:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130900480 00000100:00100000:3.0:1788361676.936182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361676.936209:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:1.0:1788361676.936219:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130900480:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361676.936280:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7242450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130900480:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 64us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361676.936287:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:0.0:1788361676.936352:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:1.0:1788361676.936357:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130900864 00000100:00100000:1.0:1788361676.936362:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130900864 00000100:00100000:0.0:1788361676.936364:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130900608:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361676.936399:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130900736 00000100:00100000:2.0:1788361676.936405:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130900736 00000100:00100000:1.0:1788361676.936406:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 155 00000100:00100000:0.0:1788361676.936407:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130900608:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 44us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361676.936419:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:1.0:1788361676.936423:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130900864:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361676.936448:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 156 00000100:00100000:1.0:1788361676.936459:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130900864:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 41us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.936461:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130900736:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:0.0:1788361676.936463:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361676.936469:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361676.936473:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 155 00000100:00080000:0.0:1788361676.936474:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361676.936501:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130900736:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 44us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361676.936510:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 156 00000100:00100000:2.0:1788361676.936786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361676.936855:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130900992 00000100:00100000:0.0:1788361676.936860:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130900992 00000100:00100000:0.0:1788361676.936952:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:0.0:1788361676.936959:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130900992:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361676.936999:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130900992:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 40us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361676.937005:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00080000:1.0:1788361676.937078:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788361677.205684:0:43416:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361677.205693:0:43416:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361677.206244:0:43416:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361677.206253:0:43416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361677.216413:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361678.240660:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361678.611360:0:43467:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361678.611369:0:43467:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361678.611898:0:43467:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361678.611906:0:43467:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361679.264306:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361680.032570:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144272768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361680.032674:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361680.032992:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144272768 00000100:00100000:3.0:1788361680.033002:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144272768 00000100:00100000:2.0:1788361680.033485:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144273152:0@lo:400:kworker.0 00000100:00100000:2.0:1788361680.033565:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361680.033680:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788361680.033695:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144272768:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361680.033835:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361680.033944:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144273280:0@lo:400:kworker.0 00000100:00100000:2.0:1788361680.033988:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361680.034042:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144273280 00000100:00100000:0.0:1788361680.034042:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144273152 00000100:00100000:2.0:1788361680.034049:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144273280 00000100:00100000:0.0:1788361680.034059:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144273152 00000100:00100000:2.0:1788361680.034127:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788361680.034138:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144273280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361680.034167:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788361680.034187:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144273152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361680.034215:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144273280:12345-0@lo:400:kworker.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361680.034226:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00002000:00000024:3.0:1788361680.034227:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1788361680.034301:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144273280:0@lo:400:kworker.0 00000100:00100000:0.0:1788361680.034326:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144273152:12345-0@lo:400:kworker.0 Request processed in 144us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361680.034330:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144272768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 637us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361680.034332:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144273152:0@lo:400:kworker.0 00000100:00100000:0.0:1788361680.034376:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788361680.034525:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788361680.034564:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144272896:0@lo:400:kworker.0 00000100:00100000:3.0:1788361680.034605:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361680.034640:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144273408:0@lo:400:kworker.0 00000100:00100000:3.0:1788361680.034671:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361680.034696:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361680.034703:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144273024:0@lo:400:kworker.0 00000100:00080000:2.0:1788361680.036527:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361680.036537:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788361680.036540:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361680.036601:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144272768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361680.036617:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144272896 00000100:00100000:3.0:1788361680.036625:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144272896 00000100:00100000:2.0:1788361680.036660:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144273408 00000100:00100000:2.0:1788361680.036667:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144273408 00000040:00080000:0.0:1788361680.036673:0:43518:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000100:00100000:3.0:1788361680.036678:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000040:00080000:0.0:1788361680.036680:0:43518:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788361680.036693:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144272896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361680.036712:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788361680.036721:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144273408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361680.036766:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7240450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144272896:12345-0@lo:400:kworker.0 Request processed in 77us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361680.036776:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788361680.036812:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144273024 00000100:00100000:3.0:1788361680.036818:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144273024 00000100:00100000:3.0:1788361680.036853:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788361680.036860:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144273024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361680.036906:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144273024:12345-0@lo:400:kworker.0 Request processed in 44us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361680.036913:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788361680.036949:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144273408:12345-0@lo:400:kworker.0 Request processed in 224us (2271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361680.036958:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788361680.036974:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144273024:0@lo:400:kworker.0 00000100:00080000:2.0:1788361680.036993:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361680.036994:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144272896:0@lo:400:kworker.0 00000100:00080000:2.0:1788361680.036999:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361680.037017:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144273408:0@lo:400:kworker.0 00000040:00080000:0.0:1788361680.037256:0:43518:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361680.037264:0:43518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361680.288295:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361680.544342:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144273536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361680.544451:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361680.544643:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144273536 00000100:00100000:3.0:1788361680.544654:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144273536 00000100:00100000:3.0:1788361680.544713:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788361680.544720:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144273536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361680.544776:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788361680.544863:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144273536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361680.544877:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788361680.545017:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144273536:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788361681.120365:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361681.120374:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361681.120939:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361681.120950:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361681.312246:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361681.388656:0:43569:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361681.388665:0:43569:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361681.389268:0:43569:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361681.389276:0:43569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361682.055606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361682.055651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361682.055694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361682.055743:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130901632 00000100:00100000:3.0:1788361682.055832:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130901376 00000100:00100000:3.0:1788361682.055837:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130901376 00000100:00100000:3.0:1788361682.055901:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:3.0:1788361682.055912:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130901376:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361682.055989:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130901120 00000100:00100000:2.0:1788361682.055995:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130901632 00000100:00100000:1.0:1788361682.055996:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130901120 00000100:00080000:0.0:1788361682.056004:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361682.056016:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361682.056053:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:1.0:1788361682.056055:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:2.0:1788361682.056067:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130901632:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361682.056075:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130901120:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361682.056527:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b064e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130901632:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 462us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361682.056535:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130901120:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 457us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361682.056536:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:3.0:1788361682.056537:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130901376:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 627us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361682.056554:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:1.0:1788361682.056556:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:0.0:1788361682.056626:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361682.056679:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130901248 00000100:00100000:1.0:1788361682.056685:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130901248 00000100:00100000:0.0:1788361682.056735:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361682.056759:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:1.0:1788361682.056768:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130901248:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361682.056809:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130901248:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 42us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361682.056815:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:3.0:1788361682.056881:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130901504 00000100:00100000:3.0:1788361682.056886:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130901504 00000100:00100000:3.0:1788361682.056921:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:3.0:1788361682.056929:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130901504:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361682.056970:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130901504:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 42us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361682.056977:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00080000:2.0:1788361682.057768:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361682.057774:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361682.336942:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361682.745951:0:43620:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361682.745964:0:43620:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361682.746507:0:43620:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361682.746521:0:43620:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361683.360288:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361684.122924:0:43672:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361684.122932:0:43672:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361684.123468:0:43672:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361684.123477:0:43672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361684.385733:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361685.152478:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361685.152514:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144273792:0@lo:400:kworker.0 00000100:00100000:1.0:1788361685.152581:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144273920:0@lo:400:kworker.0 00000100:00100000:3.0:1788361685.152614:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361685.152671:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361685.152683:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144274048:0@lo:400:kworker.0 00000100:00100000:3.0:1788361685.152715:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144273664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361685.152758:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144274176:0@lo:400:kworker.0 00000100:00100000:1.0:1788361685.152777:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144274432:0@lo:400:kworker.0 00000100:00100000:2.0:1788361685.154081:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361685.154159:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144273920 00000100:00100000:2.0:1788361685.154168:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144273920 00000100:00100000:2.0:1788361685.154227:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144274048 00000100:00100000:2.0:1788361685.154230:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144274048 00000100:00100000:0.0:1788361685.154266:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361685.154279:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788361685.154292:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361685.154294:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144273920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361685.154330:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361685.154350:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144274304:0@lo:400:kworker.0 00000100:00100000:3.0:1788361685.154355:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144273792 00000100:00100000:3.0:1788361685.154362:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144273792 00000100:00100000:1.0:1788361685.154364:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144273920:12345-0@lo:400:kworker.0 Request processed in 72us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361685.154375:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788361685.154405:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361685.154415:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788361685.154434:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab7242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144273792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361685.154464:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144274176 00000100:00100000:1.0:1788361685.154470:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144274176 00000100:00100000:0.0:1788361685.154492:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361685.154503:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab7242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144273792:12345-0@lo:400:kworker.0 Request processed in 76us (1888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361685.154511:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788361685.154523:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144274304 00000100:00100000:1.0:1788361685.154528:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144274304 00000100:00100000:1.0:1788361685.154563:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144274432 00000100:00100000:1.0:1788361685.154566:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144274432 00000100:00100000:0.0:1788361685.154571:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144273920:0@lo:400:kworker.0 00000100:00100000:3.0:1788361685.154583:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144273792:0@lo:400:kworker.0 00000100:00100000:1.0:1788361685.154593:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788361685.154602:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144274176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361685.154628:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788361685.154638:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144274304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361685.154677:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788361685.154679:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144274176:12345-0@lo:400:kworker.0 Request processed in 69us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361685.154706:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144274304:12345-0@lo:400:kworker.0 Request processed in 47us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361685.154706:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144274432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361685.154718:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788361685.154729:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788361685.154767:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788361685.154778:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144274048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361685.154783:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144274304:0@lo:400:kworker.0 00000100:00100000:2.0:1788361685.154786:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144273664 00000100:00100000:2.0:1788361685.154792:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144273664 00000100:00100000:0.0:1788361685.154811:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144274432:12345-0@lo:400:kworker.0 Request processed in 119us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361685.154812:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144274176:0@lo:400:kworker.0 00000100:00100000:2.0:1788361685.154830:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788361685.154838:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788361685.154844:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144273664:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361685.154851:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144274048:12345-0@lo:400:kworker.0 Request processed in 76us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361685.154859:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00002000:00000024:2.0:1788361685.154872:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00080000:3.0:1788361685.154886:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361685.154891:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144274432:0@lo:400:kworker.0 00000100:00080000:3.0:1788361685.154892:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361685.154898:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361685.154918:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144273664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361685.154926:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788361685.154960:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144274048:0@lo:400:kworker.0 00000100:00100000:3.0:1788361685.155108:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144273664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788361685.409660:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361685.502761:0:43723:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361685.502769:0:43723:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361685.503420:0:43723:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361685.503429:0:43723:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361685.664581:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144274560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361685.664650:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361685.664727:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144274560 00000100:00100000:0.0:1788361685.664736:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144274560 00000100:00100000:0.0:1788361685.664791:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788361685.664798:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144274560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361685.664833:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788361685.664878:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144274560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361685.664884:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788361685.664906:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144274560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361686.432996:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361686.913951:0:43774:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361686.913959:0:43774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361686.914490:0:43774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361686.914499:0:43774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361687.177472:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361687.177657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361687.177709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361687.177740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361687.177770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361687.177820:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130902272 00000100:00100000:0.0:1788361687.177833:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130902272 00000100:00100000:0.0:1788361687.177899:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130901888 00000100:00100000:0.0:1788361687.177902:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130901888 00000100:00100000:0.0:1788361687.177930:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:0.0:1788361687.177942:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130902272:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361687.178036:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130902272:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 97us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361687.178044:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:0.0:1788361687.178065:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:0.0:1788361687.178070:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130901888:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361687.178128:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130901888:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 57us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361687.178135:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00080000:3.0:1788361687.178549:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361687.178727:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130901760 00000100:00100000:1.0:1788361687.178733:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130901760 00000100:00100000:1.0:1788361687.178778:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:1.0:1788361687.178786:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130901760:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361687.178890:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130901760:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 105us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361687.178898:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:2.0:1788361687.181492:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130902016 00000100:00100000:2.0:1788361687.181526:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130902016 00000100:00100000:2.0:1788361687.181657:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130902144 00000100:00100000:2.0:1788361687.181662:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130902144 00000100:00100000:3.0:1788361687.181692:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:3.0:1788361687.181707:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130902016:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:0.0:1788361687.181806:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361687.181813:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361687.182296:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:2.0:1788361687.182306:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130902144:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361687.182349:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130902144:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 45us (4577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361687.182357:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:3.0:1788361687.183040:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130902016:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1333us (5378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361687.183050:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 162 00010000:00010000:1.0:1788361687.457556:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361688.327042:0:43826:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361688.327052:0:43826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361688.327825:0:43826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361688.327834:0:43826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361688.480731:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361689.505421:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361689.794582:0:43877:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361689.794592:0:43877:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361689.795191:0:43877:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361689.795200:0:43877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361690.272280:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361690.272303:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144274688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361690.272360:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361690.272784:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144274688 00000100:00100000:2.0:1788361690.272792:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144274688 00000100:00100000:2.0:1788361690.272855:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788361690.272865:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144274688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361690.272896:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1788361690.272944:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144274688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361690.272952:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788361690.273073:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144274816:0@lo:400:kworker.0 00000100:00100000:2.0:1788361690.273134:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788361690.273158:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361690.273163:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144275328:0@lo:400:kworker.0 00000100:00100000:1.0:1788361690.273183:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144275072:0@lo:400:kworker.0 00000100:00100000:2.0:1788361690.273191:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361690.273225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361690.273231:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144274688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361690.273238:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144274816 00000100:00100000:3.0:1788361690.273244:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144274816 00000100:00100000:2.0:1788361690.273254:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361690.273257:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788361690.273263:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144275200:0@lo:400:kworker.0 00000100:00100000:1.0:1788361690.273269:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144274944:0@lo:400:kworker.0 00000100:00100000:2.0:1788361690.273293:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361690.273307:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788361690.273313:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361690.273379:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144274816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361690.273414:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144275328 00000100:00100000:1.0:1788361690.273420:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144275328 00000100:00100000:3.0:1788361690.273424:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144274816:12345-0@lo:400:kworker.0 Request processed in 47us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361690.273432:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788361690.273456:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144274816:0@lo:400:kworker.0 00000100:00100000:1.0:1788361690.273468:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144275072 00000100:00100000:3.0:1788361690.273471:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144275200 00000100:00100000:1.0:1788361690.273473:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144275072 00000100:00100000:3.0:1788361690.273477:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144275200 00000100:00100000:2.0:1788361690.273495:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144274944 00000100:00100000:2.0:1788361690.273500:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144274944 00000100:00100000:1.0:1788361690.273507:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788361690.273514:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788361690.273520:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144275328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361690.273527:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144275072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361690.273560:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788361690.273571:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144274944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361690.273621:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788361690.273629:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144275200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361690.273845:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144275328:12345-0@lo:400:kworker.0 Request processed in 329us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361690.273853:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788361690.273865:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144274944:12345-0@lo:400:kworker.0 Request processed in 295us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361690.273873:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1788361690.273886:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361690.273891:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361690.273908:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144275328:0@lo:400:kworker.0 00000100:00100000:1.0:1788361690.273944:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144274944:0@lo:400:kworker.0 00000100:00100000:1.0:1788361690.273958:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144275072:0@lo:400:kworker.0 00000100:00100000:0.0:1788361690.274109:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144275200:12345-0@lo:400:kworker.0 Request processed in 481us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361690.274114:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788361690.274187:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144275200:0@lo:400:kworker.0 00000100:00100000:3.0:1788361690.274273:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144275072:12345-0@lo:400:kworker.0 Request processed in 749us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361690.274279:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00010000:00010000:1.0:1788361690.528696:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361690.784368:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144275456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361690.784439:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361690.784775:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144275456 00000100:00100000:0.0:1788361690.784783:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144275456 00000100:00100000:0.0:1788361690.784839:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788361690.784849:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144275456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361690.784883:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788361690.784948:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90705180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144275456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361690.784956:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788361690.784978:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144275456:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788361691.203081:0:43929:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361691.203113:0:43929:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361691.203650:0:43929:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361691.204411:0:43929:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1788361691.360422:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361691.360436:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361691.361055:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361691.361070:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361691.552345:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361692.295362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361692.295411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361692.295440:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361692.295455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361692.295475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361692.295495:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130902784 00000100:00100000:0.0:1788361692.295502:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130902784 00000100:00100000:0.0:1788361692.295543:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130902656 00000100:00100000:0.0:1788361692.295545:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130902656 00000100:00100000:0.0:1788361692.295572:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:0.0:1788361692.295580:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130902784:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361692.295634:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130902784:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 56us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361692.295639:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:0.0:1788361692.295663:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:0.0:1788361692.295673:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130902656:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361692.295699:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130902656:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 30us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361692.295705:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:2.0:1788361692.295752:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130902400 00000100:00100000:2.0:1788361692.295758:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130902400 00000100:00100000:2.0:1788361692.295793:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:2.0:1788361692.295801:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130902400:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361692.295833:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130902400:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361692.295839:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:1.0:1788361692.295929:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130902528 00000100:00100000:1.0:1788361692.295933:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130902528 00000100:00100000:1.0:1788361692.295973:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130902912 00000100:00100000:1.0:1788361692.295976:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130902912 00000100:00100000:1.0:1788361692.296007:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:1.0:1788361692.296013:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130902528:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361692.296045:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130902528:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361692.296051:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:1.0:1788361692.296067:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:1.0:1788361692.296073:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130902912:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361692.296130:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130902912:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 56us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361692.296135:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00080000:1.0:1788361692.296157:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361692.296161:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361692.296163:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788361692.576322:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361692.621689:0:43980:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361692.621698:0:43980:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361692.622270:0:43980:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361692.622280:0:43980:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361693.600942:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361694.083345:0:44031:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361694.083353:0:44031:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361694.083897:0:44031:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361694.083907:0:44031:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361694.624509:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361695.392299:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788361695.392321:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144275584:0@lo:400:kworker.0 00000100:00100000:1.0:1788361695.392327:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144275712:0@lo:400:kworker.0 00000100:00100000:2.0:1788361695.392385:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144276096:0@lo:400:kworker.0 00000100:00100000:3.0:1788361695.392417:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144275840:0@lo:400:kworker.0 00000100:00100000:2.0:1788361695.392447:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361695.392447:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361695.392695:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361695.392739:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361695.392746:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144276224:0@lo:400:kworker.0 00000100:00100000:3.0:1788361695.392770:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361695.392809:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144276096 00000100:00100000:3.0:1788361695.392816:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144276096 00000100:00100000:3.0:1788361695.392868:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144276224 00000100:00100000:3.0:1788361695.392873:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144276224 00000100:00100000:0.0:1788361695.392874:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361695.392910:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf18b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144275968:0@lo:400:kworker.0 00000100:00100000:3.0:1788361695.392919:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788361695.392929:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144276096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361695.392940:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361695.392973:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144275712 00000100:00100000:0.0:1788361695.392978:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144275712 00000100:00100000:3.0:1788361695.392987:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144276096:12345-0@lo:400:kworker.0 Request processed in 59us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361695.392996:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788361695.393009:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144275840 00000100:00100000:0.0:1788361695.393013:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144275840 00000100:00100000:3.0:1788361695.393015:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144275968 00000100:00100000:3.0:1788361695.393021:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144275968 00000100:00100000:3.0:1788361695.393038:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788361695.393043:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144276224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361695.393079:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf188380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144276224:12345-0@lo:400:kworker.0 Request processed in 35us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361695.393109:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788361695.393121:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788361695.393127:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144275968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361695.393162:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144275968:12345-0@lo:400:kworker.0 Request processed in 35us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361695.393168:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00080000:3.0:1788361695.393206:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361695.393211:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361695.393214:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361695.393236:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144276352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361695.393270:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361695.393316:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788361695.393325:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144275712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361695.393328:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144276224:0@lo:400:kworker.0 00000100:00100000:2.0:1788361695.393368:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf189180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144276096:0@lo:400:kworker.0 00000100:00100000:3.0:1788361695.393379:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788361695.393394:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144275840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361695.393394:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144275712:12345-0@lo:400:kworker.0 Request processed in 66us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361695.393398:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144276352 00000100:00100000:1.0:1788361695.393403:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144275584 00000100:00100000:2.0:1788361695.393404:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144276352 00000100:00100000:0.0:1788361695.393409:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788361695.393411:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144275584 00000100:00100000:0.0:1788361695.393448:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788361695.393455:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788361695.393460:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf18a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144276352:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361695.393467:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144275584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361695.393470:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144275840:12345-0@lo:400:kworker.0 Request processed in 81us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361695.393485:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00002000:00000024:0.0:1788361695.393488:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1788361695.393490:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf188000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144275840:0@lo:400:kworker.0 00000100:00100000:1.0:1788361695.393516:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144275584:12345-0@lo:400:kworker.0 Request processed in 53us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361695.393524:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788361695.393570:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144275712:0@lo:400:kworker.0 00000100:00100000:1.0:1788361695.393587:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf18b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144275968:0@lo:400:kworker.0 00000100:00100000:1.0:1788361695.393599:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a898bca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144275584:0@lo:400:kworker.0 00000100:00100000:0.0:1788361695.394594:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf18a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144276352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1135us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361695.394603:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788361695.394845:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf188e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144276352:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788361695.532917:0:44082:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361695.532931:0:44082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361695.533656:0:44082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361695.533669:0:44082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361695.648289:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361695.904352:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144276480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361695.904417:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361695.904569:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144276480 00000100:00100000:3.0:1788361695.904576:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144276480 00000100:00100000:3.0:1788361695.904618:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788361695.904636:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144276480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788361695.904667:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:3.0:1788361695.904719:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144276480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361695.904727:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788361695.904799:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf189c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144276480:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788361696.672320:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361696.996523:0:44133:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361696.996532:0:44133:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361696.998318:0:44133:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361696.998334:0:44133:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361697.417152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361697.417195:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361697.417223:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361697.417251:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130903040 00000100:00100000:3.0:1788361697.417252:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130903168 00000100:00100000:3.0:1788361697.417261:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130903168 00000100:00100000:0.0:1788361697.417262:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130903040 00000100:00100000:0.0:1788361697.417317:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:3.0:1788361697.417322:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00100000:2.0:1788361697.417324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361697.417330:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130903040:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361697.417338:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130903168:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361697.417404:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130903040:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 75us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361697.417405:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130903168:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361697.417418:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00100000:0.0:1788361697.417422:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00080000:3.0:1788361697.417442:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361697.417506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361697.417533:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130903552 00000100:00100000:2.0:1788361697.417537:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130903552 00000100:00100000:2.0:1788361697.417577:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:2.0:1788361697.417585:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130903552:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361697.417628:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130903552:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 30us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361697.417635:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00080000:2.0:1788361697.417652:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361697.417699:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130903424 00000100:00100000:1.0:1788361697.417703:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130903424 00000100:00100000:1.0:1788361697.417819:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130903296 00000100:00100000:1.0:1788361697.417823:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130903296 00000100:00080000:2.0:1788361697.417852:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361697.417854:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361697.417876:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:2.0:1788361697.417884:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130903424:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361697.417912:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130903424:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361697.417918:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:1.0:1788361697.418020:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:1.0:1788361697.418027:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130903296:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361697.418053:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130903296:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361697.418059:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 170 00010000:00010000:1.0:1788361697.697148:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361698.450901:0:44185:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361698.450910:0:44185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361698.451402:0:44185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361698.451410:0:44185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361698.720372:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361699.744548:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361699.870018:0:44236:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361699.870028:0:44236:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361699.870571:0:44236:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361699.870581:0:44236:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361700.512857:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144276736:0@lo:400:kworker.0 00000100:00100000:2.0:1788361700.512861:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144276608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361700.512914:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144276864:0@lo:400:kworker.0 00000100:00100000:2.0:1788361700.512941:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.512942:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144276992:0@lo:400:kworker.0 00000100:00100000:1.0:1788361700.512981:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.513004:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361700.513008:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144277120:0@lo:400:kworker.0 00000100:00100000:1.0:1788361700.513013:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144277376:0@lo:400:kworker.0 00000100:00100000:3.0:1788361700.513047:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144277248:0@lo:400:kworker.0 00000100:00100000:2.0:1788361700.513052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361700.513061:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144276864 00000100:00100000:1.0:1788361700.513070:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144276864 00000100:00100000:1.0:1788361700.513145:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788361700.513155:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144276864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361700.514386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361700.514444:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144277120 00000100:00100000:3.0:1788361700.514450:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144277120 00000100:00100000:2.0:1788361700.514451:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144277248 00000100:00100000:2.0:1788361700.514458:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144277248 00000100:00100000:1.0:1788361700.514464:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a796d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144276864:12345-0@lo:400:kworker.0 Request processed in 1308us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.514476:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788361700.514485:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788361700.514493:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144277120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361700.514500:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788361700.514513:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf18ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144277248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361700.514513:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144276736 00000100:00100000:1.0:1788361700.514520:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144276736 00000100:00100000:3.0:1788361700.514535:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144277120:12345-0@lo:400:kworker.0 Request processed in 43us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.514541:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788361700.514561:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788361700.514570:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf18ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144277248:12345-0@lo:400:kworker.0 Request processed in 60us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.514574:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144276736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361700.514581:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788361700.514584:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144277248:0@lo:400:kworker.0 00000100:00100000:0.0:1788361700.514687:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.514731:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144276608 00000100:00100000:0.0:1788361700.514735:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144276608 00000100:00100000:0.0:1788361700.514775:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788361700.514782:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144276608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361700.514813:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361700.514847:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144276608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361700.514854:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788361700.514868:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144277120:0@lo:400:kworker.0 00000100:00100000:2.0:1788361700.514871:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361700.514882:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144276992 00000100:00100000:0.0:1788361700.514887:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144276992 00000100:00100000:3.0:1788361700.514889:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144276608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361700.514914:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788361700.514916:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144276864:0@lo:400:kworker.0 00000100:00100000:0.0:1788361700.514922:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144276992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361700.514929:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144277376 00000100:00100000:3.0:1788361700.514933:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144277376 00000100:00100000:3.0:1788361700.514963:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788361700.514968:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144276992:12345-0@lo:400:kworker.0 Request processed in 44us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.514972:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144277376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361700.514984:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1788361700.514986:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361700.514991:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361700.514994:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361700.515013:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144276992:0@lo:400:kworker.0 00000100:00100000:3.0:1788361700.515020:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144277376:12345-0@lo:400:kworker.0 Request processed in 47us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361700.515028:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788361700.515059:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144277376:0@lo:400:kworker.0 00000100:00100000:3.0:1788361700.515712:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144276736:0@lo:400:kworker.0 00000100:00100000:1.0:1788361700.516007:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144276736:12345-0@lo:400:kworker.0 Request processed in 1437us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361700.516016:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00010000:1.0:1788361700.768306:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361701.025747:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144277504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361701.025814:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361701.025932:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144277504 00000100:00100000:2.0:1788361701.025941:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144277504 00000100:00100000:2.0:1788361701.025998:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788361701.026007:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144277504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361701.026043:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361701.026430:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144277504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 424us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361701.026438:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788361701.026504:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf189500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144277504:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1788361701.303899:0:44287:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361701.303910:0:44287:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361701.304603:0:44287:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361701.304614:0:44287:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:3.0:1788361701.600372:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361701.600381:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361701.600985:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361701.600995:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361701.793765:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361702.535834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361702.535889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361702.535920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361702.535947:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130903936 00000100:00100000:1.0:1788361702.535956:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130903936 00000100:00100000:3.0:1788361702.535958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361702.535992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361702.536001:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130904064 00000100:00100000:1.0:1788361702.536004:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130904064 00000100:00100000:1.0:1788361702.536027:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:1.0:1788361702.536035:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130903936:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361702.536041:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:3.0:1788361702.536054:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130904064:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361702.536111:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf188a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130903936:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 78us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361702.536119:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:3.0:1788361702.536122:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130904064:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 68us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361702.536132:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:0.0:1788361702.536178:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130903680 00000100:00100000:0.0:1788361702.536183:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130903680 00000100:00100000:0.0:1788361702.536226:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:0.0:1788361702.536234:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130903680:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361702.536261:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ceec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130903680:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361702.536267:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:2.0:1788361702.536382:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130904192 00000100:00100000:2.0:1788361702.536387:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130904192 00000100:00100000:2.0:1788361702.536421:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130903808 00000100:00100000:2.0:1788361702.536424:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130903808 00000100:00100000:2.0:1788361702.536451:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:2.0:1788361702.536460:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf18bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130904192:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:1.0:1788361702.536648:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361702.536654:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361702.536656:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361702.536667:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf18bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130904192:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 208us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361702.536673:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 234 00000100:00100000:2.0:1788361702.536680:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:1.0:1788361702.536685:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf18aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130903808:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361702.536717:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf18aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130903808:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 36us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361702.536723:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 234 00000040:00080000:1.0:1788361702.796836:0:44338:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361702.796846:0:44338:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361702.797443:0:44338:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361702.797454:0:44338:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361702.816607:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361703.840391:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361704.222901:0:44389:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361704.222910:0:44389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361704.223768:0:44389:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361704.223778:0:44389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361704.864668:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361705.632198:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144277632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361705.632241:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144277888:0@lo:400:kworker.0 00000100:00100000:3.0:1788361705.632260:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361705.632268:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361705.632311:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144277760:0@lo:400:kworker.0 00000100:00100000:2.0:1788361705.632360:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144278016:0@lo:400:kworker.0 00000100:00100000:1.0:1788361705.632402:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144278400:0@lo:400:kworker.0 00000100:00100000:1.0:1788361705.632433:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361705.632484:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144277888 00000100:00100000:1.0:1788361705.632491:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144277888 00000100:00100000:3.0:1788361705.632496:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361705.632521:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144278272:0@lo:400:kworker.0 00000100:00100000:1.0:1788361705.632539:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788361705.632542:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361705.632548:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144277888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361705.632573:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788361705.632579:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144278144:0@lo:400:kworker.0 00000100:00100000:3.0:1788361705.632599:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361705.632609:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144277888:12345-0@lo:400:kworker.0 Request processed in 62us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361705.632617:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788361705.632623:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144277632 00000100:00100000:3.0:1788361705.632627:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144277632 00000100:00100000:1.0:1788361705.632636:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144278400 00000100:00100000:1.0:1788361705.632639:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144278400 00000100:00100000:3.0:1788361705.632655:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788361705.632659:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144278272 00000100:00100000:1.0:1788361705.632661:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144278272 00000100:00100000:3.0:1788361705.632662:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf18b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144277632:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361705.632677:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144278144 00000100:00100000:1.0:1788361705.632679:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144278144 00002000:00000024:3.0:1788361705.632687:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1788361705.632690:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788361705.632694:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144278400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361705.632719:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144278400:12345-0@lo:400:kworker.0 Request processed in 23us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361705.632720:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf18b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144277632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361705.632725:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788361705.632726:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788361705.632737:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788361705.632743:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788361705.632743:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144278272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361705.632749:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf18a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144278144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361705.632770:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf18a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144278144:12345-0@lo:400:kworker.0 Request processed in 21us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361705.632770:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf18b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144278272:12345-0@lo:400:kworker.0 Request processed in 26us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361705.632776:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788361705.632792:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144277760 00000100:00100000:1.0:1788361705.632795:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144277760 00000100:00100000:1.0:1788361705.632818:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788361705.632824:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144277760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361705.632850:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144277760:12345-0@lo:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361705.632856:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:1.0:1788361705.632876:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361705.632880:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361705.632882:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361705.632915:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144277888:0@lo:400:kworker.0 00000100:00100000:1.0:1788361705.632925:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144278400:0@lo:400:kworker.0 00000100:00100000:3.0:1788361705.633147:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788361705.633183:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144278144:0@lo:400:kworker.0 00000100:00100000:3.0:1788361705.633193:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144278272:0@lo:400:kworker.0 00000100:00100000:3.0:1788361705.633206:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144277632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361705.633214:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144277760:0@lo:400:kworker.0 00000100:00100000:2.0:1788361705.633882:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361705.634009:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144278016 00000100:00100000:0.0:1788361705.634014:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144278016 00000100:00100000:0.0:1788361705.634079:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788361705.634103:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144278016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361705.634161:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144278016:12345-0@lo:400:kworker.0 Request processed in 74us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361705.634167:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788361705.634294:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144278016:0@lo:400:kworker.0 00000040:00080000:2.0:1788361705.678220:0:44441:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361705.678229:0:44441:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361705.678935:0:44441:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361705.678945:0:44441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361705.888960:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361706.144310:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144278528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788361706.144376:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361706.144419:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144278528 00000100:00100000:0.0:1788361706.144427:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144278528 00000100:00100000:0.0:1788361706.144484:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788361706.144498:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144278528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361706.144531:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788361706.144602:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144278528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361706.144610:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788361706.144649:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf189f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144278528:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788361706.912612:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361707.168477:0:44492:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361707.168486:0:44492:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361707.170830:0:44492:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361707.170845:0:44492:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361707.657430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361707.657553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361707.657591:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130904320 00000100:00100000:1.0:1788361707.657601:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130904320 00000100:00100000:3.0:1788361707.657602:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361707.657642:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361707.657658:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:1.0:1788361707.657669:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130904320:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361707.657736:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130904320:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 69us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361707.657744:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:0.0:1788361707.657951:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130904576 00000100:00100000:0.0:1788361707.657957:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130904576 00000100:00100000:0.0:1788361707.658008:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 177 00000100:00080000:1.0:1788361707.658011:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361707.658018:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130904576:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361707.658053:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130904576:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361707.658061:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 177 00000100:00100000:3.0:1788361707.658182:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130904832 00000100:00100000:3.0:1788361707.658197:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130904832 00000100:00100000:2.0:1788361707.658209:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130904448 00000100:00100000:2.0:1788361707.658216:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130904448 00000100:00100000:2.0:1788361707.658255:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 238 00000100:00100000:2.0:1788361707.658265:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130904832:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:0.0:1788361707.658373:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361707.658561:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:3.0:1788361707.660713:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130904448:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361707.660798:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf189c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130904448:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 2228us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361707.660807:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:3.0:1788361707.660873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361707.661036:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf189500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130904832:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361707.661046:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 238 00000100:00100000:0.0:1788361707.661670:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130904704 00000100:00100000:0.0:1788361707.661680:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130904704 00000100:00100000:0.0:1788361707.661747:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00100000:0.0:1788361707.661756:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130904704:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361707.661806:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf188e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130904704:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 51us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361707.661817:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00080000:1.0:1788361707.662016:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788361707.936322:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361708.690751:0:44543:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361708.690760:0:44543:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361708.691396:0:44543:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361708.691405:0:44543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361708.960305:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361709.986227:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361710.200398:0:44594:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361710.200406:0:44594:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361710.200953:0:44594:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361710.200961:0:44594:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361710.752263:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144278784:0@lo:400:kworker.0 00000100:00100000:1.0:1788361710.752311:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf18b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144278656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361710.752341:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.752352:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361710.752369:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144278912:0@lo:400:kworker.0 00000100:00100000:1.0:1788361710.752388:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144279168:0@lo:400:kworker.0 00000100:00100000:3.0:1788361710.752397:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144279296:0@lo:400:kworker.0 00000100:00100000:0.0:1788361710.752405:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.752419:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361710.752429:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144279424:0@lo:400:kworker.0 00000100:00100000:3.0:1788361710.752442:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144278784 00000100:00100000:3.0:1788361710.752449:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144278784 00000100:00100000:0.0:1788361710.752454:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.752467:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144278656 00000100:00100000:1.0:1788361710.752472:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144278656 00000100:00100000:0.0:1788361710.752476:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361710.752484:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144279040:0@lo:400:kworker.0 00000100:00100000:3.0:1788361710.752489:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788361710.752499:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144278784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361710.752506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361710.752518:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788361710.752540:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144278656:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361710.752548:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144278912 00000100:00100000:0.0:1788361710.752553:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144278912 00000100:00100000:3.0:1788361710.752562:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144278784:12345-0@lo:400:kworker.0 Request processed in 63us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361710.752570:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788361710.752582:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144279040 00000100:00100000:0.0:1788361710.752585:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144279040 00002000:00000024:1.0:1788361710.752586:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361710.752606:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788361710.752613:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144279168 00000100:00100000:0.0:1788361710.752614:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144278912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361710.752617:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144279168 00000100:00100000:1.0:1788361710.752631:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144278656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.752638:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788361710.752641:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144279424 00000100:00100000:3.0:1788361710.752645:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144279424 00000100:00100000:0.0:1788361710.752656:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144278912:12345-0@lo:400:kworker.0 Request processed in 43us (250us total) trans 0 rc 0/0 00000100:00080000:1.0:1788361710.752660:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361710.752664:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:1.0:1788361710.752666:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361710.752670:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00080000:1.0:1788361710.752671:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361710.752680:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144279168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361710.752680:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788361710.752685:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144279040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361710.752719:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144279168:12345-0@lo:400:kworker.0 Request processed in 40us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.752719:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144279040:12345-0@lo:400:kworker.0 Request processed in 33us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.752725:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf18b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144278656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361710.752728:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788361710.752732:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788361710.752748:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788361710.752753:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144279168:0@lo:400:kworker.0 00000100:00100000:3.0:1788361710.752757:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144279424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361710.752781:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144279040:0@lo:400:kworker.0 00000100:00100000:3.0:1788361710.752789:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144279424:12345-0@lo:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361710.752790:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144278912:0@lo:400:kworker.0 00000100:00100000:0.0:1788361710.752798:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144279424:0@lo:400:kworker.0 00000100:00100000:3.0:1788361710.752807:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788361710.752830:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361710.752864:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144278784:0@lo:400:kworker.0 00000100:00100000:1.0:1788361710.752867:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144279296 00000100:00100000:1.0:1788361710.752872:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144279296 00000100:00100000:1.0:1788361710.752908:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788361710.752912:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144279296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361710.752945:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf188000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144279296:12345-0@lo:400:kworker.0 Request processed in 32us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361710.752949:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:0.0:1788361710.752961:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361710.753185:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144279296:0@lo:400:kworker.0 00010000:00010000:1.0:1788361711.008323:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361711.264300:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361711.264321:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144279552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361711.264380:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361711.264445:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144279552 00000100:00100000:2.0:1788361711.264453:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144279552 00000100:00100000:2.0:1788361711.264500:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788361711.264509:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144279552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361711.264552:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361711.264602:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144279552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361711.264610:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788361711.264810:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144279552:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788361711.613808:0:44645:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361711.613817:0:44645:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361711.614433:0:44645:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361711.614737:0:44645:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1788361711.840497:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361711.840506:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361711.841192:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361711.841213:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361712.032630:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361712.775536:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361712.775579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361712.775618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361712.775650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361712.775662:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130905088 00000100:00100000:0.0:1788361712.775673:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130905088 00000100:00100000:3.0:1788361712.775682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361712.775710:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130904960 00000100:00100000:3.0:1788361712.775715:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130904960 00000100:00100000:1.0:1788361712.775739:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130905344 00000100:00100000:0.0:1788361712.775740:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130905472 00000100:00100000:1.0:1788361712.775745:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130905344 00000100:00100000:0.0:1788361712.775745:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130905472 00000100:00100000:3.0:1788361712.775756:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:3.0:1788361712.775769:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130904960:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361712.775774:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130905216 00000100:00100000:0.0:1788361712.775776:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 243 00000100:00100000:1.0:1788361712.775777:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130905216 00000100:00100000:0.0:1788361712.775784:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130905088:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361712.775797:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:1.0:1788361712.775803:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf18b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130905344:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361712.775860:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130904960:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 91us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361712.775861:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf18b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130905344:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 53us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361712.775861:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf189180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130905088:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 74us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361712.775879:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:0.0:1788361712.775879:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 243 00000100:00100000:3.0:1788361712.775880:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:1.0:1788361712.775903:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 182 00000100:00100000:0.0:1788361712.775903:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 244 00000100:00100000:1.0:1788361712.775912:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a88443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130905216:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361712.775912:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130905472:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361712.775938:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a88443450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130905216:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361712.775939:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130905472:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361712.775946:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 182 00000100:00100000:0.0:1788361712.775949:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 244 00000100:00080000:0.0:1788361712.775969:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361712.775973:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788361712.775976:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788361713.050484:0:44697:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361713.050493:0:44697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361713.051008:0:44697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361713.051017:0:44697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361713.056723:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361714.080275:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361714.484626:0:44748:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361714.484635:0:44748:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361714.485438:0:44748:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361714.485449:0:44748:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361715.104717:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361715.872238:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144279680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361715.872308:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361715.872382:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144279808:0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.872415:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361715.872448:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144280320:0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.872479:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361715.872516:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361715.872524:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144279936:0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.872552:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361715.872605:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144279680 00000100:00100000:3.0:1788361715.872613:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144279680 00000100:00100000:3.0:1788361715.872690:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788361715.872699:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898bca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144279680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788361715.872732:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361715.872791:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898bca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144279680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.872798:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788361715.872822:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144279808 00000100:00100000:3.0:1788361715.872826:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144279808 00000100:00100000:3.0:1788361715.872851:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788361715.872857:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144279808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.872900:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83cec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144279808:12345-0@lo:400:kworker.0 Request processed in 42us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.872906:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788361715.872948:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144280320 00000100:00100000:0.0:1788361715.872953:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144279680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361715.872954:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144280320 00000100:00100000:0.0:1788361715.872971:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144279808:0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.872990:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788361715.872999:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144280320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.873043:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a843eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144280320:12345-0@lo:400:kworker.0 Request processed in 46us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.873050:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788361715.873069:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144279936 00000100:00100000:3.0:1788361715.873072:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144279936 00000100:00100000:3.0:1788361715.873118:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788361715.873124:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144279936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.873152:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144279936:12345-0@lo:400:kworker.0 Request processed in 29us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.873158:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:3.0:1788361715.873172:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361715.873176:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361715.873178:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361715.873211:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144280192:0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.873235:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361715.873254:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361715.873259:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144280064:0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.873280:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361715.873308:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144280192 00000100:00100000:3.0:1788361715.873311:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144280192 00000100:00100000:3.0:1788361715.873333:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788361715.873339:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144280192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.873372:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875232144280192:12345-0@lo:400:kworker.0 Request processed in 32us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.873377:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788361715.873393:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144280064 00000100:00100000:3.0:1788361715.873396:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144280064 00000100:00100000:3.0:1788361715.873417:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788361715.873422:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144280064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.873450:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144280064:12345-0@lo:400:kworker.0 Request processed in 27us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361715.873455:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788361715.873483:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144280064:0@lo:400:kworker.0 00000100:00100000:3.0:1788361715.873504:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875232144280192:0@lo:400:kworker.0 00000100:00100000:1.0:1788361715.873801:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144280448:0@lo:400:kworker.0 00000100:00100000:1.0:1788361715.873831:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361715.873928:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144280448 00000100:00100000:2.0:1788361715.873932:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144280448 00000100:00100000:2.0:1788361715.873976:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788361715.873985:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144280448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361715.874035:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144280448:12345-0@lo:400:kworker.0 Request processed in 52us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361715.874042:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:1.0:1788361715.874111:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361715.874134:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144280448:0@lo:400:kworker.0 00000100:00100000:0.0:1788361715.874424:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144279936:0@lo:400:kworker.0 00000100:00100000:0.0:1788361715.874437:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144280320:0@lo:400:kworker.0 00000040:00080000:2.0:1788361715.946328:0:44799:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361715.946337:0:44799:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361715.947903:0:44799:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361715.947920:0:44799:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361716.128277:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361716.384354:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abc895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144280576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361716.384427:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361716.384500:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144280576 00000100:00100000:1.0:1788361716.384509:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144280576 00000100:00100000:1.0:1788361716.384584:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788361716.384594:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144280576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361716.384630:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361716.384752:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144280576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361716.384756:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abc895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144280576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361716.384764:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00010000:1.0:1788361717.154185:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361717.329405:0:44850:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361717.329414:0:44850:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361717.331020:0:44850:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361717.331200:0:44850:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361717.895439:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361717.895702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361717.895740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361717.895774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361717.895803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361717.895813:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130905856 00000100:00100000:1.0:1788361717.895823:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130905856 00000100:00100000:2.0:1788361717.895844:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130905984 00000100:00100000:2.0:1788361717.895850:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130905984 00000100:00100000:0.0:1788361717.895892:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130905728 00000100:00100000:2.0:1788361717.895893:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00100000:0.0:1788361717.895898:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130905728 00000100:00100000:2.0:1788361717.895906:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130905984:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361717.895913:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 186 00000100:00100000:1.0:1788361717.895925:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130905856:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361717.895944:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130906112 00000100:00100000:0.0:1788361717.895949:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130906112 00000100:00100000:0.0:1788361717.895976:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 248 00000100:00100000:0.0:1788361717.895984:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130905728:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361717.895990:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130905984:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 84us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361717.896000:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00100000:1.0:1788361717.896026:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130905856:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 103us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361717.896035:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130905728:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 50us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361717.896041:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 186 00000100:00100000:2.0:1788361717.896042:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 249 00000100:00100000:0.0:1788361717.896054:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 248 00000100:00100000:2.0:1788361717.896059:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130906112:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:1.0:1788361717.896067:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361717.896074:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361717.896076:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361717.896120:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130906112:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361717.896129:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 249 00000100:00100000:3.0:1788361717.896240:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130905600 00000100:00100000:3.0:1788361717.896245:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130905600 00000100:00100000:0.0:1788361717.896393:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:0.0:1788361717.896404:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130905600:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361717.896440:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a83ced050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130905600:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 39us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361717.896448:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 213 00010000:00010000:0.0:1788361718.176280:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361718.743770:0:44901:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361718.743778:0:44901:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361718.744358:0:44901:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361718.744367:0:44901:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361719.200282:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361720.147424:0:44953:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361720.147431:0:44953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361720.147959:0:44953:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361720.147966:0:44953:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361720.225042:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361720.992406:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144280704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361720.992489:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361720.992611:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144280832:0@lo:400:kworker.0 00000100:00100000:1.0:1788361720.992613:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144280704 00000100:00100000:1.0:1788361720.992623:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144280704 00000100:00100000:1.0:1788361720.992762:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788361720.992774:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144280704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361720.992807:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1788361720.992836:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361720.992900:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89853dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144280704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361720.992911:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788361720.992919:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144281344:0@lo:400:kworker.0 00000100:00100000:0.0:1788361720.992962:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144280832 00000100:00100000:2.0:1788361720.992963:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361720.992969:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144280832 00000100:00100000:0.0:1788361720.993014:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788361720.993024:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144280832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361720.993027:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144281088:0@lo:400:kworker.0 00000100:00100000:1.0:1788361720.993034:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144281344 00000100:00100000:1.0:1788361720.993042:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144281344 00000100:00100000:2.0:1788361720.993058:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361720.993112:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788361720.993119:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144281216:0@lo:400:kworker.0 00000100:00100000:1.0:1788361720.993132:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144281088 00000100:00100000:0.0:1788361720.993135:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144280832:12345-0@lo:400:kworker.0 Request processed in 112us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361720.993140:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144281088 00000100:00100000:2.0:1788361720.993148:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361720.993148:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788361720.993187:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144281216 00000100:00080000:0.0:1788361720.993192:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361720.993193:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144281216 00000100:00080000:0.0:1788361720.993202:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361720.993222:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144280704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361720.993224:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788361720.993238:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144281344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361720.993254:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788361720.993271:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144281088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361720.993283:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875232144281344:12345-0@lo:400:kworker.0 Request processed in 46us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361720.993291:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788361720.993302:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144281216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361720.993351:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abc894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144281088:12345-0@lo:400:kworker.0 Request processed in 86us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361720.993365:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144281216:12345-0@lo:400:kworker.0 Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361720.993399:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144280960:0@lo:400:kworker.0 00000100:00100000:3.0:1788361720.993440:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361720.993495:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788361720.993498:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144280960 00000100:00100000:1.0:1788361720.993503:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788361720.993504:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144280960 00000100:00100000:3.0:1788361720.993549:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788361720.993560:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1875232144281344:0@lo:400:kworker.0 00000100:00100000:3.0:1788361720.993561:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144280960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361720.993583:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144280832:0@lo:400:kworker.0 00000100:00100000:3.0:1788361720.993624:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8986707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144280960:12345-0@lo:400:kworker.0 Request processed in 66us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361720.993631:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1788361720.993648:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361720.993653:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144281216:0@lo:400:kworker.0 00000100:00080000:0.0:1788361720.993657:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361720.993669:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144280960:0@lo:400:kworker.0 00000100:00100000:1.0:1788361720.993673:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf0b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144281088:0@lo:400:kworker.0 00000100:00100000:2.0:1788361720.995111:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000040:00080000:2.0:1788361721.056398:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361721.056408:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361721.056908:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361721.056917:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361721.249106:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361721.504279:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144281472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361721.504358:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361721.504403:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144281472 00000100:00100000:0.0:1788361721.504414:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144281472 00000100:00100000:0.0:1788361721.504491:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788361721.504502:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144281472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361721.504551:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788361721.504631:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac1566680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144281472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361721.504639:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788361721.504687:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a834c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144281472:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788361721.555632:0:45004:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361721.555648:0:45004:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361721.556253:0:45004:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361721.556263:0:45004:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361722.272346:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361722.973871:0:45055:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361722.973879:0:45055:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361722.974694:0:45055:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361722.974705:0:45055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361723.016803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361723.016856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361723.016896:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361723.016916:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130906368 00000100:00100000:0.0:1788361723.016918:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130906240 00000100:00100000:2.0:1788361723.016928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361723.016929:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130906368 00000100:00100000:0.0:1788361723.016929:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130906240 00000100:00100000:2.0:1788361723.016970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361723.016986:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:3.0:1788361723.016999:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130906752 00000100:00100000:0.0:1788361723.016999:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130906240:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361723.017002:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130906624 00000100:00100000:3.0:1788361723.017005:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130906752 00000100:00100000:2.0:1788361723.017009:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130906624 00000100:00100000:3.0:1788361723.017040:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 253 00000100:00100000:3.0:1788361723.017052:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130906368:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361723.017052:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130906496 00000100:00100000:2.0:1788361723.017058:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130906496 00000100:00100000:2.0:1788361723.017112:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:0.0:1788361723.017117:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130906240:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 91us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361723.017127:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130906624:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361723.017128:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a834c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130906368:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 69us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361723.017129:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:3.0:1788361723.017157:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 253 00000100:00080000:0.0:1788361723.017161:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361723.017167:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361723.017171:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130906624:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 47us (273us total) trans 0 rc 0/0 00000100:00080000:0.0:1788361723.017171:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361723.017180:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 254 00000100:00100000:2.0:1788361723.017185:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:3.0:1788361723.017193:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130906752:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361723.017208:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:2.0:1788361723.017219:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130906496:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361723.017225:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130906752:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 35us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361723.017233:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 254 00000100:00100000:2.0:1788361723.017254:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89858af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130906496:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 37us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361723.017262:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 189 00010000:00010000:2.0:1788361723.296345:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361724.320285:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361724.438366:0:45106:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361724.438376:0:45106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361724.438971:0:45106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361724.438990:0:45106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361725.344778:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361725.844629:0:45157:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361725.844639:0:45157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361725.845205:0:45157:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361725.845214:0:45157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361726.112300:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144281600:0@lo:400:kworker.0 00000100:00100000:0.0:1788361726.112375:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361726.112444:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144282112:0@lo:400:kworker.0 00000100:00100000:0.0:1788361726.112475:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361726.112502:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144281856:0@lo:400:kworker.0 00000100:00100000:0.0:1788361726.112504:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788361726.112516:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144281728:0@lo:400:kworker.0 00000100:00100000:3.0:1788361726.112519:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144281984:0@lo:400:kworker.0 00000100:00100000:2.0:1788361726.112534:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144281600 00000100:00100000:2.0:1788361726.112543:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144281600 00000100:00100000:1.0:1788361726.112552:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361726.112554:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361726.112555:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144282112 00000100:00100000:0.0:1788361726.112559:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144282112 00000100:00100000:1.0:1788361726.112593:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144282368:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361726.112598:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788361726.112603:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144281856 00000100:00100000:0.0:1788361726.112603:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144281984 00000100:00100000:0.0:1788361726.112607:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144281984 00000100:00100000:2.0:1788361726.112612:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144281600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361726.112623:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361726.112648:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788361726.112657:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144282368 00000100:00100000:0.0:1788361726.112658:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144282112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361726.112663:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144282368 00000100:00100000:3.0:1788361726.112664:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144281856 00000100:00100000:2.0:1788361726.112672:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144281600:12345-0@lo:400:kworker.0 Request processed in 64us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361726.112702:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144282112:12345-0@lo:400:kworker.0 Request processed in 45us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361726.112707:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788361726.112708:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788361726.112712:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788361726.112724:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144281856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361726.112725:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144282368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361726.112740:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788361726.112747:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144281984:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1788361726.112759:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361726.112765:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875232144281856:12345-0@lo:400:kworker.0 Request processed in 47us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361726.112772:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788361726.112777:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144281984:12345-0@lo:400:kworker.0 Request processed in 32us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361726.112782:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:0.0:1788361726.112810:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361726.112811:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144281856:0@lo:400:kworker.0 00000100:00080000:0.0:1788361726.112814:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361726.112840:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144281984:0@lo:400:kworker.0 00000100:00100000:3.0:1788361726.112844:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144282368:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361726.112846:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144282368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361726.112856:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788361726.112864:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361726.112882:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144282240:0@lo:400:kworker.0 00000100:00100000:3.0:1788361726.112889:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144281728 00000100:00100000:3.0:1788361726.112892:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144281728 00000100:00100000:0.0:1788361726.112902:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361726.112924:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144282112:0@lo:400:kworker.0 00000100:00100000:3.0:1788361726.112926:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00080000:1.0:1788361726.112928:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361726.112934:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144281728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361726.112934:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144281600:0@lo:400:kworker.0 00000100:00100000:1.0:1788361726.112951:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144282240 00000100:00100000:1.0:1788361726.112956:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144282240 00000100:00100000:1.0:1788361726.112990:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788361726.112998:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144282240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361726.113005:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788361726.113078:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144281728:12345-0@lo:400:kworker.0 Request processed in 145us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361726.113103:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788361726.113111:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144281728:0@lo:400:kworker.0 00000100:00100000:0.0:1788361726.113138:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144282240:0@lo:400:kworker.0 00000100:00100000:1.0:1788361726.113142:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144282240:12345-0@lo:400:kworker.0 Request processed in 142us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361726.113150:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:1.0:1788361726.113170:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788361726.368341:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361726.624729:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788361726.624754:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144282496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361726.624827:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361726.625291:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144282496 00000100:00100000:0.0:1788361726.625299:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144282496 00000100:00100000:0.0:1788361726.625470:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788361726.625481:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144282496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361726.625516:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788361726.625606:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144282496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361726.625611:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788361726.625722:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144282496:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788361727.237605:0:45209:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361727.237612:0:45209:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361727.238043:0:45209:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361727.238051:0:45209:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361727.392369:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361728.138549:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361728.138583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361728.138612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361728.138612:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130906880 00000100:00100000:0.0:1788361728.138622:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130906880 00000100:00100000:1.0:1788361728.138650:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361728.138681:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 217 00000100:00100000:1.0:1788361728.138685:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361728.138695:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130906880:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361728.138722:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130907392 00000100:00100000:1.0:1788361728.138728:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130907392 00000100:00100000:1.0:1788361728.138772:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130907008 00000100:00100000:1.0:1788361728.138775:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130907008 00000100:00100000:0.0:1788361728.138782:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130906880:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361728.138789:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 217 00000100:00100000:2.0:1788361728.138832:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 258 00000100:00100000:2.0:1788361728.138846:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130907392:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361728.138848:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130907136 00000100:00100000:3.0:1788361728.138855:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130907136 00000100:00080000:0.0:1788361728.138863:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361728.138870:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788361728.138889:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130907392:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 48us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361728.138897:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130907264 00000100:00100000:2.0:1788361728.138898:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 258 00000100:00100000:2.0:1788361728.138935:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 192 00000100:00100000:2.0:1788361728.138943:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130907136:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361728.138949:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130907264 00000100:00100000:2.0:1788361728.138975:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130907136:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 32us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361728.138983:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 192 00000100:00100000:3.0:1788361728.139000:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:3.0:1788361728.139011:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130907264:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361728.139040:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 259 00000100:00100000:1.0:1788361728.139051:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130907008:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361728.139057:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130907264:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (371us total) trans 0 rc 0/0 00000100:00080000:0.0:1788361728.139060:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361728.139115:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130907008:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 68us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361728.139122:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 259 00000100:00100000:3.0:1788361728.139374:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 193 00010000:00010000:1.0:1788361728.416232:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361728.641720:0:45260:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361728.641728:0:45260:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361728.642221:0:45260:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361728.642231:0:45260:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361729.440420:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361730.060284:0:45311:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361730.060293:0:45311:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361730.060866:0:45311:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361730.060876:0:45311:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361730.464647:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361731.232281:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144282880:0@lo:400:kworker.0 00000100:00100000:1.0:1788361731.232309:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144283008:0@lo:400:kworker.0 00000100:00100000:2.0:1788361731.232334:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144283136:0@lo:400:kworker.0 00000100:00100000:3.0:1788361731.232397:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361731.232428:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361731.232432:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144282880 00000100:00100000:1.0:1788361731.232440:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144282880 00000100:00100000:3.0:1788361731.232469:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144283392:0@lo:400:kworker.0 00000100:00100000:2.0:1788361731.232495:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144283136 00000100:00100000:3.0:1788361731.232502:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361731.232502:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144283136 00000100:00100000:1.0:1788361731.232513:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788361731.232526:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144282880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361731.232532:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788361731.232539:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144283392 00000100:00100000:3.0:1788361731.232542:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144282624:0@lo:400:kworker.0 00000100:00100000:2.0:1788361731.232544:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144283392 00000100:00100000:3.0:1788361731.232589:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361731.232597:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144282880:12345-0@lo:400:kworker.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361731.232607:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788361731.232624:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144282752:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788361731.232632:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361731.232640:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361731.232650:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361731.232656:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361731.232673:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144283264:0@lo:400:kworker.0 00000100:00100000:2.0:1788361731.232686:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788361731.232698:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144283136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361731.232699:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144282752 00000100:00100000:3.0:1788361731.232705:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361731.232705:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144282752 00000100:00100000:3.0:1788361731.232746:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144282880:0@lo:400:kworker.0 00000100:00100000:2.0:1788361731.232758:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144283136:12345-0@lo:400:kworker.0 Request processed in 61us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361731.232764:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788361731.232773:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144283264 00000100:00100000:1.0:1788361731.232777:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144282752:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361731.232778:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144283264 00002000:00000024:1.0:1788361731.232807:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1788361731.232882:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144282752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361731.232889:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788361731.232916:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144283008 00000100:00100000:1.0:1788361731.232920:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144283008 00000100:00100000:1.0:1788361731.232941:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788361731.232947:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144283008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361731.232979:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144283008:12345-0@lo:400:kworker.0 Request processed in 32us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361731.232985:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788361731.236256:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788361731.236286:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788361731.236320:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144283392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361731.236409:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144283392:12345-0@lo:400:kworker.0 Request processed in 102us (3909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361731.236417:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788361731.236442:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788361731.236489:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144282624 00000100:00100000:3.0:1788361731.236498:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144282624 00000100:00100000:2.0:1788361731.236512:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144283136:0@lo:400:kworker.0 00000100:00100000:3.0:1788361731.236541:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788361731.236550:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144282624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361731.236584:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3314:x1875232144282624:12345-0@lo:400:kworker.0 Request processed in 36us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361731.236633:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3314:1875232144282624:0@lo:400:kworker.0 00000100:00100000:3.0:1788361731.236639:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788361731.236658:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144282752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361731.236673:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144283392:0@lo:400:kworker.0 00000100:00080000:2.0:1788361731.236716:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788361731.236721:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361731.236769:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144283264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361731.236801:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144283008:0@lo:400:kworker.0 00000100:00100000:1.0:1788361731.236826:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875232144283264:12345-0@lo:400:kworker.0 Request processed in 374us (4124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361731.236834:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788361731.236876:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1875232144283264:0@lo:400:kworker.0 00000040:00080000:2.0:1788361731.296430:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361731.296438:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361731.296940:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361731.296950:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1788361731.475146:0:45362:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361731.475154:0:45362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361731.475710:0:45362:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361731.475719:0:45362:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361731.488751:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361731.744491:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144283520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361731.744659:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361731.744839:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144283520 00000100:00100000:2.0:1788361731.744847:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144283520 00000100:00100000:2.0:1788361731.744893:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788361731.744913:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144283520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361731.744947:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361731.745014:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144283520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361731.745022:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788361731.745055:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144283520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788361732.512358:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361732.852997:0:45413:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361732.853007:0:45413:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361732.853544:0:45413:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361732.853554:0:45413:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361733.256702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361733.256793:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361733.256828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361733.256864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361733.256885:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130907648 00000100:00100000:3.0:1788361733.256897:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130907648 00000100:00100000:1.0:1788361733.256924:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361733.256958:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130907904 00000100:00100000:1.0:1788361733.256962:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130907904 00000100:00100000:3.0:1788361733.256969:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130908032 00000100:00100000:3.0:1788361733.256976:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130908032 00000100:00100000:1.0:1788361733.257003:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130907776 00000100:00100000:1.0:1788361733.257008:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130907776 00000100:00100000:3.0:1788361733.257014:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 263 00000100:00100000:3.0:1788361733.257028:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130907648:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361733.257040:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 196 00000100:00100000:1.0:1788361733.257051:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130907904:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361733.257132:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130907648:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 107us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361733.257136:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:3.0:1788361733.257145:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 263 00000100:00100000:2.0:1788361733.257151:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130907776:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361733.257173:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130907520 00000100:00100000:0.0:1788361733.257178:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130907520 00000100:00100000:3.0:1788361733.257182:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 264 00000100:00100000:3.0:1788361733.257192:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130908032:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361733.257218:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:0.0:1788361733.257227:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130907520:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361733.257289:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130907904:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 240us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361733.257296:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 196 00000100:00080000:1.0:1788361733.257473:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361733.257477:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361733.257479:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361733.260083:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130907776:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 2924us (3206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361733.260104:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130907520:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 2857us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361733.260119:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:0.0:1788361733.260119:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:3.0:1788361733.260225:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130908032:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 3033us (3312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361733.260234:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 264 00010000:00010000:0.0:1788361733.536278:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361734.250126:0:45465:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361734.250137:0:45465:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361734.250756:0:45465:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361734.250764:0:45465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361734.560284:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361735.584256:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361735.678658:0:45516:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361735.678677:0:45516:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361735.679301:0:45516:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361735.679311:0:45516:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361736.352359:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144283776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361736.352364:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144283648:0@lo:400:kworker.0 00000100:00100000:2.0:1788361736.352409:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144283904:0@lo:400:kworker.0 00000100:00100000:1.0:1788361736.352449:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144284032:0@lo:400:kworker.0 00000100:00100000:3.0:1788361736.352493:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361736.352498:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361736.352566:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144284416:0@lo:400:kworker.0 00000100:00100000:3.0:1788361736.352588:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144284288:0@lo:400:kworker.0 00000100:00100000:2.0:1788361736.352597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361736.352609:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144283776 00000100:00100000:0.0:1788361736.352617:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144283776 00000100:00100000:3.0:1788361736.352628:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361736.352682:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361736.352685:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144284416 00000100:00100000:3.0:1788361736.352691:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144284416 00000100:00100000:0.0:1788361736.352697:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788361736.352709:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144283776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361736.352716:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144284160:0@lo:400:kworker.0 00002000:00000024:0.0:1788361736.352744:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1788361736.352750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361736.352764:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144284288 00000100:00100000:3.0:1788361736.352769:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144284288 00000100:00100000:3.0:1788361736.352804:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144284160 00000100:00100000:3.0:1788361736.352808:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144284160 00000100:00100000:1.0:1788361736.352812:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788361736.352824:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144284416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361736.352831:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788361736.352839:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788361736.352844:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144284288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361736.352853:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144284160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361736.352907:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144283776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 200us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361736.352910:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144284160:12345-0@lo:400:kworker.0 Request processed in 60us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361736.352917:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788361736.352929:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1788361736.352941:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361736.352946:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361736.352954:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144284288:12345-0@lo:400:kworker.0 Request processed in 113us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361736.352961:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144283648 00000100:00100000:3.0:1788361736.352965:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788361736.352967:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144283648 00000100:00100000:0.0:1788361736.352999:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144283904 00000100:00100000:0.0:1788361736.353004:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144283904 00000100:00100000:2.0:1788361736.353006:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788361736.353017:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144283648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361736.353018:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144284288:0@lo:400:kworker.0 00000100:00100000:3.0:1788361736.353043:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144283776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361736.353061:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788361736.353064:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144283648:12345-0@lo:400:kworker.0 Request processed in 48us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361736.353072:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144283904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361736.353115:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144283648:0@lo:400:kworker.0 00000100:00100000:3.0:1788361736.353132:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144284160:0@lo:400:kworker.0 00000100:00100000:0.0:1788361736.353146:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144283904:12345-0@lo:400:kworker.0 Request processed in 76us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361736.353153:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1788361736.353172:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361736.353199:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144283904:0@lo:400:kworker.0 00000100:00100000:2.0:1788361736.353200:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788361736.353253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361736.353286:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144284032 00000100:00100000:2.0:1788361736.353292:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144284032 00000100:00100000:2.0:1788361736.353325:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788361736.353332:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144284032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361736.353382:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144284032:12345-0@lo:400:kworker.0 Request processed in 51us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361736.353392:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788361736.353483:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144284032:0@lo:400:kworker.0 00000100:00100000:1.0:1788361736.353598:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144284416:12345-0@lo:400:kworker.0 Request processed in 777us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361736.353604:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788361736.353656:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144284416:0@lo:400:kworker.0 00010000:00010000:0.0:1788361736.609304:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361736.864675:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144284544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361736.864732:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361736.865125:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144284544 00000100:00100000:2.0:1788361736.865134:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144284544 00000100:00100000:2.0:1788361736.865186:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788361736.865195:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144284544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361736.865238:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361736.865286:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144284544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361736.865293:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788361736.865337:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144284544:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788361737.130403:0:45567:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361737.130413:0:45567:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361737.130974:0:45567:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361737.130983:0:45567:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361737.632358:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361738.376188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361738.376225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361738.376263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361738.376288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361738.376368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361738.376408:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130908544 00000100:00100000:1.0:1788361738.376419:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130908544 00000100:00100000:1.0:1788361738.376482:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130908416 00000100:00100000:1.0:1788361738.376485:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130908416 00000100:00100000:1.0:1788361738.376511:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:1.0:1788361738.376521:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130908544:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361738.376595:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130908544:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 76us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361738.376607:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:1.0:1788361738.376628:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:1.0:1788361738.376636:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130908416:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361738.376661:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130908416:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361738.376668:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:0.0:1788361738.376670:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130908160 00000100:00100000:0.0:1788361738.376676:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130908160 00000100:00100000:1.0:1788361738.376697:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130908288 00000100:00100000:1.0:1788361738.376703:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130908288 00000100:00100000:0.0:1788361738.376724:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00100000:0.0:1788361738.376734:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130908160:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361738.376740:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130908672 00000100:00100000:1.0:1788361738.376744:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130908672 00000100:00100000:0.0:1788361738.376772:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130908160:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 40us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361738.376783:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00080000:0.0:1788361738.377161:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361738.377166:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788361738.377169:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361738.377288:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 268 00000100:00100000:3.0:1788361738.377299:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130908288:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361738.377350:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130908288:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 53us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361738.377356:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 268 00000100:00100000:1.0:1788361738.377520:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 269 00000100:00100000:1.0:1788361738.377527:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130908672:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361738.377555:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130908672:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361738.377561:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 269 00000100:00080000:0.0:1788361738.377660:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788361738.591357:0:45618:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361738.591368:0:45618:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361738.591851:0:45618:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361738.591862:0:45618:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361738.656207:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361739.680482:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361739.988190:0:45669:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361739.988200:0:45669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361739.988838:0:45669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361739.988847:0:45669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361740.704252:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361741.352693:0:45721:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361741.352702:0:45721:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361741.353356:0:45721:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361741.353364:0:45721:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361741.472351:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144284928:0@lo:400:kworker.0 00000100:00100000:0.0:1788361741.472372:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144285056:0@lo:400:kworker.0 00000100:00100000:2.0:1788361741.472466:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361741.472471:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144284800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361741.472494:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144284672:0@lo:400:kworker.0 00000100:00100000:0.0:1788361741.472525:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361741.472531:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144284928 00000100:00100000:3.0:1788361741.472550:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144284928 00000100:00100000:1.0:1788361741.472557:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361741.472584:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144285312:0@lo:400:kworker.0 00000100:00100000:2.0:1788361741.472601:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8aec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144285440:0@lo:400:kworker.0 00000100:00100000:1.0:1788361741.472612:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144285184:0@lo:400:kworker.0 00000100:00100000:3.0:1788361741.472619:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788361741.472626:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361741.472632:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144284928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361741.472653:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361741.472704:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144285312 00000100:00100000:3.0:1788361741.472710:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144284928:12345-0@lo:400:kworker.0 Request processed in 83us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361741.472711:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144284800 00000100:00100000:0.0:1788361741.472711:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144285312 00000100:00100000:1.0:1788361741.472719:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144284800 00000100:00100000:3.0:1788361741.472720:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788361741.472746:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144284928:0@lo:400:kworker.0 00000100:00080000:3.0:1788361741.472748:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361741.472763:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361741.472766:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144285440 00000100:00080000:3.0:1788361741.472770:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361741.472771:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144285440 00000100:00100000:1.0:1788361741.472778:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788361741.472791:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144284800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361741.472809:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144284672 00000100:00100000:3.0:1788361741.472815:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144284672 00002000:00000024:1.0:1788361741.472825:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361741.472826:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788361741.472843:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788361741.472844:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144285312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361741.472868:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8a7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144285440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361741.472869:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788361741.472883:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144284800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361741.472889:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144284672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361741.472900:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788361741.472900:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875232144285312:12345-0@lo:400:kworker.0 Request processed in 59us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361741.472911:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788361741.472950:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788361741.472959:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361741.472960:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144284672:12345-0@lo:400:kworker.0 Request processed in 74us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361741.472969:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788361741.472977:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8a7f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144285440:12345-0@lo:400:kworker.0 Request processed in 119us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361741.472989:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788361741.473001:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144284672:0@lo:400:kworker.0 00000100:00100000:0.0:1788361741.473009:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144284800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361741.473023:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144285184 00000100:00100000:3.0:1788361741.473030:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361741.473033:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144285184 00000100:00100000:0.0:1788361741.473035:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1875232144285312:0@lo:400:kworker.0 00000100:00100000:3.0:1788361741.473119:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144285056 00000100:00100000:2.0:1788361741.473127:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788361741.473129:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144285056 00000100:00100000:2.0:1788361741.473144:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144285184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361741.473185:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788361741.473197:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875232144285184:12345-0@lo:400:kworker.0 Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361741.473202:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144285056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361741.473209:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788361741.473258:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8aec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144285440:0@lo:400:kworker.0 00000100:00100000:1.0:1788361741.473273:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875232144285184:0@lo:400:kworker.0 00000100:00100000:3.0:1788361741.473289:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b066300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144285056:12345-0@lo:400:kworker.0 Request processed in 94us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361741.473300:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788361741.473324:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144285056:0@lo:400:kworker.0 00000040:00080000:2.0:1788361741.536509:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361741.536522:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361741.537076:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361741.537111:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361741.728240:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361741.984347:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144285568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361741.984416:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361741.984498:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144285568 00000100:00100000:0.0:1788361741.984505:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144285568 00000100:00100000:0.0:1788361741.984562:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788361741.984571:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144285568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361741.984605:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788361741.984771:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b067800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144285568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 200us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361741.984779:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788361741.984862:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144285568:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361742.755026:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361742.787841:0:45772:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361742.787850:0:45772:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361742.788762:0:45772:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361742.788772:0:45772:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361743.496351:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361743.496409:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361743.496446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361743.496479:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361743.496480:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130909056 00000100:00100000:1.0:1788361743.496491:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130909056 00000100:00100000:1.0:1788361743.496555:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:1.0:1788361743.496566:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130909056:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361743.496634:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130909056:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 69us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361743.496641:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00080000:1.0:1788361743.496662:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361743.496711:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130908800 00000100:00100000:0.0:1788361743.496717:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130908800 00000100:00100000:0.0:1788361743.496754:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:0.0:1788361743.496763:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130908800:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361743.496899:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130908800:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 129us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361743.496908:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:2.0:1788361743.496912:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130909312 00000100:00100000:2.0:1788361743.496918:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130909312 00000100:00100000:0.0:1788361743.496959:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130908928 00000100:00100000:2.0:1788361743.496964:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 273 00000100:00100000:0.0:1788361743.496966:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130908928 00000100:00100000:2.0:1788361743.496975:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130909312:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361743.497003:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 274 00000100:00100000:0.0:1788361743.497019:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130908928:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361743.498123:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130909312:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1146us (1672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361743.498132:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 273 00000100:00080000:2.0:1788361743.498166:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361743.498289:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361743.498354:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130909184 00000100:00100000:2.0:1788361743.498360:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130909184 00000100:00080000:3.0:1788361743.498392:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788361743.498405:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:2.0:1788361743.498415:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130909184:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361743.498475:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130909184:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 61us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361743.498482:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:0.0:1788361743.498553:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130908928:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 1539us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361743.498562:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 274 00010000:00010000:0.0:1788361743.777177:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361744.247566:0:45823:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361744.247575:0:45823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361744.248187:0:45823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361744.248196:0:45823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361744.800238:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361745.749510:0:45874:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361745.749517:0:45874:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361745.750019:0:45874:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361745.750029:0:45874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361745.824456:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361746.592702:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144285696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361746.592766:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361746.593384:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144286080:0@lo:400:kworker.0 00000100:00100000:1.0:1788361746.593413:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361746.593479:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144285696 00000100:00100000:2.0:1788361746.593488:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144285696 00000100:00100000:3.0:1788361746.593558:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144285952:0@lo:400:kworker.0 00000100:00100000:3.0:1788361746.593590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361746.594666:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144285824:0@lo:400:kworker.0 00000100:00100000:0.0:1788361746.594708:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361746.594785:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361746.594792:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144286208:0@lo:400:kworker.0 00000100:00100000:1.0:1788361746.594822:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361746.594871:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144285952 00000100:00100000:1.0:1788361746.594876:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144285952 00000100:00100000:1.0:1788361746.594917:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788361746.594926:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144285952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361746.594976:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90704380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144285952:12345-0@lo:400:kworker.0 Request processed in 52us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361746.594983:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788361746.595030:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144285824 00000100:00100000:1.0:1788361746.595033:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144285824 00000100:00100000:1.0:1788361746.595058:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788361746.595064:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144285824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361746.595110:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3313:x1875232144285824:12345-0@lo:400:kworker.0 Request processed in 45us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361746.595116:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788361746.595155:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144286080 00000100:00100000:1.0:1788361746.595159:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144286080 00000100:00100000:1.0:1788361746.595182:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144286208 00000100:00100000:1.0:1788361746.595186:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144286208 00000100:00100000:1.0:1788361746.595218:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788361746.595225:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144286080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361746.595260:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144286080:12345-0@lo:400:kworker.0 Request processed in 36us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361746.595266:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788361746.595289:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788361746.595296:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144286208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361746.595323:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a835e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144286208:12345-0@lo:400:kworker.0 Request processed in 28us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361746.595329:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788361746.595367:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144286208:0@lo:400:kworker.0 00000100:00100000:1.0:1788361746.595380:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144286080:0@lo:400:kworker.0 00000100:00080000:1.0:1788361746.595421:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361746.595426:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361746.595428:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361746.595677:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144285952:0@lo:400:kworker.0 00000100:00100000:2.0:1788361746.595976:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788361746.595986:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144285696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788361746.596013:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361746.596054:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3313:1875232144285824:0@lo:400:kworker.0 00000100:00100000:2.0:1788361746.596059:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144285696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (3291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361746.596066:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788361746.596069:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144286336:0@lo:400:kworker.0 00000100:00100000:0.0:1788361746.596124:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361746.596204:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144285696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361746.596260:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144286336 00000100:00100000:2.0:1788361746.596265:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144286336 00000100:00100000:2.0:1788361746.596351:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788361746.596359:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144286336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361746.596401:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144286336:12345-0@lo:400:kworker.0 Request processed in 41us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361746.596408:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788361746.596426:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144286336:0@lo:400:kworker.0 00000100:00080000:3.0:1788361746.596453:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361746.849213:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361747.104679:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144286464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361747.104751:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361747.105348:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144286464 00000100:00100000:1.0:1788361747.105355:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144286464 00000100:00100000:1.0:1788361747.105656:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788361747.105667:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144286464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361747.105700:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361747.105761:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144286464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361747.105768:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788361747.108570:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144286464:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788361747.201625:0:45925:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361747.201633:0:45925:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361747.202203:0:45925:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361747.202224:0:45925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361747.872257:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361748.615579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361748.617055:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130909440 00000100:00100000:1.0:1788361748.617068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361748.617070:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130909440 00000100:00100000:0.0:1788361748.617133:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130909696 00000100:00100000:0.0:1788361748.617139:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130909696 00000100:00100000:2.0:1788361748.617145:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:2.0:1788361748.617158:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130909440:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361748.617188:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:0.0:1788361748.617198:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130909696:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361748.619603:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130909440:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 2437us (4020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361748.619603:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130909696:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 2395us (2526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361748.619628:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:0.0:1788361748.619628:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00080000:0.0:1788361748.619671:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361748.620041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361748.620289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361748.620323:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361748.620357:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130909824 00000100:00100000:3.0:1788361748.620365:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130909824 00000100:00100000:3.0:1788361748.620409:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:3.0:1788361748.620418:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130909824:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361748.620467:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0567b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130909824:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 50us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361748.620475:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00080000:3.0:1788361748.620553:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361748.624312:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130909568 00000100:00100000:0.0:1788361748.624323:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130909568 00000100:00100000:0.0:1788361748.624387:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130909952 00000100:00100000:0.0:1788361748.624390:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130909952 00000100:00100000:0.0:1788361748.624413:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 278 00000100:00100000:0.0:1788361748.624421:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf1e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130909568:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361748.624487:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf1e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130909568:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 67us (4448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361748.624494:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 278 00000100:00100000:0.0:1788361748.624507:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 279 00000100:00100000:0.0:1788361748.624512:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130909952:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361748.624529:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130909952:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 17us (4207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361748.624535:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 279 00000100:00080000:2.0:1788361748.625149:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788361748.662152:0:45977:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361748.662160:0:45977:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361748.662919:0:45977:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361748.662929:0:45977:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361748.896496:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788361749.921317:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361750.051048:0:46028:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361750.051055:0:46028:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361750.051926:0:46028:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361750.051939:0:46028:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361750.944682:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361751.481525:0:46079:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361751.481535:0:46079:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361751.482394:0:46079:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361751.482404:0:46079:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361751.712436:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361751.712461:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144286592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361751.712507:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144286848:0@lo:400:kworker.0 00000100:00100000:0.0:1788361751.712534:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361751.712564:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361751.712602:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144286720:0@lo:400:kworker.0 00000100:00100000:2.0:1788361751.712605:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144287360:0@lo:400:kworker.0 00000100:00100000:0.0:1788361751.712647:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361751.712652:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361751.712673:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144287104:0@lo:400:kworker.0 00000100:00100000:3.0:1788361751.712680:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144286848 00000100:00100000:3.0:1788361751.712689:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144286848 00000100:00100000:2.0:1788361751.712690:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361751.712690:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144287232:0@lo:400:kworker.0 00000100:00100000:2.0:1788361751.712707:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144286976:0@lo:400:kworker.0 00000100:00100000:1.0:1788361751.712714:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361751.713047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361751.713064:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144286592 00000100:00100000:1.0:1788361751.713070:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144286592 00000100:00100000:1.0:1788361751.713120:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788361751.713128:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144286592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788361751.713160:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1788361751.713196:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144286592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361751.713203:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788361751.713226:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144286720 00000100:00100000:1.0:1788361751.713229:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144286720 00000100:00100000:1.0:1788361751.713267:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788361751.713342:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144286720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361751.713377:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144286720:12345-0@lo:400:kworker.0 Request processed in 104us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361751.713383:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788361751.713409:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144287360 00000100:00100000:1.0:1788361751.713412:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144287360 00000100:00100000:3.0:1788361751.714365:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144286976 00000100:00100000:1.0:1788361751.714372:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144287104 00000100:00100000:3.0:1788361751.714374:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144286976 00000100:00100000:1.0:1788361751.714378:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144287104 00000100:00100000:0.0:1788361751.714379:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788361751.714392:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8aec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144286848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361751.714431:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788361751.714441:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144287360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361751.714447:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8aec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144286848:12345-0@lo:400:kworker.0 Request processed in 57us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361751.714456:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788361751.714479:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144287360:12345-0@lo:400:kworker.0 Request processed in 40us (1829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361751.714480:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788361751.714488:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788361751.714495:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144286976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361751.714496:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788361751.714502:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ab710e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144287104:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361751.714535:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361751.714543:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361751.714547:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361751.714549:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144286976:12345-0@lo:400:kworker.0 Request processed in 57us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361751.714556:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ab710e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144287104:12345-0@lo:400:kworker.0 Request processed in 59us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361751.714559:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788361751.714570:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788361751.714612:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361751.714630:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144287104:0@lo:400:kworker.0 00000100:00100000:0.0:1788361751.714663:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144286592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361751.714664:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144286976:0@lo:400:kworker.0 00000100:00100000:1.0:1788361751.714677:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144287232 00000100:00100000:1.0:1788361751.714681:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144287232 00000100:00100000:3.0:1788361751.714691:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf189880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144287360:0@lo:400:kworker.0 00000100:00100000:0.0:1788361751.714699:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144286720:0@lo:400:kworker.0 00000100:00100000:3.0:1788361751.714711:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144286848:0@lo:400:kworker.0 00000100:00100000:1.0:1788361751.714763:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00080000:2.0:1788361751.714768:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361751.714773:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144287232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361751.714813:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144287232:12345-0@lo:400:kworker.0 Request processed in 42us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361751.714819:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788361751.714891:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144287232:0@lo:400:kworker.0 00000040:00080000:3.0:1788361751.776382:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361751.776390:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361751.776948:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361751.776957:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361751.968296:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361752.225328:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788361752.225351:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144287488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361752.225416:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361752.225590:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144287488 00000100:00100000:2.0:1788361752.225598:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144287488 00000100:00100000:2.0:1788361752.225644:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788361752.225653:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144287488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361752.225692:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361752.225738:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf189880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144287488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361752.225745:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788361752.225890:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144287488:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788361752.937671:0:46130:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361752.937681:0:46130:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361752.938310:0:46130:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361752.938320:0:46130:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361752.992374:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361753.735442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361753.735475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361753.735509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361753.735513:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130910080 00000100:00100000:2.0:1788361753.735523:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130910080 00000100:00100000:0.0:1788361753.735544:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130910208 00000100:00100000:0.0:1788361753.735555:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130910208 00000100:00100000:2.0:1788361753.735581:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:2.0:1788361753.735594:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130910080:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361753.735605:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361753.735613:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 283 00000100:00100000:0.0:1788361753.735624:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130910208:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361753.735667:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130910080:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361753.735668:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf188a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130910208:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 45us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361753.735684:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:0.0:1788361753.735685:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 283 00000100:00080000:2.0:1788361753.735726:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361753.735783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361753.735801:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130910336 00000100:00100000:2.0:1788361753.735802:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130910464 00000100:00100000:1.0:1788361753.735806:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130910336 00000100:00100000:2.0:1788361753.735808:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130910464 00000100:00100000:3.0:1788361753.735830:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130910592 00000100:00100000:3.0:1788361753.735835:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130910592 00000100:00100000:1.0:1788361753.735855:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:1.0:1788361753.735863:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130910336:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361753.735872:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 284 00000100:00100000:2.0:1788361753.735876:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 212 00000100:00100000:3.0:1788361753.735883:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130910592:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361753.735892:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130910464:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361753.735926:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf188700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130910336:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 52us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361753.735934:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:2.0:1788361753.736664:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf189f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130910464:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 774us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361753.736673:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 212 00000100:00080000:2.0:1788361753.736696:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788361753.736698:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf188e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130910592:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 814us (913us total) trans 0 rc 0/0 00000100:00080000:2.0:1788361753.736701:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361753.736706:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361753.736715:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 284 00010000:00010000:2.0:1788361754.016235:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361754.373809:0:46181:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361754.373817:0:46181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361754.374389:0:46181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361754.374398:0:46181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361755.040306:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361755.775627:0:46233:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361755.775634:0:46233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361755.776462:0:46233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361755.776474:0:46233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361756.065006:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361756.832343:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8abf18b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144287744:0@lo:400:kworker.0 00000100:00100000:1.0:1788361756.832382:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144287616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361756.832536:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144287872:0@lo:400:kworker.0 00000100:00100000:1.0:1788361756.833724:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361756.833779:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361756.833836:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361756.833886:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144288384:0@lo:400:kworker.0 00000100:00100000:1.0:1788361756.833888:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144288128:0@lo:400:kworker.0 00000100:00100000:3.0:1788361756.833949:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361756.833994:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144288384 00000100:00100000:3.0:1788361756.833999:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361756.834005:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144288384 00000100:00100000:3.0:1788361756.834012:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144288000:0@lo:400:kworker.0 00000100:00100000:3.0:1788361756.834060:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361756.834077:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788361756.834116:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144288384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361756.834155:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144287744 00000100:00100000:3.0:1788361756.834163:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144287744 00000100:00100000:1.0:1788361756.834186:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144288384:12345-0@lo:400:kworker.0 Request processed in 98us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361756.834196:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:1.0:1788361756.834233:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361756.834249:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361756.834295:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788361756.834306:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144288256:0@lo:400:kworker.0 00000100:00100000:1.0:1788361756.834340:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361756.834354:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144287616 00000100:00100000:0.0:1788361756.834361:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144287616 00000100:00100000:1.0:1788361756.834381:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144288128 00000100:00100000:1.0:1788361756.834387:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144288128 00000100:00100000:0.0:1788361756.834425:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788361756.834431:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144288256 00000100:00100000:1.0:1788361756.834436:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144288256 00000100:00100000:0.0:1788361756.834442:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144287616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361756.834468:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00002000:00000024:0.0:1788361756.834485:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1788361756.834494:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144288128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361756.834840:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788361756.834851:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144287744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361756.834952:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144288128:12345-0@lo:400:kworker.0 Request processed in 461us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361756.834961:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788361756.834988:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788361756.834993:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144287744:12345-0@lo:400:kworker.0 Request processed in 139us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361756.835003:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898b122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144288256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361756.835005:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788361756.835060:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144287872 00000100:00100000:1.0:1788361756.835061:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898b122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875232144288256:12345-0@lo:400:kworker.0 Request processed in 61us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361756.835070:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144287872 00000100:00100000:1.0:1788361756.835076:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:1.0:1788361756.835151:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361756.835155:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361756.835159:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361756.835166:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144288000 00000100:00100000:3.0:1788361756.835172:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144288000 00000100:00100000:1.0:1788361756.835177:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788361756.835189:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144287872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361756.835222:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788361756.835237:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144288000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361756.835246:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144287872:12345-0@lo:400:kworker.0 Request processed in 58us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361756.835266:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788361756.835289:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875232144288000:12345-0@lo:400:kworker.0 Request processed in 54us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361756.835299:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788361756.835328:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1875232144288256:0@lo:400:kworker.0 00000100:00100000:1.0:1788361756.835349:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144288128:0@lo:400:kworker.0 00000100:00100000:3.0:1788361756.835368:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144288000:0@lo:400:kworker.0 00000100:00100000:1.0:1788361756.835383:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144287616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361756.835396:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ab71b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144287872:0@lo:400:kworker.0 00000100:00100000:3.0:1788361756.835415:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144288384:0@lo:400:kworker.0 00000100:00100000:3.0:1788361756.835482:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8abf18b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144287744:0@lo:400:kworker.0 00000100:00100000:0.0:1788361756.835653:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144287616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1217us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361756.835661:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00010000:2.0:1788361757.088221:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361757.212355:0:46284:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361757.212362:0:46284:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361757.212802:0:46284:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361757.212810:0:46284:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:3.0:1788361757.345482:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144288512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361757.345547:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361757.345697:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144288512 00000100:00100000:1.0:1788361757.345704:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144288512 00000100:00100000:1.0:1788361757.345751:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788361757.345760:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144288512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361757.345793:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361757.345841:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89b4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144288512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361757.345848:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788361757.345959:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144288512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788361758.112363:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361758.630360:0:46335:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361758.630369:0:46335:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361758.630776:0:46335:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361758.630784:0:46335:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361758.856959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361758.857003:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361758.857039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361758.857123:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130910720 00000100:00100000:0.0:1788361758.857133:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130910720 00000100:00100000:0.0:1788361758.857190:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:0.0:1788361758.857209:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a89872a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130910720:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361758.857271:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130911104 00000100:00100000:3.0:1788361758.857276:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130911104 00000100:00100000:0.0:1788361758.857286:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a89872a0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2350:x1875232130910720:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 78us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361758.857295:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:3.0:1788361758.857315:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:3.0:1788361758.857325:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130911104:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361758.857360:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2349:x1875232130911104:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361758.857367:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:2.0:1788361758.857451:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130910848 00000100:00100000:2.0:1788361758.857456:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130910848 00000100:00100000:2.0:1788361758.857508:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 288 00000100:00100000:2.0:1788361758.857516:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8abf0aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130910848:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361758.857547:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8abf0aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2349:x1875232130910848:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361758.857554:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 288 00000100:00080000:1.0:1788361758.857890:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788361758.857895:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361758.858824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361758.858873:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361758.859837:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130910976 00000100:00100000:3.0:1788361758.859846:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130910976 00000100:00100000:3.0:1788361758.859923:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:3.0:1788361758.859934:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130910976:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:0.0:1788361758.859963:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361758.860017:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2350:x1875232130910976:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 85us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361758.860024:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:1.0:1788361758.860122:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130911232 00000100:00100000:1.0:1788361758.860127:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130911232 00000100:00100000:1.0:1788361758.860167:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 289 00000100:00100000:1.0:1788361758.860176:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130911232:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361758.860234:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2350:x1875232130911232:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 58us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361758.860241:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 289 00000100:00080000:3.0:1788361758.860542:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788361759.137466:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361760.052387:0:46386:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361760.052397:0:46386:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361760.052900:0:46386:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361760.052909:0:46386:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361760.161259:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788361761.184333:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361761.409825:0:46437:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361761.409834:0:46437:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361761.410391:0:46437:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361761.410400:0:46437:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361761.952399:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144288896:0@lo:400:kworker.0 00000100:00100000:1.0:1788361761.952485:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361761.952539:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144288896 00000100:00100000:2.0:1788361761.952548:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144288896 00000100:00100000:1.0:1788361761.952563:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144289408:0@lo:400:kworker.0 00000100:00100000:1.0:1788361761.952610:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361761.952616:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788361761.952638:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a898764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144288896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361761.952638:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361761.952650:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144289024:0@lo:400:kworker.0 00000100:00100000:1.0:1788361761.952677:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361761.952704:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a898764bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144288896:12345-0@lo:400:kworker.0 Request processed in 70us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361761.952710:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788361761.952738:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144288896:0@lo:400:kworker.0 00000100:00100000:2.0:1788361761.952754:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144288768:0@lo:400:kworker.0 00000100:00100000:2.0:1788361761.952787:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361761.952795:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144289408 00000100:00100000:1.0:1788361761.952800:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144289408 00000100:00100000:2.0:1788361761.952812:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144289280:0@lo:400:kworker.0 00000100:00100000:1.0:1788361761.952838:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144289024 00000100:00100000:1.0:1788361761.952842:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144289024 00000100:00100000:1.0:1788361761.952884:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788361761.952894:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144289408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361761.952902:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788361761.952906:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361761.952922:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144289024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361761.952950:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144289408:12345-0@lo:400:kworker.0 Request processed in 58us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361761.952953:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144289280 00000100:00100000:2.0:1788361761.952959:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144289280 00000100:00100000:1.0:1788361761.952960:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788361761.952989:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144289024:12345-0@lo:400:kworker.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361761.953003:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788361761.953014:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144289280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361761.953016:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788361761.953058:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144289280:12345-0@lo:400:kworker.0 Request processed in 46us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361761.953076:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788361761.953195:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144288640:0@lo:400:kworker.0 00000100:00100000:3.0:1788361761.953230:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361761.953255:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144289152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361761.953318:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361761.953345:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144289024:0@lo:400:kworker.0 00000100:00100000:1.0:1788361761.953356:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144289408:0@lo:400:kworker.0 00000100:00080000:3.0:1788361761.953366:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361761.953375:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788361761.953386:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144288640 00000100:00100000:3.0:1788361761.953389:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144288640 00000100:00100000:3.0:1788361761.953416:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788361761.953421:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144288640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361761.953445:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144288768 00000100:00100000:1.0:1788361761.953449:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144288768 00000100:00100000:3.0:1788361761.953452:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144288640:12345-0@lo:400:kworker.0 Request processed in 32us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361761.953458:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788361761.953478:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788361761.953484:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144289152 00000100:00100000:1.0:1788361761.953485:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8ae7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144288768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361761.953488:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144289152 00000100:00100000:3.0:1788361761.953510:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788361761.953514:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8ae7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144288768:12345-0@lo:400:kworker.0 Request processed in 30us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361761.953516:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144289152:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361761.953523:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00002000:00000024:3.0:1788361761.953543:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:3.0:1788361761.953573:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144289152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361761.953580:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:3.0:1788361761.953591:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788361761.953601:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a90706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144288640:0@lo:400:kworker.0 00000100:00100000:3.0:1788361761.953613:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144289152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788361761.953636:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8a7f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144288768:0@lo:400:kworker.0 00000100:00100000:3.0:1788361761.953642:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144289280:0@lo:400:kworker.0 00000040:00080000:1.0:1788361762.016544:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361762.016553:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361762.017163:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361762.017183:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:1.0:1788361762.208293:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361762.464311:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361762.464335:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144289536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361762.464403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361762.464531:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144289536 00000100:00100000:2.0:1788361762.464540:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144289536 00000100:00100000:2.0:1788361762.464593:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788361762.464602:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144289536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361762.464635:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361762.464703:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144289536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361762.464710:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788361762.464745:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144289536:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788361762.784205:0:46490:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361762.784214:0:46490:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361762.784743:0:46490:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361762.784752:0:46490:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361763.232249:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361763.975951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361763.976223:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130911360 00000100:00100000:1.0:1788361763.976240:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130911360 00000100:00100000:0.0:1788361763.976316:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361763.976326:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:1.0:1788361763.976340:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130911360:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361763.976358:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361763.976384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1788361763.976436:0:37551:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130911488 00000100:00100000:1.0:1788361763.976446:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130911360:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 106us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361763.976451:0:37551:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130911488 00000100:00100000:1.0:1788361763.976460:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:1.0:1788361763.976509:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130911616 00000100:00100000:1.0:1788361763.976513:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130911616 00000100:00100000:1.0:1788361763.976546:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130911744 00000100:00100000:1.0:1788361763.976548:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130911744 00000100:00100000:1.0:1788361763.976575:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:1.0:1788361763.976582:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130911616:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361763.976607:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130911616:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361763.976617:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 293 00000100:00100000:1.0:1788361763.976624:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:1.0:1788361763.976650:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00100000:0.0:1788361763.976651:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130911488:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361763.976661:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130911744:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361763.976680:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130911744:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 23us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361763.976684:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00080000:1.0:1788361763.976837:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788361763.976841:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361763.976843:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788361763.976865:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130911488:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 224us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361763.976876:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 293 00000100:00100000:0.0:1788361763.978250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361763.978343:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130911872 00000100:00100000:1.0:1788361763.978351:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130911872 00000100:00100000:1.0:1788361763.978404:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 294 00000100:00100000:1.0:1788361763.978409:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130911872:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361763.978521:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130911872:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361763.978527:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 294 00000100:00080000:3.0:1788361763.978823:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788361764.189624:0:46541:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361764.189632:0:46541:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361764.190360:0:46541:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361764.190372:0:46541:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361764.256250:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788361765.281472:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361765.565832:0:46592:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361765.565842:0:46592:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361765.566366:0:46592:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361765.566379:0:46592:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361766.304269:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361766.938467:0:46643:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361766.938477:0:46643:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361766.938993:0:46643:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361766.939003:0:46643:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361767.072407:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144289664:0@lo:400:kworker.0 00000100:00100000:1.0:1788361767.072469:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144289920:0@lo:400:kworker.0 00000100:00100000:0.0:1788361767.072489:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361767.072525:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361767.072555:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788361767.072561:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144290048:0@lo:400:kworker.0 00000100:00100000:1.0:1788361767.072583:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361767.072614:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144289664 00000100:00100000:1.0:1788361767.072621:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144289664 00000100:00100000:1.0:1788361767.072659:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788361767.072667:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144289664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361767.072916:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144290176:0@lo:400:kworker.0 00000100:00100000:1.0:1788361767.072921:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144289664:12345-0@lo:400:kworker.0 Request processed in 253us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361767.072929:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788361767.072957:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144289920 00000100:00100000:2.0:1788361767.072964:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144289920 00000100:00100000:0.0:1788361767.072965:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361767.072984:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144289792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361767.073005:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144289664:0@lo:400:kworker.0 00000100:00100000:3.0:1788361767.073014:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144290432:0@lo:400:kworker.0 00000100:00100000:1.0:1788361767.073021:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361767.073034:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144290048 00000100:00100000:2.0:1788361767.073039:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144290048 00000100:00100000:1.0:1788361767.073055:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144290304:0@lo:400:kworker.0 00000100:00100000:0.0:1788361767.073061:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788361767.073072:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788361767.073076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361767.073076:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361767.073112:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144290048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361767.073131:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144290176 00000100:00100000:1.0:1788361767.073135:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144290176 00000100:00100000:1.0:1788361767.073182:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144290432 00000100:00100000:1.0:1788361767.073187:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144290432 00000100:00100000:3.0:1788361767.073191:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144290048:0@lo:400:kworker.0 00000100:00100000:2.0:1788361767.073192:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144290048:12345-0@lo:400:kworker.0 Request processed in 106us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361767.073193:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144289920:12345-0@lo:400:kworker.0 Request processed in 122us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361767.073213:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144289920:0@lo:400:kworker.0 00000100:00100000:2.0:1788361767.073219:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788361767.073225:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788361767.073226:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788361767.073240:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144290176:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788361767.073248:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361767.073255:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361767.073259:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361767.073267:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1788361767.073273:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144289792 00000100:00100000:0.0:1788361767.073279:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144290432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361767.073280:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144289792 00000100:00100000:1.0:1788361767.073288:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144290176:12345-0@lo:400:kworker.0 Request processed in 53us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361767.073295:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788361767.073319:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361767.073322:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788361767.073328:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144290432:12345-0@lo:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361767.073336:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144289792:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361767.073341:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788361767.073354:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144290432:0@lo:400:kworker.0 00000100:00100000:1.0:1788361767.073354:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144290304 00000100:00100000:1.0:1788361767.073366:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144290304 00002000:00000024:2.0:1788361767.073369:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361767.073375:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144290176:0@lo:400:kworker.0 00000100:00080000:3.0:1788361767.073402:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361767.073408:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788361767.073420:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144290304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788361767.073426:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144289792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361767.073435:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788361767.073460:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144289792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361767.073465:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144290304:12345-0@lo:400:kworker.0 Request processed in 46us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361767.073474:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788361767.073478:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144290304:0@lo:400:kworker.0 00010000:00010000:2.0:1788361767.328234:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361767.585421:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144290560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361767.585498:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361767.585542:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144290560 00000100:00100000:1.0:1788361767.585550:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144290560 00000100:00100000:1.0:1788361767.585607:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788361767.585618:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144290560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361767.585652:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361767.585704:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144290560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361767.585712:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788361767.585749:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144290560:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788361768.311655:0:46694:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361768.311664:0:46694:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361768.312184:0:46694:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361768.312195:0:46694:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361768.352323:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361769.095561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361769.095598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361769.095631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361769.095662:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130912000 00000100:00100000:2.0:1788361769.095665:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130912256 00000100:00100000:1.0:1788361769.095672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361769.095674:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130912000 00000100:00100000:2.0:1788361769.095674:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130912256 00000100:00100000:1.0:1788361769.095708:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361769.095733:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:2.0:1788361769.095740:0:35983:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130912384 00000100:00100000:2.0:1788361769.095746:0:35983:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130912384 00000100:00100000:3.0:1788361769.095747:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130912000:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361769.095771:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:0.0:1788361769.095776:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130912512 00000100:00100000:2.0:1788361769.095783:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130912256:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361769.095783:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130912512 00000100:00100000:3.0:1788361769.095822:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130912000:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361769.095824:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130912128 00000100:00100000:2.0:1788361769.095828:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130912256:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361769.095830:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130912128 00000100:00100000:3.0:1788361769.095839:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:2.0:1788361769.095843:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:0.0:1788361769.095863:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 298 00000100:00100000:2.0:1788361769.095868:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:0.0:1788361769.095876:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130912512:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361769.095881:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130912384:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:3.0:1788361769.095888:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788361769.095893:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788361769.095896:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361769.095919:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130912512:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361769.095927:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 298 00000100:00100000:2.0:1788361769.095935:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130912384:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 57us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361769.095945:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:0.0:1788361769.095953:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 299 00000100:00100000:0.0:1788361769.095963:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130912128:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361769.095992:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130912128:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 32us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361769.096000:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 299 00010000:00010000:2.0:1788361769.376647:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361769.724962:0:46746:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361769.724970:0:46746:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361769.725487:0:46746:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361769.725496:0:46746:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361770.400269:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361771.114507:0:46797:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361771.114516:0:46797:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361771.115263:0:46797:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361771.115273:0:46797:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361771.424317:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788361772.192299:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144290816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361772.192341:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144290944:0@lo:400:kworker.0 00000100:00100000:0.0:1788361772.192363:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144290688:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.192373:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361772.192385:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.192431:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144291328:0@lo:400:kworker.0 00000100:00100000:0.0:1788361772.193287:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361772.193315:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144291456:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.193324:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361772.193328:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144291200:0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.193359:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.193363:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144290816 00000100:00100000:2.0:1788361772.193371:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144290816 00000100:00100000:0.0:1788361772.193375:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144291072:0@lo:400:kworker.0 00000100:00100000:0.0:1788361772.193408:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361772.193424:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144290944 00000100:00100000:1.0:1788361772.193431:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144290944 00000100:00100000:2.0:1788361772.193435:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788361772.193449:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875232144290816:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361772.193449:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144291072 00000100:00100000:0.0:1788361772.193455:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144291072 00000100:00100000:1.0:1788361772.193474:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00002000:00000024:2.0:1788361772.193486:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:1.0:1788361772.193486:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144290944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361772.193498:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788361772.193508:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144291072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.193548:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144290944:12345-0@lo:400:kworker.0 Request processed in 65us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.193556:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a8926d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875232144290816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361772.193564:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788361772.193565:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875232144291072:12345-0@lo:400:kworker.0 Request processed in 55us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.193570:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788361772.193580:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788361772.193599:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144290688 00000100:00080000:2.0:1788361772.193600:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788361772.193605:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144290688 00000100:00080000:2.0:1788361772.193606:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361772.193643:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144291072:0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.193648:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788361772.193658:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a8ae7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1875232144290816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361772.193659:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144290688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.193701:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3311:x1875232144290688:12345-0@lo:400:kworker.0 Request processed in 44us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.193709:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144291328 00000100:00100000:1.0:1788361772.193709:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788361772.193715:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144291328 00000100:00100000:0.0:1788361772.193731:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144290944:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.193754:0:35347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144291456 00000100:00100000:2.0:1788361772.193759:0:35347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144291456 00000100:00100000:0.0:1788361772.193776:0:37551:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788361772.193788:0:37551:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144291328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.193793:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361772.193798:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788361772.193809:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144291456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361772.193838:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f680700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3311:1875232144290688:0@lo:400:kworker.0 00000100:00100000:0.0:1788361772.193846:0:37551:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144291328:12345-0@lo:400:kworker.0 Request processed in 59us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361772.193855:0:37551:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788361772.193868:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875232144291456:12345-0@lo:400:kworker.0 Request processed in 60us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361772.193872:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144291200 00000100:00100000:1.0:1788361772.193877:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144291200 00000100:00100000:2.0:1788361772.193878:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788361772.193899:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1875232144291456:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.193905:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788361772.193916:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9075d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144291200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361772.193936:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144291328:0@lo:400:kworker.0 00000100:00100000:2.0:1788361772.193962:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9075d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144291200:12345-0@lo:400:kworker.0 Request processed in 48us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361772.193970:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788361772.193975:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144291200:0@lo:400:kworker.0 00000100:00080000:2.0:1788361772.193990:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1788361772.256433:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361772.256449:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361772.257032:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361772.257047:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361772.448269:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361772.549826:0:46848:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361772.549840:0:46848:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361772.550418:0:46848:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361772.550428:0:46848:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361772.704425:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144291584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788361772.704495:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361772.704558:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144291584 00000100:00100000:1.0:1788361772.704567:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144291584 00000100:00100000:1.0:1788361772.704619:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788361772.704629:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144291584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788361772.704674:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:1.0:1788361772.704728:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144291584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361772.704735:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788361772.704897:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144291584:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788361773.472371:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361773.930345:0:46899:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361773.930353:0:46899:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361773.930925:0:46899:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361773.930935:0:46899:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:2.0:1788361774.215927:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361774.215962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1788361774.215984:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361774.215990:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130912640 00000100:00100000:3.0:1788361774.215999:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130912640 00000100:00100000:1.0:1788361774.216016:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130912768 00000100:00100000:2.0:1788361774.216022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361774.216023:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130912768 00000100:00100000:3.0:1788361774.216049:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:3.0:1788361774.216061:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130912640:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361774.216063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361774.216069:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 303 00000100:00100000:1.0:1788361774.216077:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130912768:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:2.0:1788361774.216130:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361774.216146:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130913152 00000100:00100000:2.0:1788361774.216151:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130913152 00000100:00100000:3.0:1788361774.216176:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2351:x1875232130912640:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 116us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361774.216176:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0573480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2352:x1875232130912768:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361774.216186:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:1.0:1788361774.216186:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 303 00000100:00100000:0.0:1788361774.216199:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130913024 00000100:00100000:2.0:1788361774.216201:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 304 00000100:00100000:0.0:1788361774.216206:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130913024 00000100:00100000:2.0:1788361774.216215:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130913152:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361774.216245:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130912896 00000100:00080000:3.0:1788361774.216249:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361774.216250:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130912896 00000100:00100000:2.0:1788361774.216255:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2351:x1875232130913152:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 42us (195us total) trans 0 rc 0/0 00000100:00080000:3.0:1788361774.216262:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788361774.216267:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361774.216268:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 304 00000100:00100000:0.0:1788361774.216285:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:0.0:1788361774.216294:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130913024:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361774.216314:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00100000:3.0:1788361774.216325:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130912896:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361774.216332:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2352:x1875232130913024:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 37us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361774.216341:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:3.0:1788361774.216361:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2351:x1875232130912896:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361774.216369:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 228 00010000:00010000:0.0:1788361774.496709:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788361775.360015:0:46950:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:0.0:1788361775.360022:0:46950:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788361775.360504:0:46950:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:0.0:1788361775.360513:0:46950:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361775.520642:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788361776.544216:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788361776.762334:0:47002:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361776.762345:0:47002:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361776.762902:0:47002:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361776.762911:0:47002:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:0.0:1788361777.312282:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144291840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788361777.312298:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9075d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144291968:0@lo:400:kworker.0 00000100:00100000:3.0:1788361777.312340:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9075dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144291712:0@lo:400:kworker.0 00000100:00100000:1.0:1788361777.312351:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9075c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144292096:0@lo:400:kworker.0 00000100:00100000:0.0:1788361777.312512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361777.312571:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9075ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144292224:0@lo:400:kworker.0 00000100:00100000:0.0:1788361777.312600:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361777.312633:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144291840 00000100:00100000:0.0:1788361777.312640:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144291840 00000100:00100000:0.0:1788361777.312694:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788361777.312702:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144291840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361777.312734:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:2.0:1788361777.312780:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361777.313127:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144291840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 423us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361777.313135:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1788361777.313159:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788361777.313197:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361777.313205:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144291840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788361777.313242:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788361777.313251:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9077f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144292480:0@lo:400:kworker.0 00000100:00100000:0.0:1788361777.313253:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144291968 00000100:00100000:1.0:1788361777.313282:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788361777.313310:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144292224 00000100:00100000:1.0:1788361777.313314:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144292224 00000100:00100000:1.0:1788361777.313342:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144292480 00000100:00100000:0.0:1788361777.313344:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144291968 00000100:00100000:1.0:1788361777.313347:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144292480 00000100:00100000:3.0:1788361777.313364:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361777.313402:0:35982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144292096 00000100:00100000:1.0:1788361777.313408:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788361777.313408:0:35982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144292096 00000100:00100000:1.0:1788361777.313423:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144292224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361777.313447:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144292352:0@lo:400:kworker.0 00000100:00100000:0.0:1788361777.313453:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788361777.313472:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8ac0571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144291968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361777.313485:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875232144292224:12345-0@lo:400:kworker.0 Request processed in 65us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361777.313492:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788361777.313509:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788361777.313519:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9073bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144292480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361777.313523:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8ac0571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144291968:12345-0@lo:400:kworker.0 Request processed in 56us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361777.313532:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788361777.313538:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9075d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144291968:0@lo:400:kworker.0 00000100:00100000:0.0:1788361777.313551:0:35982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788361777.313560:0:35982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144292096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788361777.313564:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9073bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875232144292480:12345-0@lo:400:kworker.0 Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361777.313572:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788361777.313611:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361777.313613:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144291712 00000100:00100000:1.0:1788361777.313617:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9077f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1875232144292480:0@lo:400:kworker.0 00000100:00100000:0.0:1788361777.313619:0:35982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90738a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144292096:12345-0@lo:400:kworker.0 Request processed in 58us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361777.313621:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144291712 00000100:00100000:0.0:1788361777.313635:0:35982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788361777.313651:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9075c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144292096:0@lo:400:kworker.0 00000100:00100000:2.0:1788361777.313684:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788361777.313694:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144291712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361777.313697:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9075ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875232144292224:0@lo:400:kworker.0 00000100:00100000:3.0:1788361777.313703:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144292352 00000100:00100000:3.0:1788361777.313714:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144292352 00000100:00080000:1.0:1788361777.313715:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361777.313725:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361777.313761:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144291712:12345-0@lo:400:kworker.0 Request processed in 66us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361777.313769:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788361777.313793:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9075dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144291712:0@lo:400:kworker.0 00000100:00100000:3.0:1788361777.313795:0:37122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788361777.313815:0:37122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144292352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361777.313870:0:37122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144292352:12345-0@lo:400:kworker.0 Request processed in 61us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361777.313875:0:37122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788361777.313916:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac1565f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144292352:0@lo:400:kworker.0 00000100:00080000:1.0:1788361777.314381:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788361777.568312:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361777.824633:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144292608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788361777.824722:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788361777.824821:0:35984:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144292608 00000100:00100000:2.0:1788361777.824830:0:35984:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144292608 00000100:00100000:2.0:1788361777.824879:0:35984:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788361777.824887:0:35984:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9073aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144292608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788361777.824924:0:35984:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:2.0:1788361777.824988:0:35984:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9073aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144292608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361777.824995:0:35984:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788361777.825122:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0571880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144292608:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788361778.198687:0:47053:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:3.0:1788361778.198696:0:47053:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788361778.199257:0:47053:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:3.0:1788361778.199266:0:47053:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361778.592216:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788361779.336017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361779.336134:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361779.336180:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361779.336215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361779.336232:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130913408 00000100:00100000:0.0:1788361779.336243:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130913536 00000100:00100000:3.0:1788361779.336248:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130913408 00000100:00100000:0.0:1788361779.336251:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130913536 00000100:00100000:1.0:1788361779.336257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361779.336308:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130913792 00000100:00100000:1.0:1788361779.336318:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130913792 00000100:00100000:0.0:1788361779.336338:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130913664 00000100:00100000:0.0:1788361779.336344:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130913664 00000100:00100000:3.0:1788361779.336356:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 308 00000100:00100000:3.0:1788361779.336370:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130913408:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361779.336377:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:0.0:1788361779.336387:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130913536:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361779.336425:0:35341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130913280 00000100:00100000:2.0:1788361779.336434:0:35341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130913280 00000100:00100000:0.0:1788361779.336467:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90739f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+10:2352:x1875232130913536:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 75us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361779.336476:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:2.0:1788361779.336493:0:35341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:0.0:1788361779.336504:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 232 00000100:00100000:0.0:1788361779.336530:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9073b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130913664:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361779.336578:0:35341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130913280:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361779.336786:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90738700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c05f3090-241b-43d5-9787-08721e3d4333+55:2351:x1875232130913408:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 417us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361779.336810:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9073b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c05f3090-241b-43d5-9787-08721e3d4333+13:2351:x1875232130913664:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 283us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361779.336819:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 232 00000100:00100000:2.0:1788361779.336847:0:35341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2352:x1875232130913280:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 341us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361779.336949:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 309 00000100:00100000:2.0:1788361779.336979:0:35341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00080000:2.0:1788361779.337047:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788361779.337053:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788361779.337067:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788361779.337180:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9073b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130913792:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361779.337235:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 308 00000100:00100000:1.0:1788361779.337237:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9073b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2352:x1875232130913792:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 277us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361779.337249:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 309 00010000:00010000:3.0:1788361779.617071:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361779.636390:0:47104:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361779.636403:0:47104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361779.636938:0:47104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361779.636947:0:47104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:0.0:1788361780.640561:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788361781.061693:0:47155:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361781.061702:0:47155:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361781.062437:0:47155:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361781.062448:0:47155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:2.0:1788361781.664249:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788361782.432256:0:3311:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a9f683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144292736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361782.432328:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361782.432396:0:37998:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144292736 00000100:00100000:0.0:1788361782.432401:0:37998:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144292736 00000100:00100000:0.0:1788361782.432454:0:37998:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788361782.432461:0:37998:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144292736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788361782.432490:0:37998:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 321978368 pending 0 free 3704619008 avail 3702521856 00000100:00100000:0.0:1788361782.432526:0:37998:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875232144292736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361782.432531:0:37998:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788361782.432536:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144292992:0@lo:400:kworker.0 00000100:00080000:0.0:1788361782.432548:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788361782.432559:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144292864:0@lo:400:kworker.0 00000100:00100000:3.0:1788361782.432579:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361782.432592:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788361782.432611:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788361782.432620:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144293376:0@lo:400:kworker.0 00000100:00100000:3.0:1788361782.432623:0:3313:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144293120:0@lo:400:kworker.0 00000100:00100000:0.0:1788361782.432649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361782.432912:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788361782.432917:0:3312:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8a89b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144293248:0@lo:400:kworker.0 00000100:00100000:0.0:1788361782.432934:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361782.432969:0:3311:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a9f683100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1875232144292736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788361782.432985:0:35980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144292992 00000100:00100000:0.0:1788361782.432987:0:35980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144292992 00000100:00100000:0.0:1788361782.433008:0:35980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788361782.433013:0:35980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144292992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361782.433051:0:35980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875232144292992:12345-0@lo:400:kworker.0 Request processed in 38us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361782.433056:0:35980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788361782.433069:0:35340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144292864 00000100:00100000:0.0:1788361782.433072:0:35340:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144292864 00000100:00100000:0.0:1788361782.433148:0:35340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788361782.433155:0:35340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144292864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788361782.433182:0:35340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:dd4618f9-dd70-46a6-81c4-d61716ccf4f3+19:3312:x1875232144292864:12345-0@lo:400:kworker.0 Request processed in 29us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361782.433186:0:35340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788361782.433260:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144293376 00000100:00100000:0.0:1788361782.433264:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144293376 00000100:00100000:0.0:1788361782.433329:0:37122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144293248 00000100:00100000:0.0:1788361782.433333:0:37122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144293248 00000100:00100000:3.0:1788361782.433372:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788361782.433381:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144293376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361782.433418:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875232144293376:12345-0@lo:400:kworker.0 Request processed in 38us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361782.433426:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788361782.433440:0:35347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788361782.433448:0:35347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144293248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361782.433474:0:35347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875232144293248:12345-0@lo:400:kworker.0 Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361782.433479:0:35347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:0.0:1788361782.433618:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788361782.433623:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788361782.433652:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1875232144293248:0@lo:400:kworker.0 00000100:00100000:0.0:1788361782.433662:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:dd4618f9-dd70-46a6-81c4-d61716ccf4f3:3312:1875232144292864:0@lo:400:kworker.0 00000100:00100000:0.0:1788361782.433672:0:3312:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1875232144293376:0@lo:400:kworker.0 00000100:00100000:0.0:1788361782.433705:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361782.433781:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1875232144292992:0@lo:400:kworker.0 00000100:00100000:3.0:1788361782.433945:0:35346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144293120 00000100:00100000:3.0:1788361782.433950:0:35346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144293120 00000100:00100000:3.0:1788361782.433982:0:35346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788361782.433989:0:35346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9f683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144293120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788361782.434029:0:35346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9f683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875232144293120:12345-0@lo:400:kworker.0 Request processed in 40us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361782.434044:0:35346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788361782.434055:0:3313:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8a89b4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875232144293120:0@lo:400:kworker.0 00000040:00080000:1.0:1788361782.496304:0:35380:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361782.496314:0:35380:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361782.496751:0:35380:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361782.496763:0:35380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000040:00080000:1.0:1788361782.504449:0:47206:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:1.0:1788361782.504456:0:47206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788361782.505222:0:47206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:1.0:1788361782.505235:0:47206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00010000:00010000:3.0:1788361782.691078:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788361782.944314:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788361782.945214:0:3314:0:(client.c:1909:ptlrpc_send_new_req()) Sending RPC req@ffff9a8ac0570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144293504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788361782.945281:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788361782.945450:0:35985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232144293504 00000100:00100000:0.0:1788361782.945459:0:35985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232144293504 00000100:00100000:0.0:1788361782.945555:0:35985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788361782.945565:0:35985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a89b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144293504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788361782.945601:0:35985:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 218038272 pending 0 free 3767533568 avail 3765436416 00000100:00100000:0.0:1788361782.945734:0:35985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a89b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875232144293504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 169us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361782.945742:0:35985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788361782.945815:0:3314:0:(client.c:2404:ptlrpc_check_set()) Completed RPC req@ffff9a8ac0570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1875232144293504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788361783.717210:0:35334:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788361783.969184:0:47258:0:(llog.c:805:llog_process_thread()) index: 7, lh_last_idx: 7 synced_idx: 7 lgh_last_idx: 7 00000040:00080000:2.0:1788361783.969190:0:47258:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x2c:0x0] at index 7 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788361783.969818:0:47258:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x2c:0x0] index 64768 count 1 00000040:00080000:2.0:1788361783.969826:0:47258:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 8 count 2 00000100:00100000:1.0:1788361784.456386:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361784.456428:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361784.456455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361784.456483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1788361784.456509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1788361784.456588:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130914048 00000100:00100000:3.0:1788361784.456596:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130914048 00000100:00100000:3.0:1788361784.456661:0:35345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130914432 00000100:00100000:3.0:1788361784.456664:0:35345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130914432 00000100:00100000:3.0:1788361784.456688:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 313 00000100:00100000:3.0:1788361784.456697:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9073a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130914048:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361784.456766:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9073a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c05f3090-241b-43d5-9787-08721e3d4333+55:2350:x1875232130914048:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 69us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361784.456773:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 313 00000100:00100000:3.0:1788361784.456790:0:35345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 314 00000100:00100000:3.0:1788361784.456796:0:35345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130914432:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1788361784.456820:0:35345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90739180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3f3d107-dc70-4b5c-ae8d-f9aeb6aa1008+5:2349:x1875232130914432:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788361784.456826:0:35345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 314 00000100:00080000:1.0:1788361784.456976:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788361784.457669:0:35339:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130913920 00000100:00100000:2.0:1788361784.457676:0:35339:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130913920 00000100:00100000:2.0:1788361784.457755:0:35339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:2.0:1788361784.457764:0:35339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8987920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130913920:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1788361784.457812:0:35339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8987920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bd12fa5b-f901-4872-ad58-55985ec8f4aa+13:2349:x1875232130913920:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 49us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788361784.457818:0:35339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:0.0:1788361784.457836:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130914304 00000100:00100000:0.0:1788361784.457840:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130914304 00000100:00100000:0.0:1788361784.457874:0:36286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875232130914176 00000100:00100000:0.0:1788361784.457878:0:36286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875232130914176 00000100:00100000:0.0:1788361784.457899:0:36286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 234 00000100:00100000:0.0:1788361784.457911:0:36286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a90738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130914304:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1788361784.457943:0:36286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a90738000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c05f3090-241b-43d5-9787-08721e3d4333+13:2350:x1875232130914304:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788361784.457949:0:36286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 234 00000100:00100000:1.0:1788361784.457961:0:35983:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:1.0:1788361784.457968:0:35983:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9a8a9073b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130914176:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1788361784.457999:0:35983:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9a8a9073b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c05f3090-241b-43d5-9787-08721e3d4333+10:2349:x1875232130914176:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 27us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788361784.458005:0:35983:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00080000:1.0:1788361784.458132:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788361784.458135:0:35342:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788361784.736347:0:35335:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788361785.659422:0:47308:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_13a: @@@@@@ FAIL: request on 0x2000032e1:0x37:0x0 is not SUCCEED on mds1 00010000:00010000:3.0:1788361785.760200:0:36289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 74694 lines, 74694 kept, 0 dropped, 0 bad.